Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/llvm/llvm-lnt


https://github.com/llvm/llvm-lnt

Handle cases where there is no results

Make sure LNT does not fail when test result is empty.

llvm-svn: 213128

f20f0f656da063eb77d913d6fcf31af54244db18 authored over 10 years ago by Yi Kong <[email protected]>
Show geomean for filtered tests

LNT shows geomean for all tests, even if user filters a subset of tests.

This patch lets LNT to...

a80ea960acaf27483f27e46456c7b92af7b28a2b authored over 10 years ago by Yi Kong <[email protected]>
Add option to show small differences

LNT ignores small changes by default to save users from getting
excessive amount of results. How...

586f8bd6d488296e15c550288390367577ee1cd6 authored over 10 years ago by Yi Kong <[email protected]>
Whitespace cleanup

llvm-svn: 212985

e39d4b4d6cab9a7ce83f1627cf32583ba2662b3e authored over 10 years ago by Chris Matthews <[email protected]>
Add missing parameter for compile tests

llvm-svn: 212984

21795a49e8db4f40e7c8edc08762ec71a225b486 authored over 10 years ago by Chris Matthews <[email protected]>
Fix missing import from my bad merge

llvm-svn: 212746

9db1e88e6c661e8835a905f42068269350e1bdc2 authored over 10 years ago by Chris Matthews <[email protected]>
Fix server bug in client result reporting

LNT client was reporting everything as UNCHANGED_PASS, because a
comparison_window of 0, each re...

6a1b30138ba3f294143bf0c74fcac25145faefd3 authored over 10 years ago by Chris Matthews <[email protected]>
Support update for Reports

Both multisample and LNT report need ways to update reports. This patch
adds some simple functi...

5fd63a9d007dfc669faeab3c097bfaef6b6dbb72 authored over 10 years ago by Chris Matthews <[email protected]>
Fix hanging comment

llvm-svn: 212739

152c6d109f6e7a922bd53e7ef404695ae47ced8f authored over 10 years ago by Chris Matthews <[email protected]>
Remove unused import

llvm-svn: 212738

21c6c37a6c9ad1003f6ec1be0cef468a146bbff8 authored over 10 years ago by Chris Matthews <[email protected]>
Refactor submission logic in nt

llvm-svn: 212737

f6d7f8ba14400ccb9aea745e87da71e7a73b32a9 authored over 10 years ago by Chris Matthews <[email protected]>
Change submit so that the results from the server can be used on the client.

Rename results to server_report, to help distinguish between that and the local report object.

...

ef40273c5561184374596c99c9333b1f3e0bf5c5 authored over 10 years ago by Chris Matthews <[email protected]>
Clean up geomean calculation code

Update comments to reflect changes to geomean calculation.

No functionality change intended.

l...

202d05149b7715aeb64eab66c709c83da0c3930f authored over 10 years ago by Yi Kong <[email protected]>
Remove the now unused comparison_window parameter from send email comparison

llvm-svn: 212295

34d92e927bc98e54ce480161453bc6c169104b7b authored over 10 years ago by Chris Matthews <[email protected]>
Make baseline color more distinguishable

Baseline plot is currently quite confusing. Second baseline and those after
has color irrelevant...

2f7bd6364f2446642aa07332a4c50391e1a8fb79 authored over 10 years ago by Yi Kong <[email protected]>
[runtest compile] Improve handling of command failures/unexpected stderr.

- We now log a more readable diagnostic in situations that error during normal
invocation of...

5309f47b005ef351bc8ff21d7b7be147588ae689 authored over 10 years ago by Daniel Dunbar <[email protected]>
Correct r211148 - we should be resetting cc_src_branch to "", not None.

llvm-svn: 211706

563140ae8f9fb297922b6378e6d98bfcd657a276 authored over 10 years ago by James Molloy <[email protected]>
[lnttool] Add --version command line option.

llvm-svn: 211603

ebdc7098122841add518502604588fccc15b0262 authored over 10 years ago by Daniel Dunbar <[email protected]>
Don't report failure if sample is empty

It is not useful to report failure on empty sample or when not comparing to
other runs.

llvm-sv...

9f2bd1f63e77729bcce8e21d9eab673e6a64faa0 authored over 10 years ago by Yi Kong <[email protected]>
Fix geomean calculation for previous run

llvm-svn: 211582

b8fa3ec8dd55ea4553294b17b9323604eda313d1 authored over 10 years ago by Yi Kong <[email protected]>
Fix server crash when there is no entry

Return samples as an empty list when geomean is None.

llvm-svn: 211580

8ae29a7b58da406446caeadc484be6f7e494b3b3 authored over 10 years ago by Yi Kong <[email protected]>
Teach LNT how to parse version output from a CMake build.

llvm-svn: 211148

a6b9ed0657aa83b372a1ab8f2d1318268933f69b authored over 10 years ago by James Molloy <[email protected]>
Fix geometric mean comparison bug introduced in r210123

not_none was not correctly implemented.

llvm-svn: 210352

8f8b59d3c4c65c74f27f034d80cbbf679f513bb2 authored over 10 years ago by Yi Kong <[email protected]>
Benchmarking only mode

This patch enables LNT to use benchmarking only mode in test suite.

llvm-svn: 210276

e5bc62f3cbc4cddf43d3e6867904538960055e14 authored over 10 years ago by Yi Kong <[email protected]>
Fixup this test so that it does not try and execute hidden files as databases

llvm-svn: 210139

f1613458a84b6e66970f0fa12222b27b04462d42 authored over 10 years ago by Chris Matthews <[email protected]>
Fix my merge fail fail

llvm-svn: 210136

e73f40184414fd9f8443cd28270bfa477688f5b6 authored over 10 years ago by Chris Matthews <[email protected]>
Updating some files to modernize LNT for server deployment.

llvm-svn: 210134

4fd9ff860dd3bc84e17426e9d7427ecae325fb82 authored over 10 years ago by Chris Matthews <[email protected]>
Fixups in geomean calculation

Geomean calculation was having problems with compile test suite. Fix that, as well as some bugs...

b63d1395e2900cfffab79edfc4b7c9dec74bf54f authored over 10 years ago by Chris Matthews <[email protected]>
Add missing updates to test database

llvm-svn: 210131

edece82bb24c8dd9604c2ab6a751d147eae9e32c authored over 10 years ago by Chris Matthews <[email protected]>
Updated smoketests to cover more of the web interface

llvm-svn: 210128

fbc08b6c191e90eaaa16e8adfce6fee7978d6ec7 authored over 10 years ago by Chris Matthews <[email protected]>
Fixups in geomean calculation

Geomean calculation was having problems with compile test suite. Fix that, as well as some bugs...

96bb414a0567c2347153a0c7a82514d799114dcc authored over 10 years ago by Chris Matthews <[email protected]>
Remove some unused imports

llvm-svn: 210122

a9b58a78d58690ead28a3d626a80236aa0c5f088 authored over 10 years ago by Chris Matthews <[email protected]>
Fix daily report page

Fix the regression from r209204, removes no longer used comparison_window.

llvm-svn: 210088

aaafbc23375042b3857bac50098f582ee0a93bdb authored over 10 years ago by Yi Kong <[email protected]>
Skip baselines which have no data

In the event of a baseline request which produces no data, don't show that baseline.

llvm-svn: ...

013372f19f0035e00d189bbfb2fb6da41abe779d authored over 10 years ago by Chris Matthews <[email protected]>
Aggregate most recent runs

This method significantly reduces noise when applied in combination of
Mann-Whitney U test. It r...

465d5fdbf640b8e53f0f3d773f335e2c4825dd4f authored over 10 years ago by Yi Kong <[email protected]>
Add geometric mean to run reports

llvm-svn: 209118

da8dfddddb3dbb4cd84c662d3dca1321c0260884 authored over 10 years ago by Yi Kong <[email protected]>
Rewrite selectAll using jQuery

We are using jQuery everywhere else, rewrite using jQuery for consistency.

llvm-svn: 209071

d456a3aaf020837757ea05c2d2b48305d51b5aeb authored over 10 years ago by Yi Kong <[email protected]>
Show server time in UTC instead of local timezone

llvm-svn: 209041

b8e2200a5716446f2e433a42e7632fe03ab8c942 authored over 10 years ago by Yi Kong <[email protected]>
Unify the use of jQuery

Use of jquery-latest is not recommended
Replace the use of 1.5 with 1.7 to fix some rendering is...

e50a72c5a966e42889a502a2e15876886ded44e9 authored over 10 years ago by Yi Kong <[email protected]>
Activate navbar items upon hovering the mouse

llvm-svn: 209021

a3e3a048e9b6fa1b3e6f10c62bbd2c8c9ca445a9 authored over 10 years ago by Yi Kong <[email protected]>
Make compile_time and exec_time tables sortable

llvm-svn: 209020

e8ca9faea99488f424c628feda8e3bba6eb3c453 authored over 10 years ago by Yi Kong <[email protected]>
Add select all checkbox for report tables

llvm-svn: 209019

8354c57aa7da80060a933293fe58bf3560ce1878 authored over 10 years ago by Yi Kong <[email protected]>
Also fix background color rendering for run status

llvm-svn: 209018

9fc9b1ce1b2205d651a0ea07ab672f61243a65c7 authored over 10 years ago by Yi Kong <[email protected]>
Remove the excrescent argument MWU

llvm-svn: 208738

f169c5c3378a3e71b8ed1c215e2870d7e9feafec authored over 10 years ago by Yi Kong <[email protected]>
Use Python implementation of MWU test

Turns out we have a Mann-Whitney U test implementation(for large sample
size) in external.stats....

6fba7ef796295684c4c97722537a1647d8316738 authored over 10 years ago by Yi Kong <[email protected]>
Fix rendering of compile-time and exec-time table

Background colour of pct_delta was not rendered on odd numbered lines,
because HTML bgcolor tag ...

7144d88a2a99cb503811c71c299848b34a9b817d authored over 10 years ago by Yi Kong <[email protected]>
Add two-sided 0.10 Mann-Whitney U confidence table

0.05 confidence level is too strict on noisy machines, add 0.10 as an extra
option.

llvm-svn: 2...

d95998207bb403af5301ac7c859c2dcbdcae30b5 authored over 10 years ago by Yi Kong <[email protected]>
Update inline documentation to remove mouse wheel

Mouse wheel zoom is disabled, so remove the instructions for it.

llvm-svn: 208612

8cfc0ec5042180e1f5f524095fba6e1324f1cc0d authored over 10 years ago by Chris Matthews <[email protected]>
Fix Mann-Whitney U calculation with large sample size

SciPy uses one-sided p-value while rest of program uses two-sided, multiplied
by 2.

llvm-svn: 2...

2adba5b5f106e727fb19927d018c8778ed6609dc authored over 10 years ago by Yi Kong <[email protected]>
Fix stats

Forgot to update a variable during code refactoring

llvm-svn: 208534

db33fe16d062f55ab88e42fe72c20a6777b1bc65 authored over 10 years ago by Yi Kong <[email protected]>
Use Mann-Whitney U test to identify changes(2)

Correctly calculates Mann-Whitney U
Optionally depends on SciPy

llvm-svn: 208450

560ec22dd23d30412681763840b02050d1d57028 authored over 10 years ago by Yi Kong <[email protected]>
Disable mouse-wheel zoom on LNT graphs

Flot's mouse wheel zoom feature does not work well on OSX. Since there is a manual zoom button, ...

01ebb7576aa05e1ffbf4b8f87f8247bd0e5dfbc8 authored over 10 years ago by Chris Matthews <[email protected]>
Add manual zoom controls to LNT graphs

The mouse wheel zooming can be cumbersome on some platforms. This change provides good ol' fashi...

298b5ffb719cb65065a5ebdcd0b05490f6970974 authored over 10 years ago by Chris Matthews <[email protected]>
Update baseline's color selection

When there are many baselines on a LNT graph, they become hard to distinguish. This changes base...

e93a1c7c517426952192fe5925ac4a2f25cf9ae5 authored over 10 years ago by Chris Matthews <[email protected]>
Update graph baselines to have a title passed as part of the url argument

When multiple baseline are present, they are hard to distinguish from each other. This change a...

5a37ec5c7f4fee0b45208f2423cabc3ad442144d authored over 10 years ago by Chris Matthews <[email protected]>
Make submitFile and submitFiles consistent, so that they both return results

llvm-svn: 208125

248fbe3c24474b9e7a2b113cb63bdfdb2de09e15 authored over 10 years ago by Chris Matthews <[email protected]>
Revert the use of SciPy while we investigate the failures on the bots.

llvm-svn: 207918

56f5c36afa67cc45bdb1fc53a8ffd48631e83171 authored over 10 years ago by Chris Matthews <[email protected]>
Use Mann-Whitney U test to identify changes

llvm-svn: 207898

d5d1dd96ed38e6dad720cae94a550fb30a3a9e9f authored over 10 years ago by Yi Kong <[email protected]>
Fix plotting issue caused by r188111

llvm-svn: 207773

9786d80df67eed9116e00d94d54b861c1baff9b2 authored over 10 years ago by Yi Kong <[email protected]>
When passing no arguments to compile suite, show an error instead of crashing

The command "lnt runtest compile" crashes, where as "lnt runtest nt" prints help. Fix this so th...

ed8647e6051d9d025846b0c5712336cfa80f0c9f authored over 10 years ago by Chris Matthews <[email protected]>
Add simple baseline run graphing

Add visual representation of baselines in graphs. When passing a "baseline.<n>=<run_num>" argum...

cfd6cd4ef1e0ae93704290ee6e7f9af0ee486187 authored almost 11 years ago by Chris Matthews <[email protected]>
Add some simple logging to files

To help diagnose server failures more easily.

llvm-svn: 204367

59b6bfaeb4cc2e77cddff5b93eefb06b0863fac2 authored almost 11 years ago by Chris Matthews <[email protected]>
Enable json export of graph data

If passing json=true to the graphing page, export the graph data as json instead of HTML.

llvm-...

c1a54191027c8ab7b40aa93be5a2a5e9693dc01c authored almost 11 years ago by Chris Matthews <[email protected]>
[lnt] Expose ability to run under qemu.

Adds a --qemu-user-mode=VALUE option that sets USER_EMULATION_MODE to '1' and
RUNUNDER to the gi...

e69d4b10c1951c8bb85a953b36c0bd4f88ab00e8 authored almost 11 years ago by Daniel Sanders <[email protected]>
Fixup lnt submit --verbose to print results

In a previous refactoring responsibility for printing during submission was moved to the callers...

afb674480513461df46a83223399e70a864a969d authored almost 11 years ago by Chris Matthews <[email protected]>
Sane default for --commit in lnt submit

Lnt submit is used for sending results to the server, so having the default behavior be not subm...

bea378a3129ded1f33d05f9ebba5c171a5ba0036 authored almost 11 years ago by Chris Matthews <[email protected]>
Allow a Report check to be called after Report creation.

This will allow for future validation of modified Report objects.

llvm-svn: 199270

00542df8d0f0c054f4b7e63e5ab0cf24c76e055f authored almost 11 years ago by Chris Matthews <[email protected]>
Prepare submit for being used in two phase commits.

Change submit to return results from the server, so they can be used to determine needed reruns....

e58f834fbacb5946bcc6bc8e8f952296ac7fc357 authored about 11 years ago by Chris Matthews <[email protected]>
Fix test which was broken when Overview page was replaced with recent activity page.

llvm-svn: 198668

cc353757eb4ac2f97c5642f0f64b285fa71315b0 authored about 11 years ago by Chris Matthews <[email protected]>
Remove a test which references a compiler which no longer exists.

llvm-svn: 198667

e35de9005c79d7436b5fd4e3bb699cc26f022c69 authored about 11 years ago by Chris Matthews <[email protected]>
Re-apply: In an effort refactor the code to make way for run resampling, move the run submission code into the test suites.

With resampling the submission logic will change in NT.
Deprecate runtest command line args. Mov...

49ea3146ebb8c0cd542b0600e31e436f5d58daaf authored about 11 years ago by Chris Matthews <[email protected]>
Revert "By request, add a --verbose option to LNT nt, which prints out what all the sub-commands are doing while also logging their output to a file."

This reverts commit r195509. As was discussed on the list, the output from subcommands makes th...

792297d30d1b6e715ebf5e1f03840e7f615eb37f authored about 11 years ago by Chris Matthews <[email protected]>
Revert all commits starting from 198453

This commit broke the following LNT buildbots:

clang-x86_64-darwin12-nt-O3
clang-native-arm-lnt...

6c888377a5652c023733cd40de531243fa550f99 authored about 11 years ago by Tobias Grosser <[email protected]>
Remove another use of a parameter

This is an attempt to fix the build after commit r198467.

llvm-svn: 198483

9ae7d27c514e667b8ddb313d8cf54cbfc81a4b3d authored about 11 years ago by Tobias Grosser <[email protected]>
Remove a unused parameter.

llvm-svn: 198467

b1b89388b4060af99258625d5b7ee9d41f69c468 authored about 11 years ago by Chris Matthews <[email protected]>
Don't pass run.id back with commit=False

When we don't commit runs, don't pass back the run.id, because the run won't exist.

llvm-svn: 1...

3542c6149c0597d18ede123a65bd826765d236f9 authored about 11 years ago by Chris Matthews <[email protected]>
Remove unused import.

llvm-svn: 198464

562183661b2fb2770d4b22d99a503784ca073375 authored about 11 years ago by Chris Matthews <[email protected]>
Remove dead code.

llvm-svn: 198463

8f6d75c1ddcc902cbae493891bda420d32a62295 authored about 11 years ago by Chris Matthews <[email protected]>
Fixup comment.

llvm-svn: 198460

c5fa5babd0bd26bdfddbb80cc3df50ba061bb098 authored about 11 years ago by Chris Matthews <[email protected]>
Make the verbose argument not consume other tokens from the input args.

llvm-svn: 198458

041814ac03a03b6c0313ae4f2269443255af3c42 authored about 11 years ago by Chris Matthews <[email protected]>
Handle the case of a missing configure file in the test suite better.

llvm-svn: 198455

237a5ff0db93dfd26804bee1e165f5c6a31a20f2 authored about 11 years ago by Chris Matthews <[email protected]>
print RunID of submitted runs

It is nice to know the runid on the client, for easy lookup if on the server later. This commit...

bddecc65965c32bacbe5201110908a075a326252 authored about 11 years ago by Chris Matthews <[email protected]>
In an effort refactor the code to make way for run resampling, move the run submission code into the test suites.

With resampling the submission logic will change in NT.
Deprecate runtest command line args. Mov...

bcbe2db0ba96b69a8fd1f9b82fa2864d3169e829 authored about 11 years ago by Chris Matthews <[email protected]>
Fixed a small bug where the --hostname argument to lnt create was not being interpolated into the wsgi script.

This looks like just a careless mistake where the interpolation pattern was not
placed in correc...

88d9e8c9f81fd9d3ba0ce06895c3b1ff29bb05df authored about 11 years ago by Michael Gottesman <[email protected]>
Fix stray s in summary report editor js.

llvm-svn: 196188

3bb37e889392804f16240eb6743a0b222d62dd5c authored about 11 years ago by Chris Matthews <[email protected]>
Fix sys.std -> sys.stderr

llvm-svn: 195531

274cf89cb9c77ae78933d51bbad587512d73b5bc authored about 11 years ago by Tobias Grosser <[email protected]>
Fix a second typo!

llvm-svn: 195530

b1efc09ddceaeb1eee028df6f2d6c4094b7d8fb3 authored about 11 years ago by Chris Matthews <[email protected]>
Fix typo in logging error statement.

llvm-svn: 195527

9d4701f742e850ba8d9336abd96d0e12f16835d2 authored about 11 years ago by Chris Matthews <[email protected]>
By request, add a --verbose option to LNT nt, which prints out what all the sub-commands are doing while also logging their output to a file.

llvm-svn: 195509

d92cee9a0dd850d8e5f3d598836e0f5c5176f067 authored about 11 years ago by Chris Matthews <[email protected]>
By popular demand, when LNT nt fails while running a subprocess command, make sure the error message which is printed has the name of the log file which contains the output of the failing command.

llvm-svn: 195506

7c253dd9f9c762227acf440202b90ad8a1a357ed authored about 11 years ago by Chris Matthews <[email protected]>
Fix an error caused by a partial commit of r194516.

llvm-svn: 195498

1a8779eb7ff02d8c083ea2333c5bfb5c9e535f98 authored about 11 years ago by Chris Matthews <[email protected]>
Add a json interface to the Summary Report view.

llvm-svn: 194518

1b90807cdd4b9bbedbddbd8b66ba03db3796b12a authored about 11 years ago by Chris Matthews <[email protected]>
Bootstrapify summary report edit UI.

llvm-svn: 194517

e1f1eba9a76f82e4e2bc2530516bf19d55ce1e65 authored about 11 years ago by Chris Matthews <[email protected]>
Better errors for invalid --cc parameters.

When you specified something odd for --cc you'd get a really cryptic "Permission Denied" error w...

94416e95280bda022c28ff79f8f1e0d6d924ccd9 authored about 11 years ago by Chris Matthews <[email protected]>
Remove empty directories.

llvm-svn: 192726

00c3d0b1ce9cf63255dffec7cf689f7dc9203a3f authored about 11 years ago by Daniel Dunbar <[email protected]>
Rename opts to config, for consistency.

llvm-svn: 190020

511e21995f98ac23936506bc5603fb7312ea68ec authored over 11 years ago by Chris Matthews <[email protected]>
Swap the internal representation of the test configuration from OptionParser.Value to a plain old dict. I want to use a dict so that we can accept multiple sources of test configurations. Since we are just using a dict, no need to use getattr anymore, just extend the native object dict with the options.

llvm-svn: 190018

d446e4aa88e4a651777088ae4e596e5dd1e5ec19 authored over 11 years ago by Chris Matthews <[email protected]>
Only include relevant tests in a run report.

- This limits the set of test names we consider (and thus report on) to be
tests that appear...

a9216e28ab8b85045f74841f9521c8e6f2c3bfa0 authored over 11 years ago by Daniel Dunbar <[email protected]>
Make sure test-externals flag is passed to configure regardless of the without-llvm flag.

llvm-svn: 189533

bf16db6cd29c3c1c6b4d2a67db9372bf290e8159 authored over 11 years ago by Chris Matthews <[email protected]>
Better code coverage for the runtest lit tests: call runtest with an assortment of options.

llvm-svn: 188399

c1ff9cb5e58a53b2371ec0212988bd14b7142962 authored over 11 years ago by Chris Matthews <[email protected]>