Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/llvm/llvm-lnt


https://github.com/llvm/llvm-lnt

Show other regressions in regression graphs

Expose an API for getting regression based on a graph. Fetch those regression with JS, then rend...

23400f9b2717ec8cbccb00185b251743f69f172c authored about 9 years ago by Chris Matthews <[email protected]>
Don't time check workers!

It makes too much logging traffic.

llvm-svn: 255969

2d6f0fc52fb8792e388c662e1aa3bbfe7622d2e7 authored about 9 years ago by Chris Matthews <[email protected]>
Add a health endpoint

When deployed to the cloud, some clouds monitor app/__health to see if the app needs to be resta...

136ab40a38e5db746c781086cc311317a67ab01c authored about 9 years ago by Chris Matthews <[email protected]>
More robust grouping

Sometimes parts of the orders are None (start or a machine). Cope with that gracefully.

llvm-s...

b98532c61e6a07d24428458b51a8b88ffb6eabad authored about 9 years ago by Chris Matthews <[email protected]>
Little deployment, logging and background process fixes

- Subprocesses share memory log.
- No need to limit requests to 300, that is actually far too of...

889049e763b4f38374c81124eda4825f863112de authored about 9 years ago by Chris Matthews <[email protected]>
Tweaks to logging system and messages all over the system

llvm-svn: 255964

697f3da22a239fb13c8c393f6dd0ef305842fdd5 authored about 9 years ago by Chris Matthews <[email protected]>
Fixups for background jobs

llvm-svn: 255963

fdac237e148649c2f99006c6f90563f05a7762ec authored about 9 years ago by Chris Matthews <[email protected]>
Fix output compares from logging change

llvm-svn: 255962

7b4767894b921ec0981b1c292b73d6f346de1c02 authored about 9 years ago by Chris Matthews <[email protected]>
Refector: extract regression model code to a regression module

llvm-svn: 255961

4d810acf6637348eabbe835503d272f5f3f9d588 authored about 9 years ago by Chris Matthews <[email protected]>
Should not use get for async ops, it may exception

llvm-svn: 255960

e3d145afaf6439328702635f0aa9fd387e2f5721 authored about 9 years ago by Chris Matthews <[email protected]>
Cleanups and test fixes for rules

llvm-svn: 255959

6ee7083a18700344b1d9e23b38f74f330540c796 authored about 9 years ago by Chris Matthews <[email protected]>
Fix LNT's logging, add /log endpoint to view logs from web

LNT's logging support has always been horrible. This makes debugging server problems hard. Thi...

5ff842e89282ccdb215be521c5a19e9c4eafd416 authored about 9 years ago by Chris Matthews <[email protected]>
Regression evolution rule: detect fixed regressions and move them

Evolve regressions. When regressions that no longer exist are detected in the system, move them...

f7ae70d0fcb8a3a3c9f02280c8dbdca0ad8854fc authored about 9 years ago by Chris Matthews <[email protected]>
Provide a mechanism to implement LNT polices

This commit adds a flexible rule mechanism to LNT. Rules are Python
files that are loaded at se...

ca9c0672047f123609480e61a50d754e37765a81 authored about 9 years ago by Chris Matthews <[email protected]>
Fix test case that won't work until change is committed

llvm-svn: 255955

b6c1cff48d374a1bc1f97c68582242097ba0a568 authored about 9 years ago by Chris Matthews <[email protected]>
Merge of Regression Details with states

llvm-svn: 255954

a1dec862bfd4ea15e207f62e56ad967d8925c1e7 authored about 9 years ago by Chris Matthews <[email protected]>
Initial regression correlation

llvm-svn: 255953

7d5091d1bab8465d2a9ab4ce507c98e0c0fcf6b3 authored about 9 years ago by Chris Matthews <[email protected]>
Whitespace fixups

llvm-svn: 255952

ed21b84c989aabb253b95e374a42fe4970693e6a authored about 9 years ago by Chris Matthews <[email protected]>
Calculate field changes in background process

llvm-svn: 255951

2800806b889df140cbf0accc2315551c131cbad8 authored about 9 years ago by Chris Matthews <[email protected]>
Regression tracking interface tweaks

llvm-svn: 255950

527896268f1ce0f2876722c3cde6e68ddb6def73 authored about 9 years ago by Chris Matthews <[email protected]>
Getting all the registered database names is useful

llvm-svn: 255949

9f95171bbb0964b64493ad6f9daca00166892201 authored about 9 years ago by Chris Matthews <[email protected]>
Fix layout to work with non-db or test-suite pages

llvm-svn: 255948

cdecb70935e0a9ca461efa64697704ada6b38784 authored about 9 years ago by Chris Matthews <[email protected]>
A handy debugging representation for Database configs

llvm-svn: 255947

b133a728fb812f7ab353980da1decc5e202d6e6e authored about 9 years ago by Chris Matthews <[email protected]>
Reorder command line printing, and count kinds of results

When you submit from the command line, the summary data is obscured by
all the results data that...

cedd9586892ff942c3502a20c15869335a55e89c authored about 9 years ago by Chris Matthews <[email protected]>
A LNT blaster

A script for load testing LNT instance. Generate gobs of random data and submit to LNT.

llvm-sv...

59d02418f709e3480b7094e10cd93d86078e0a82 authored about 9 years ago by Chris Matthews <[email protected]>
[LNT] --spec-with-ref supports --remote now

This was added to the testsuite in r253629 earlier today.

llvm-svn: 253649

ac8278bacd4c99e416fb4189117d7a24630bec8d authored about 9 years ago by Adam Nemet <[email protected]>
[html] Center content using style attribute. NFC.

The <center> tag is deprecated, see
https://developer.mozilla.org/en-US/docs/Web/HTML/Element/ce...

2606096ec0559c5fd7519ec5dbcafe2408409f1d authored about 9 years ago by Arnaud A. de Grandmaison <[email protected]>
[html] Move deprecated align/width/bgcolor attributes into the style attribute. NFC.

The align, width and bgcolor attributes from tags <td> and <th> are obsolete
(refer to http://ww...

f8bf8ab3cd407eb795e47319d96b310217a7144b authored about 9 years ago by Arnaud A. de Grandmaison <[email protected]>
[LNT] PGO and reference input support for SPEC

Summary:
This adds the LNT parts for D14734.

Besides the new flags, we need to pass a few more ...

7e9d263bdd51b01c86738c4740137b9aebd408a0 authored about 9 years ago by Adam Nemet <[email protected]>
[html] Empty action not allowed in form. NFC.

Refer to: http://www.w3.org/TR/html-markup/form.html#form.

llvm-svn: 253333

8e9ec7a0fd4beb5af8f0eeb4449614143be0da66 authored about 9 years ago by Arnaud A. de Grandmaison <[email protected]>
[html] Uniquify input id when the template is instantiated. NFC.

llvm-svn: 253325

76604f9ec72e61d8523ae229adef15b86265f4d8 authored about 9 years ago by Arnaud A. de Grandmaison <[email protected]>
[html] Table footer cells need to be in a row. NFC.

llvm-svn: 253226

834f69f54bacb47f125d0bc1ee8ee5482ca219d4 authored about 9 years ago by Arnaud A. de Grandmaison <[email protected]>
[html] Escape '&'. NFC.

llvm-svn: 253221

185c1c41f4a7eec6472fdf38d4b6c133f162cd34 authored about 9 years ago by Arnaud A. de Grandmaison <[email protected]>
[html] Fix tag closing in a number of places. NFC.

llvm-svn: 253218

65a479ee0e1ce542e3d26537c498e5c080be9b62 authored about 9 years ago by Arnaud A. de Grandmaison <[email protected]>
[cmake] Add a very alpha driver for the CMake-based test-suite

This driver mimicks the usage of the 'nt' driver as much as possible, but only implements a subs...

c16b9b0ec4289465b0cf654b93c68333193fbf1a authored about 9 years ago by James Molloy <[email protected]>
Do not show samples in sparkline for failed results.

llvm-svn: 252281

f9b4318e786dd820a4a0ce9f56a81a94082062a2 authored about 9 years ago by Kristof Beyls <[email protected]>
Make --exclude-stat-from-submission=hash default until llvm.org/perf has been upgraded.

This will allow bots who have picked up the hash value feature to keep on
submitting reports to ...

d25418a69cd291a91d7440f286c11ac60d7035a5 authored about 9 years ago by Kristof Beyls <[email protected]>
Revert "r249678 - Fix unit test failure introduced at r249106"

cmatthews has implemented a better fix in r249773.

llvm-svn: 249818

ba4607aeb5b43805a45efcef1d21ce3a95974cc0 authored over 9 years ago by Kristof Beyls <[email protected]>
Fix packages introduced by regression tracking

llvm-svn: 249805

403be3e5be9a4be82758c4f3111e87b958214d92 authored over 9 years ago by Chris Matthews <[email protected]>
Update some test cases I forgot about

llvm-svn: 249774

1402d9249a7f8b1a09cebfe63c1a18fd3e6bf1bd authored over 9 years ago by Chris Matthews <[email protected]>
Fix geomean calculations to work when there is no past data.

llvm-svn: 249773

5fb50ed4c0d21be31b95b0248221891e6990e075 authored over 9 years ago by Chris Matthews <[email protected]>
Basic graphing support for regression tracking

llvm-svn: 249772

46a4b44b18e276d29cdb80debbdfca6ec29362ff authored over 9 years ago by Chris Matthews <[email protected]>
Re-indent layout.html, fix hanging div

llvm-svn: 249771

3ba785e59898367c7bf2dcadd067379b59d7002e authored over 9 years ago by Chris Matthews <[email protected]>
Prototype of regression tracking feature for LNT

This patch corrosponds to my mailing list discussion about a regression tracking
feature for LNT...

c99991733e801d988448c99ec1066be14429134c authored over 9 years ago by Chris Matthews <[email protected]>
Fix submission of reports through instance rather than url.

This regression was introduced in r248789, but wasn't caught earlier as there
wasn't a regressio...

062f547a51a935164cede4b1e14aa84222c38a37 authored over 9 years ago by Kristof Beyls <[email protected]>
Document dependence on the psycopg2 module for postgres testing to developer_guide.rst.

llvm-svn: 249679

d1d12dc5e5d2648f1b8e662d98bfd52b0fb26844 authored over 9 years ago by Kristof Beyls <[email protected]>
Fix unit test failure introduced at r249106.

By normalizing prev_samples to not contain None values.

llvm-svn: 249678

0fc105e1fa944b1d33ef7273a4aa37da9d5234ff authored over 9 years ago by Kristof Beyls <[email protected]>
Fix unit test failure introduced at r249102 - unbalanced HTML tags.

llvm-svn: 249677

54c245833791221c0188354b6b3e7800c878a053 authored over 9 years ago by Kristof Beyls <[email protected]>
Cleanup of graphing API

llvm-svn: 249109

8595b96245bbd04bc67bec4c4a8d6c4aaecfcb23 authored over 9 years ago by Chris Matthews <[email protected]>
New requirements for Foreman deployments

llvm-svn: 249108

bdfa436aeda45bcbaabfd949c6626a93a04ffdc8 authored over 9 years ago by Chris Matthews <[email protected]>
New graphing JSON API

llvm-svn: 249107

3ec855da37478d8624f85c5710689b54259aaaab authored over 9 years ago by Chris Matthews <[email protected]>
previous is misleading when using absmin_diff

llvm-svn: 249106

13d7db41259faff28be54357db41dc25abaa87b3 authored over 9 years ago by Chris Matthews <[email protected]>
Dismissible alerts

llvm-svn: 249105

40131b241508d35c709dc9077ceff3988049e07b authored over 9 years ago by Chris Matthews <[email protected]>
Support for Flask's flash system

llvm-svn: 249104

a4b4884e78fc39bfb6a29b84343f70a87e946c03 authored over 9 years ago by Chris Matthews <[email protected]>
By default, log to local directory

llvm-svn: 249103

94df4c78c06ccf401e98f43615b7a1ac86e08a38 authored over 9 years ago by Chris Matthews <[email protected]>
Some pages are better without a side-bar

Some of the LNT pages are better when more width. The side-bar is not
used on all pages. For ...

1342020f017a62b8283dba19b329658f55b75078 authored over 9 years ago by Chris Matthews <[email protected]>
Update to last version of bootstrap 2.3.x

llvm-svn: 249101

5b9fd1fac56094b631958111d2c8746e6a829921 authored over 9 years ago by Chris Matthews <[email protected]>
Now set executable property which I forgot as part of r249026

tests/runtest/Inputs/test-suite-nohash/configure needs to be executable to
succesfully run the u...

2b42a9796ba8f55d7df7740a541d88daa6fe1ac3 authored over 9 years ago by Kristof Beyls <[email protected]>
Add files I forgot to svn add for r249026 - Add support for storing hash of test binaries.

llvm-svn: 249034

4033a523357520bbe77b2706da0a3567644af7dc authored over 9 years ago by Kristof Beyls <[email protected]>
Add support for storing hash of test binaries.

This commit adds support for storing hashes of the test binaries as a new
sample type. The idea ...

04bdd15c7176998b446688cc7e28c75c03f695cd authored over 9 years ago by Kristof Beyls <[email protected]>
Fix temporary DB creation for postgres as used by the unit tests

The support for running the unit tests on Postgres in r248787 wasn't complete,
and this shows wh...

7ee73f96e475c2fc28a3372fad27c6d0b5f71d37 authored over 9 years ago by Kristof Beyls <[email protected]>
[LNT] Update nt.py test to support NT mem_bytes

llvm-svn: 248874

a4f83cdf4cbae060c7be467e960310a03c493abe authored over 9 years ago by Luke Larson <[email protected]>
[LNT] Add mem_bytes sample type to NT suite

llvm-svn: 248847

3fc58d7e4aaa1a02d6d4e18a7fca77cac46fb880 authored over 9 years ago by Luke Larson <[email protected]>
Fix postgres unit tests by closing db connections.

When running the unit tests on a postgres database, the following error shows:

sqlalchemy.exc.T...

834d0a489e061d31bedbfc21a3faa50b77d1396f authored over 9 years ago by Kristof Beyls <[email protected]>
Make it possible to run unit tests against a Postgres database instead of a sqlite database.

Differential Revision: http://reviews.llvm.org/D13163

llvm-svn: 248787

bde16827c6f65177ad815c1c575df2daf1c1ca27 authored over 9 years ago by Kristof Beyls <[email protected]>
Add initial LNT developer guide.

Differential Revision: http://reviews.llvm.org/D13101

llvm-svn: 248477

2c8df6b0b3c6ed35f950f8e5e137941c76b20cb5 authored over 9 years ago by Kristof Beyls <[email protected]>
Avoid leaving temporary files in the source when running unit tests.

llvm-svn: 248470

df5c8be20e1c5aae459f10bf23beb69c719918f9 authored over 9 years ago by Kristof Beyls <[email protected]>
Don't generate .pyc files when running tests.

llvm-svn: 248469

b60f47adc08847ccc262f237580a3cf5d26231a7 authored over 9 years ago by Kristof Beyls <[email protected]>
[lnt] Values for failed tests should be treated as missing.

This includes calculations involving those values such as deltas.

Also, it's not a failure for ...

d714aaf11b3984cbb2c0ba552862d547feef2634 authored over 9 years ago by Daniel Sanders <[email protected]>
[lnt] Correct delta and percent-change of geometric mean.

The geometric mean of a dataset is not the samples it is calculated from.
It is a single calcula...

abf35e509de05211da7aeefeddda5fb93c0fafc2 authored over 9 years ago by Daniel Sanders <[email protected]>
Fix typo in last commit, and add test to make sure such silly things can't happen again

llvm-svn: 244279

ad5e370b201f1c6d00029b9859d2d4b8c48b235e authored over 9 years ago by Chris Matthews <[email protected]>
If InstallDir is in driver output, ignore it

llvm-svn: 244257

144c9d6d340f61b62eabeea1fee85366ada59a97 authored over 9 years ago by Chris Matthews <[email protected]>
Fixup a test case to match what is in the database

llvm-svn: 243919

facef5e4ab88617226b11031cc5a953c19221d87 authored over 9 years ago by Chris Matthews <[email protected]>
Add more unit tests checking for error 400/404 when requesting invalid or unavailable data.

Also fixes one more instance where the server could crash on an invalid URL.
Also replace error ...

a489ecd3156e618596c8beb4595b67ff932cf171 authored over 9 years ago by Kristof Beyls <[email protected]>
Issue 400 error when graphing things that are not in the database

llvm-svn: 242324

8d10677c2229ac9bd735eb7c4ba65db7af32ca6f authored over 9 years ago by Chris Matthews <[email protected]>
try and fix setuptools dependencies on Linux

llvm-svn: 242207

32a18e3ea77fd1f6c1e2f9dccba1bc33a04dd7a0 authored over 9 years ago by Chris Matthews <[email protected]>
Reapply "Start adding a simple REST API to LNT""

This reverts commit r242149 to reapply r242070

llvm-svn: 242206

f55685c9c19ccf5e52a0609ccd43c45468ae923b authored over 9 years ago by Chris Matthews <[email protected]>
Revert "Start adding a simple REST API to LNT"

This reverts commit r242070, as it was breaking the LNT builds.

llvm-svn: 242149

d143ba34368edf1ba2eb5343f94e75b07f294832 authored over 9 years ago by Renato Golin <[email protected]>
Start adding a simple REST API to LNT

Add a small RESTful API for new clients (including ajax fronted).
FlaskRESTful is added as a dep...

b9e2382d588a5c2b1823d3547d1eb2396534bc7a authored over 9 years ago by Chris Matthews <[email protected]>
Tune whitespace in daily_report HTML report.

This makes debugging the output a bit easier.

llvm-svn: 240770

cf0cf0b4283618878bd95d173a9a45b4a57e5783 authored over 9 years ago by Kristof Beyls <[email protected]>
Retain URL query string parameters on prev and next links on daily report page.

llvm-svn: 240654

2635829411ae69976dedc4664bd2ad1f658cb13c authored over 9 years ago by Kristof Beyls <[email protected]>
Adapt daily report to handle runs missing on some days.

When a machine on a particular day doesn't produce a result, the daily
report page won't report ...

28b39126b743d3d7ce0e9c180404c09ac4df5537 authored over 9 years ago by Kristof Beyls <[email protected]>
Add --profiler-dir and --profiler-file options to lnt runserver.

--profiler-file=profile.log allows overriding the default file
the profile information is stored...

7d7269e6a2371c2c5e2d0d680890de559c42271e authored over 9 years ago by Kristof Beyls <[email protected]>
Don't crash when aggregation of samples results in 0 value in ComparisonResult constructor.

llvm-svn: 240423

12a7c606a9b9af74db0d5f2cf2a81b8c44564ea5 authored over 9 years ago by Kristof Beyls <[email protected]>
Add --qemu-flags option in addition to --qemu-flag.

llvm-svn: 240274

3ec89aca36c8fd7843ed89edba71777379b6fc98 authored over 9 years ago by Charlie Turner <[email protected]>
Don't warn that __init__.py is not an upgrade script: we know

llvm-svn: 240195

777b50ce8f11a40d38bf540a8791bd5db9d8267f authored over 9 years ago by Chris Matthews <[email protected]>
FieldChanges need to be deleted as well to maintain references

llvm-svn: 240194

a62f6ff3ffa13aa053b0ad1a3bf554c761351fff authored over 9 years ago by Chris Matthews <[email protected]>
Also on the /graph page: flip min() to max() for aggregation if bigger_is_better.

llvm-svn: 239922

64711db26b0ecc00b7b93441870b00d0a6564050 authored over 9 years ago by Kristof Beyls <[email protected]>
Add spark plots to the daily report page.

In the table, performance differences are highlighted as a single percentage
difference. Due to...

8520be9ca55446fd0bdc2872eb50eae0cd6b201f authored over 9 years ago by Kristof Beyls <[email protected]>
Correct width of content pane for wide displays.

This fixes the settings drop down-menu on the graph page not being fully visible on wide display...

11f54b2db637da61523f9dab777d66d067e4fba2 authored over 9 years ago by Kristof Beyls <[email protected]>
Retain URL query string parameters when redirecting from daily report page.

llvm-svn: 239557

6893b2fbff93ad3c8ce8685ef6f18a7883e3bdf9 authored over 9 years ago by Kristof Beyls <[email protected]>
[LNT] Add cflags string argument to LNT.

llvm-svn: 239518

6c6701c2ef99444cc3a99c55dbfb7916f75b6c48 authored over 9 years ago by Charlie Turner <[email protected]>
[LNT] Be less strict about argument ordering in FakeCompiler.

llvm-svn: 239517

a878da93785ef1ea78c12a45a577e3c618e03a80 authored over 9 years ago by Charlie Turner <[email protected]>
[LNT] Detect Debian Clang compiler.

llvm-svn: 239516

5a9540de7e25cbcd1f19da1c61362df1aaf7a1ff authored over 9 years ago by Charlie Turner <[email protected]>
Remove extra useless column that accidentally got committed as part of r239468.

llvm-svn: 239507

c49539988570a8cb5dcc11ba2f06e6d436539a40 authored over 9 years ago by Kristof Beyls <[email protected]>
Add regex filter box for machine names to daily report page.

llvm-svn: 239471

c7539f893ee3886b9c831a683f2c87994ef5c500 authored over 9 years ago by Kristof Beyls <[email protected]>
Run page regex search: only search for matches with benchmark names, not with other data in the table.

llvm-svn: 239470

ad13f34d3c701265898cc0cc0bb267f53d31f941 authored over 9 years ago by Kristof Beyls <[email protected]>
Factor out common javascript regex search code & simplify it a bit. NFC.

llvm-svn: 239469

f267492d6e1911f2512443115a6f9f7a1d95eef1 authored over 9 years ago by Kristof Beyls <[email protected]>
Add filter-machine-regex functionality to daily report.

For the email report, this is added by the new command line option
--filter_machine_regex for th...

3eb4b789b6a2be7191802af17d158c6926842b1c authored over 9 years ago by Kristof Beyls <[email protected]>
Use ValueError here, it closer to the invalid state we are trying to purvey

llvm-svn: 239444

62cb9dd112b45ebde13040357bc68ca38325caef authored over 9 years ago by Chris Matthews <[email protected]>