Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/llvm/llvm-lnt


https://github.com/llvm/llvm-lnt

[test-suite] --only-test: don't absolutify paths eagerly

If we call os.path.abspath(only_test) too soon, we cannot properly concatenate it with the build...

96528571705a6cb548ae5337ba88186986b98e3f authored almost 9 years ago by James Molloy <[email protected]>
[profile] Several javascript fixes

- Fix race condition between run source data returning and runTypeahead being initialized.
-...

d2a6937df8578890819e9df4ac3a3b8a0fd0d4bc authored almost 9 years ago by James Molloy <[email protected]>
[profile] git add v4_profile.html

This was accidentally missed out in r263882.

llvm-svn: 263937

5393ae6068e55d7f049a4feb776392272c9220a9 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add profile harvesting to test_suite.py

This is done via multiprocessing because it's on the critical path and can take a minute or two ...

2d746f1aaabb8e0682f2c57f50c019b47527869b authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Update test to reflect changed behaviour

'subtest' is not a directory in the Inputs tree, so it is correct that LNT attempt to build it a...

750800dea254cc296f89bb81f0fc91a909eb4894 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Fix only-test

It's a simple bug but crept in because I was accidentally running the regression tests with 'whi...

23ab0f382a49c4c7d59975c5b1fac702212bf039 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Hook LinuxPerfProfile into the implementation registry

This allows the importer to discover it and import linux perf data.

llvm-svn: 263927

00cf4c87315229adde4742eb34047b0049333bac authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add profile links to the run comparison report

This is the final step in hooking up profiling.

llvm-svn: 263926

5fbb906527f9ee4242930c9be5713b246b94766b authored almost 9 years ago by James Molloy <[email protected]>
[ui] Use Bootstrap CSS styling for run report tables where possible

The run reports are rendered in two ways: for email and for web. Email doesn't do CSS very well,...

24429b6fe16f9e300ca51d95b9a0d0f2c08ee8cb authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add profile IDs to ComparisonResult

And use these to render links to profiles in the run table.

llvm-svn: 263924

5dfc029e5df18a75678509e239daf823eaa5030d authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Add a 'succinct' option

Chris made VERBOSE=1 mandatory for 'make'. This makes sense, but it really does create a lot of ...

c4a043760a52f04bc685530344d5fc990abdffba authored almost 9 years ago by James Molloy <[email protected]>
[profile] Address review feedback by Kristof Beyls.

llvm-svn: 263883

91f15975f721a51236d8cbfcf43f3469aaacc142 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add profile web UI

I still need to work out a decent testing story for this (and javascript testing in LNT in gener...

ed27fdf086c70a0afba015e5f5c85277e0ee33f6 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add a rule hook to update the profile statistics

This rule runs after submission and inspects the profile directory, discovering
the total size o...

0c51bb5d35037449ec7e31b000ba8b9769d3e550 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add an admin page to view the current profile stats

This page shows graphs of the total profile size (in MB) and a histogram of the age distribution...

8222817059088fa709eabc7b0ec2d83c06570400 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add driver functions to lnttool

This teaches LNT about 'lnt profile', which can be used to interact with profile data.

llvm-svn...

787855010c4677e5e75b473a9eea21100850a6f0 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add support for importing profiles from a report

This adds the necessary plumbing to ensure a profile attached to a JSON report will find its way...

6a9b83809dd537f7f0b71b2e99478d0b07558593 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add the Profile DB table

This maps a Sample to a profile on disk. Also add the config file plumbing.

llvm-svn: 263877

65094d70ff135dc13db3f9da470f00c938b71f8a authored almost 9 years ago by James Molloy <[email protected]>
Fix problems in legend packing which caused baselines to fail

llvm-svn: 263600

556ea8012c8e795d31405d5671e316eb57ac468f authored almost 9 years ago by Chris Matthews <[email protected]>
[profile] Add an optimized on-disk representation

ProfileV2 is a profile data representation designed to keep the
profile data on-disk as small as...

63639d7d88151f4ff1b1f543d1a68d59892132e6 authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add perf and cPerf, for importing Linux Perf profiles

cPerf is a C++ python extension that reads perf.data sample streams and aggregates the data (inc...

a57bf295f7988de9d9f5fbf30b429cf03d54271d authored almost 9 years ago by James Molloy <[email protected]>
[profile] Add the initial scaffold for the LNT profiling infrastructure

This adds the API that will be used to query profiles in LNT's web stack along with a dumb imple...

11d96abfea710603e37bd1c661ff6c111ebd328c authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Fix syntax error

I'm pushing this fix because it's obviously broken, but I need to investigate why the tests didn...

6495dd99a65d449e13ba2bb073dbfcf18f1d6003 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Implement a new option: --single-result

The idea behind this option is to ease bisecting using tools like 'llvmlab bisect'. With --only-...

00653cdfdf6ad2a3cfb1cb8b4121e74af2146021 authored almost 9 years ago by James Molloy <[email protected]>
[cmake] Fix --only-test handling

Handling of --only-test was patchy, and expected it to be a directory. This caused problems when...

91d3363608cd052e25d464ca922816d5acf387f5 authored almost 9 years ago by James Molloy <[email protected]>
[lnt] Register signal handlers on the main thread

We've seen tracebacks like the one below on our LNT server, indicating
that previously, the code...

ffcbcdf3893674daf97fefeea5a242ca8e14f5a5 authored almost 9 years ago by James Molloy <[email protected]>
Add a section to the docs about the cmake test-suite

llvm-svn: 263298

9fcd3b1e8edd826645cc5d98b33701373f1f867a authored almost 9 years ago by Chris Matthews <[email protected]>
Add missing test file

llvm-svn: 263187

bc75fff839ff009dbf80635b5faadae5e9557ba3 authored almost 9 years ago by Chris Matthews <[email protected]>
When no cflags are passed on the command line, don't override them

These were set to blank if not set. For caches to override them they
need to be fully not set.

...

6209e73d7626fc2614f0c9b66f41a7d8a1a56b2c authored almost 9 years ago by Chris Matthews <[email protected]>
Allow the user to specificy a test-suite cmake cache

I think cmake caches are a good way to represent common configurations.
This change allow the us...

710d52e06118b001377a814376991a8fe43bedce authored almost 9 years ago by Chris Matthews <[email protected]>
Enhance help strings for parallel build options

It was not clear to me how these options worked together until I read
the code. This updates th...

7cf0b5473bdc8f5092ca92dbfd42e4170788a96c authored almost 9 years ago by Chris Matthews <[email protected]>
Add VERBOSE=1 to cmake test-suite options to make make's output useful

Though the default cmake make build output looks nice, it is really
useless for debugging and re...

7ae993e77fd6359f2917dba02a64930de0fb3323 authored almost 9 years ago by Chris Matthews <[email protected]>
[test-suite] Add missing test input

llvm-svn: 262226

d12d58686040ed9af8880ab3511987f2b8fc0b5e authored almost 9 years ago by James Molloy <[email protected]>
[cmake] Don't exit 1 if LIT exits 1

We expect test failures. LIT shouldn't be expected to exit with 0 all the time. We must ensure w...

b5e0f3e8d2f4e55293641442c00a65f0e7462292 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Improve help message for --cmake-define

This was suggested by Chris Matthews in a post-commit review of r261851.

llvm-svn: 262217

f41f5445833a9b9773fb15ae04593ea29b60df57 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Revert part of r261851

We shouldn't need to build timeit-host manually - the dependencies should be in place, and if th...

2a9d77bd2632db7dcf7ed67e87efbe8ac7843925 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Pass the 'score' and 'hash' metrics along from LIT to LNT

As part of this a default has been changed - 'hash' is no longer excluded by default.

The reaso...

4d63515a92021b55680a122e68dd55332cdf40cb authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Add the ability to pass CMake defines to CMake.

While we're here, ensure that we build 'timeit-host' first before anything else. CMake doesn't k...

dc73687f80e1554a443b5fdc56dc8b39082e0506 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Print configuration in key sorted order

llvm-svn: 261850

654167c72e106fad01a193d4eecf135c507f653f authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Run lit with -v instead of -sv

llvm-svn: 261849

c82e60012fd9dbfc051675061890672fa187a67b authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Support arguments to --run-under, instead of just a single executable

llvm-svn: 261848

8e7d25e2c849f5a2e78327359e56ec8482c0dc56 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Add support for --use-perf

llvm-svn: 261847

74420770e6a8f5759ae4133d810efe31685e4c82 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] Add support for --benchmarking-only.

llvm-svn: 261846

a5bc9ff701477138b4ba34d20aa9dc039f48c5b4 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite] resolve the path to --cxx when given on the command line

When not inferring opts.cxx, make sure it is resolved to a full path.

llvm-svn: 261845

506fc427d2ef493405b076c3ae8fc8a4f167979f authored almost 9 years ago by James Molloy <[email protected]>
Don't add objects to the logger, only strings.

When objects are added to the logger, the mem_logger apparantly could
retain those. If then the ...

778a8b4fe7c67a880b0ea8aaa469e7c3f31c644a authored almost 9 years ago by Kristof Beyls <[email protected]>
Clean up V4Pages.py test slightly. NFC.

llvm-svn: 260945

fb0c043356755b8f2db9abeea44158cd4d91273b authored almost 9 years ago by Kristof Beyls <[email protected]>
Color the background of sparklines on the daily report page based on the hash value of the binary.

Differential Revision: http://reviews.llvm.org/D16356

llvm-svn: 259048

03bad826a3bc7ea93fc5c07cf2e847d84c46027d authored almost 9 years ago by Kristof Beyls <[email protected]>
Add hash of binary to ComparisonResult object.

This doesn't add any user-visible functionality yet; but is a basis for
taking into account the ...

f89308d3ce305d8b11e3a77dbe6d5f0004c58270 authored almost 9 years ago by Kristof Beyls <[email protected]>
[html] Advertize the charset actually being used. NFC.

Summary:
We currently advertize the ISO-8859-1 charset is used when we
actually use UTF-8. Let's...

4ab1239790f70c1a2a36e3e1e395592da68e60f0 authored almost 9 years ago by Arnaud A. de Grandmaison <[email protected]>
Remove some console noise

llvm-svn: 258454

5f1e858526cc7deb62daacbfc37951b96afc96b6 authored almost 9 years ago by Chris Matthews <[email protected]>
little formatting fixup

llvm-svn: 258453

ef71b4ca3c54f02717598031bfbf1cbd4a4aae75 authored almost 9 years ago by Chris Matthews <[email protected]>
Better looking error output

llvm-svn: 258452

ba575af408ca6ab052dae77b92779966e0d8f341 authored almost 9 years ago by Chris Matthews <[email protected]>
Dont flash the wrong thing

llvm-svn: 258451

682d4f9e10381b47667c6736d1acd5a42991b18b authored almost 9 years ago by Chris Matthews <[email protected]>
Warn when a regression spans more than test suite version

llvm-svn: 258450

042473a494ec62632db12f4fb0e4214e00bc1f1c authored almost 9 years ago by Chris Matthews <[email protected]>
A test for json regression output

llvm-svn: 258375

de32f58bc509c4cbd8ae87acb3fd28696e64ce29 authored almost 9 years ago by Chris Matthews <[email protected]>
Allow regressions to be json dumped

llvm-svn: 258373

198e5f7b925e8db751fc29be61222a52a597904a authored almost 9 years ago by Chris Matthews <[email protected]>
Make most of the LNT object tree JSON serializable

llvm-svn: 258372

0cc5627b0d390db4b652ae4aa61f8402b1c479e9 authored almost 9 years ago by Chris Matthews <[email protected]>
On bad request, 404

llvm-svn: 258371

cacd8a14000459741c0d1ea3b2f0b16dac85a806 authored almost 9 years ago by Chris Matthews <[email protected]>
Add a "number of test results" table to the daily report page.

This adds a table on the daily report page which reports for each
machine how many tests were se...

7bfeb9f2c378d3309cdc36dfdc8defec857f4241 authored almost 9 years ago by Kristof Beyls <[email protected]>
[test-suite-cmake] Fix a borked test

Tiny typo. I *hope* this might resurrect green dragon...

llvm-svn: 258301

5fd55e0f03d6ec13c5cce8d277465ad0ba3b22f0 authored almost 9 years ago by James Molloy <[email protected]>
Revert "Revert "[test-suite-cmake] Test --only-test support""

This reapplies r258117, as it wasn't this that was causing the green dragon failure.

llvm-svn: ...

e3b41dbb1a69661cfdd86f0b8955fcbc84a0d4be authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Try and appease green dragon

There's a test failure, but I'm not quite sure why it's failing. This is a scattergun approach t...

4e45d8baf34bd941bdecbb0e29bc0b9114b72c6a authored almost 9 years ago by James Molloy <[email protected]>
Revert "[test-suite-cmake] Test --only-test support"

This reverts r258117. Green dragon isn't happy, and it's either this or r258116...

llvm-svn: 25...

97ea93be63bcc840bf73a403784f02fa5a826136 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Test --only-test support

llvm-svn: 258117

1b6fde8f33e222f7f3678f062f877efd7c936b48 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Add rununder support

llvm-svn: 258116

408dc10ff1ae68697f57cb5a998bb3b5c66e08bd authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Add cflags support

llvm-svn: 258055

e2c9ca8c2bbb5253c5be8b60bc2151456c10ddc2 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Add support for setting run_order

llvm-svn: 258054

bd001f494c136e7b10233756fc3cc04d208d67fd authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Add support for nicknames

llvm-svn: 258053

28a3cab1940e266dbe54d244c3058df17e5cb89e authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Add test for no-configure

Add a test for not running cmake if --no-configure is specified.

llvm-svn: 258052

857be8def562bade613ca45c4fca315b74450d46 authored almost 9 years ago by James Molloy <[email protected]>
[test-suite-cmake] Add very basic testing for the CMake LNT driver

This adds the input files for a fake CMake test-suite and a sanity test.

llvm-svn: 258051

8fe4a2b7fc0feec53b892f0df76a7c73f0bd4cd8 authored almost 9 years ago by James Molloy <[email protected]>
Update updatedb to handle regression objects and orders

updatedb was not observing referential integrity for field changes and
regression indicators, fi...

8e430b707427061e7c394966411f3bf948b05774 authored almost 9 years ago by Chris Matthews <[email protected]>
When removing field changes, make sure to clean up correctly

llvm-svn: 257821

e3e0292b4e7b3ca6c02f1d344e55ad2e5b1c3aa6 authored almost 9 years ago by Chris Matthews <[email protected]>
Fix issue with exceptions not being logged

llvm-svn: 257820

1606f5f83086867767e3a28481e68d3e7329bd22 authored almost 9 years ago by Chris Matthews <[email protected]>
Fix error rendering graph in json and add a test

This should have been tested to start with!

llvm-svn: 256321

7bac9a68d6c0db808fd44ab6e260a3f101df9f08 authored about 9 years ago by Chris Matthews <[email protected]>
Make sure machines are in the machine class

llvm-svn: 256320

965f8986378457d6775c078d68390170d8675afa authored about 9 years ago by Chris Matthews <[email protected]>
Add a manual regression creation link to the graphs

Sometimes a change has not been detected, it is nice to be able to
create a regression anyways. ...

b955f2c05a552dec4acade5b75d268c8abcc86d8 authored about 9 years ago by Chris Matthews <[email protected]>
Fix regression tests I broke

llvm-svn: 256296

33915e53b709dd09db671f0a915e78c6876a5c96 authored about 9 years ago by Chris Matthews <[email protected]>
Fix JSLint warnings

llvm-svn: 256295

fc04679a53d0f8f2d8df441353d033be5330d3f8 authored about 9 years ago by Chris Matthews <[email protected]>
Fix AJAX 404 errors on servers that don't run LNT at /

llvm-svn: 256294

7853af67ab62191b09fd20916476b328a2457de6 authored about 9 years ago by Chris Matthews <[email protected]>
Render runID into Regression popover

llvm-svn: 256293

e0b84d0dadbe3c22aa4e793316ac18ad23530983 authored about 9 years ago by Chris Matthews <[email protected]>
Add axis names to old LNT graph too

llvm-svn: 256235

db34a40d1a9361cec0ecdc0eff53ed4e1c8a9e7a authored about 9 years ago by Chris Matthews <[email protected]>
Fix missing order and metric in regression graph

llvm-svn: 256234

badf62022f6becce6d912df986a884ccea1d3901 authored about 9 years ago by Chris Matthews <[email protected]>
Render regressions into normal LNT graph

This adds the functionality of graphing regression into the standard
LNT graph. To make this ni...

7b2780a9df767e8fd016734bc657d13b5768bfa0 authored about 9 years ago by Chris Matthews <[email protected]>
Use the code from lnt_graph.js to render normal graph too

llvm-svn: 256232

f4867dde94dd7a6caae9066c07649b1743863b2b authored about 9 years ago by Chris Matthews <[email protected]>
Whitespace cleanup

llvm-svn: 256231

b15cbae28b6d71e27f0cad95699539866d320910 authored about 9 years ago by Chris Matthews <[email protected]>
Cleanup some old debugging code that snuck into LNT

llvm-svn: 256218

6c5fdacdc154c49fde1ff56666a15cd3366dbe62 authored about 9 years ago by Chris Matthews <[email protected]>
Fix URLs

The urls in the new System bar do not work on LNT instances that are not
attached to / on the se...

2e0800ea22f4f1ea575e1ead99da3d791240c5b9 authored about 9 years ago by Chris Matthews <[email protected]>
Separate out order rendering to its own file

llvm-svn: 256210

7bf95a6071a640a1d827a61bd9c15c70866c94db authored about 9 years ago by Chris Matthews <[email protected]>
Pass target option to test-suite

When lnt calls test-suite's configure script, it doesn't pass in a
target option and will get co...

4d1edde4660b2d9cf67c6b7a4f9aaac3c97f2653 authored about 9 years ago by Chris Matthews <[email protected]>
Link over to lnt.testing

llvm-svn: 255989

190b8f46a044768690a44e26a53b4ad662a7da44 authored about 9 years ago by Chris Matthews <[email protected]>
New docs section, LNT concepts

A lot of people have asked me why nothing is in the compile test suite,
or how to have two physi...

7a21fc2460a9422c1c94c60942a08150d32bb386 authored about 9 years ago by Chris Matthews <[email protected]>
Reorganize the nav bar

Add a system menu into the nav bar. Change the goto menu to be the name
of the suite it operates...

f6b921341b23fdec559999318d8dfdb84b749253 authored about 9 years ago by Chris Matthews <[email protected]>
Use bootstrap for the docs theme, like the rest of LNT

llvm-svn: 255983

811119c0878b22c233f5b601e4441eed81add08d authored about 9 years ago by Chris Matthews <[email protected]>
When docs are built, add them into LNT, so it can self document.

llvm-svn: 255982

31cec61cae1c95cc297022f91682e00c18aa99c0 authored about 9 years ago by Chris Matthews <[email protected]>
Annnnd one more fix for bad logging

llvm-svn: 255980

eca206be3afd00462cdb42f1cb1d00a897de9ca2 authored about 9 years ago by Chris Matthews <[email protected]>
Fix missing logging

llvm-svn: 255979

98340f3c7d7dabb944298fb7e05b952ee9f6ae78 authored about 9 years ago by Chris Matthews <[email protected]>
Clean up to fix all unit tests

llvm-svn: 255976

af689e758269eb2a60c7010e7f27e881f80aa9de authored about 9 years ago by Chris Matthews <[email protected]>
Little fixups to graphing

Add axis information, scale y-axis to percent, more descriptive buttons etc.

llvm-svn: 255975

986e2b060ad39d0f3287f109c2adf3f222e70c91 authored about 9 years ago by Chris Matthews <[email protected]>
Better JavaScript and graph normalization

A JS liner made me see the error of my ways. Fixed a few bugs all caused by bad JS style, then f...

04c4052a9944d42b26594a0dbeb9dc5916babf79 authored about 9 years ago by Chris Matthews <[email protected]>
Regression detail summary side bar

Use JS to calculate some useful stuff about this regression.

llvm-svn: 255971

aecfd12523da30abba3d5056e483ea5ad08a25d5 authored about 9 years ago by Chris Matthews <[email protected]>