Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/llvm/llvm-lnt


https://github.com/llvm/llvm-lnt

Revert r238973 in favor of using future devision in stats routines

We were incorrectly passing ints to these functions way too much.

Instead of asserting, use PEP...

999928bad6f6588420c672810bf5722d6f6aaa65 authored over 9 years ago by Chris Matthews <[email protected]>
Fix report submission when there are failed tests.

When tests fail, we get a .exec.status field type. This has integer
type, so calling the stats.*...

bda57157091043393bac9d5bb245ca1994377eb6 authored over 9 years ago by James Molloy <[email protected]>
Fix a pre-coffee think-o in r238031

...The comment was right but the if condition wasn't!

llvm-svn: 239032

26689878cb58a53282d5c35a8c4a2d9ee5f2f7eb authored over 9 years ago by James Molloy <[email protected]>
analysis: Flip min() to max() for aggregation if bigger_is_better.

As the sense of the benchmark is flipped, it makes sense to flip the
aggregation function too.

...

bb2fae95ca8c1d8fb4b17abd7d0707b56b717fba authored over 9 years ago by James Molloy <[email protected]>
daily_report: Flip colours of regression and improvement if the field type is bigger_is_better.

This is a simple find-and-replace that I missed originally.

llvm-svn: 239030

eef2aef5d32b9378d3afb92039867f2e7a8876c8 authored over 9 years ago by James Molloy <[email protected]>
Whitespace fixups in daily report. NFC

llvm-svn: 238989

ba4858d5b69ef8226d7351d50eedcc0bed3c8cce authored over 9 years ago by Chris Matthews <[email protected]>
Argument errors don't exist, so don't raise them

llvm-svn: 238988

74fe08c07c6f8c4c6f1c8c85f87505f53b5f2fa7 authored over 9 years ago by Chris Matthews <[email protected]>
Remove unneeded cast

llvm-svn: 238987

cf473f2d38832b807fea5c2754548f75fdadfd64 authored over 9 years ago by Chris Matthews <[email protected]>
Add back in missing deNoneification to Geomean calculation

llvm-svn: 238974

9ee3f0d299e5e8cde20402e485992b4fefc478c7 authored over 9 years ago by Chris Matthews <[email protected]>
All of these routines make the assumption of floats, check that

llvm-svn: 238973

2b92120037751aead098580e75cfb3177d2ad2ea authored over 9 years ago by Chris Matthews <[email protected]>
Our stats routines don't work on ints, do don't use them

llvm-svn: 238972

3e258ea9241beb2a4b5752d902500293c276ad0d authored over 9 years ago by Chris Matthews <[email protected]>
Fixup print statements

llvm-svn: 238971

a5f466f4888af49caa4b4d81daec52515bf0eb46 authored over 9 years ago by Chris Matthews <[email protected]>
Update more tests to run now that regression detection is more accurate

llvm-svn: 238970

9f39755da778776d0081c78e1a1a4ecdef32b0ef authored over 9 years ago by Chris Matthews <[email protected]>
Don't filter the summary table

This does not have benchmark names in it, so don't filter it!

llvm-svn: 238969

6a033197dd550eb7489b84bb7c15018900c9949a authored over 9 years ago by Chris Matthews <[email protected]>
Update the daily report to use more previous data

Now the analysis can use past data better, pass in more old data. Daily
report used to compare ...

7d9635fbb5e56f7fdd4cf3b77b63e3b8692470f4 authored over 9 years ago by Chris Matthews <[email protected]>
Little formatting fixup

llvm-svn: 238967

af5e8725efe87263ce8385e54c7eefef988ac8e7 authored over 9 years ago by Chris Matthews <[email protected]>
Import cleanup

llvm-svn: 238966

5bf6176956d24f3938b214dca00a19b599b24bf7 authored over 9 years ago by Chris Matthews <[email protected]>
Improved regression detection with min of diffs

This change reduces false positives in LNT's regression detection
algorithm by having it use mor...

6b4265fa7d73762cf3599e98f85a3c5dc0366412 authored over 9 years ago by Chris Matthews <[email protected]>
Remove a print statement that snuck in

llvm-svn: 238964

e50c97600bac3716f91418d268e1885b4a5b1ff9 authored over 9 years ago by Chris Matthews <[email protected]>
Remove some dead code

llvm-svn: 238963

dbb254b176df0e2de7a6936a42211c8435eb5440 authored over 9 years ago by Chris Matthews <[email protected]>
Add a filter to the Run pages so the user can filter by benchmark name

llvm-svn: 238962

71cc772fd8d9b64501669116c776c97e943292f0 authored over 9 years ago by Chris Matthews <[email protected]>
Fix paste-o from r235959

llvm-svn: 238920

26b8d921115cce8bb0c4fbc2dd5a8a75800e1ce9 authored over 9 years ago by James Molloy <[email protected]>
Enable adding test-specific records to test database.

This is commit completes the enabling of easy creation of per-test data in the
test database.

l...

1e10b0c36ca9757291a2b4014af9a759abc25f38 authored over 9 years ago by Kristof Beyls <[email protected]>
Remove most of the unnecessary insert statement from the tests/SharedInputs/SmallInstance test database.

This is another step towards enabling easy creation of per-test data in the
test database. By re...

c21e8ff0550c521c78c9b5bec16aa371b0831242 authored over 9 years ago by Kristof Beyls <[email protected]>
Replace hexadecimal encoding of blobs with textual representation in test lnt_db_create.sql.

llvm-svn: 238298

eb1754a649d076225338d838d71b6cd5638dae22 authored over 9 years ago by Kristof Beyls <[email protected]>
Replace binary test lnt.db with human-readable text to create test LNT db.

This is another step towards enabling easy creation of per-test data in the
test database.

The ...

91fd58057e40226300b1de27df4f8bd23b32b480 authored over 9 years ago by Kristof Beyls <[email protected]>
For the regression tests, make temporary LNT db instances on the fly.

This is a step towards enabling having per-test data in the test LNT db,
and making it easier to...

c74f7e895227bfcc97d443ef4092dbf91d4df319 authored over 9 years ago by Kristof Beyls <[email protected]>
Add a searchable machines page

Sometimes it is hard to find old machines in LNT. This interface
exposes them directly.

llvm-sv...

ab4552954743d3989238add75a40394c6bf3dffb authored over 9 years ago by Chris Matthews <[email protected]>
add missing assert in --exclude-stat-from-submission implementation

llvm-svn: 237784

193b75573105bcc0219b9d3c2b5ac09103d0a948 authored over 9 years ago by Kristof Beyls <[email protected]>
Improve regression test for --exclude-stat-from-submission option

llvm-svn: 237783

0cecd1253e83830116c554be5399a6cc293f4bbe authored over 9 years ago by Kristof Beyls <[email protected]>
Make show all points the default, also remove show single point

To really understand the data, it is important to actually see all the
points, not just the aggr...

43f37edfe79b1ebd20ebe56822e68507715c4125 authored over 9 years ago by Chris Matthews <[email protected]>
Small test for the exclude stat option

llvm-svn: 237742

e80eadb985f4bc55c13f0c9102ca63bcf767e57a authored over 9 years ago by Chris Matthews <[email protected]>
Fix broken view-comparison tool

llvm-svn: 237732

bdff36cfba4a7352c29f9c5ae2fb85b8bd942dec authored over 9 years ago by Chris Matthews <[email protected]>
add --exclude-stat-from-submission option to lnt runtest nt.

llvm-svn: 237671

f3b8df2d72e5dd287b8335d80bb40c7ec02dd69a authored over 9 years ago by Kristof Beyls <[email protected]>
More analysis test cases

llvm-svn: 237661

00054cb295733685a1dd4fd7e9c36c259083b6d0 authored over 9 years ago by Chris Matthews <[email protected]>
Reorder checks from stronger to weaker

llvm-svn: 237660

5c566634703d13514d9448b814f2fae91876b64d authored over 9 years ago by Chris Matthews <[email protected]>
Refactor min measurable value - it should be common and agreed on

llvm-svn: 237659

bc7827426858ae1fe029d87d6fb7495627116b36 authored over 9 years ago by Chris Matthews <[email protected]>
Refactor ComparisonResult to be more self contained

llvm-svn: 237658

3fe8ff6e09c9787ca812f20e7bf119f966d50a2d authored over 9 years ago by Chris Matthews <[email protected]>
Some more comments in ComparisonResults

llvm-svn: 237657

1273c74be8fb73698114672d06663e5d80b0d523 authored over 9 years ago by Chris Matthews <[email protected]>
Add repr to ComparisonResults for handy logging and debugging

llvm-svn: 237656

1b975adba27477b45c66e4c100c71dfeae546bec authored over 9 years ago by Chris Matthews <[email protected]>
Remove getter for samples, it is not used

It could be a property anyways.

llvm-svn: 237655

fa4fd44d75770e1476ba81387f182b80c3e3a797 authored over 9 years ago by Chris Matthews <[email protected]>
Use a property instead of a getter for test ids

llvm-svn: 237654

524d15991177ad85f7afd6c2d5c3f912f7ab72f1 authored over 9 years ago by Chris Matthews <[email protected]>
Test the generation of ComparisonResults

llvm-svn: 237653

8838572be86871b75a8ea154651b44926c92952a authored over 9 years ago by Chris Matthews <[email protected]>
Fix bug in buildbot reporting introduced in r237540

llvm-svn: 237564

1770aac2725e3f402ebaf4b438f7896a0562031b authored over 9 years ago by Tobias Grosser <[email protected]>
Do not fail on missing result_url when submitting builds

This should fix our failing buildbots. Not sure this is indeed the
optimal solution.

llvm-svn: ...

be225f6240e3a4cf8943ad9686dc1dd6735ae4bf authored over 9 years ago by Tobias Grosser <[email protected]>
Allow more than one submit server

llvm-svn: 237188

2c09d02514901f62701b4629b3c2046464143bd2 authored over 9 years ago by Chris Matthews <[email protected]>
Make upgrade_3_to_4 and upgrade_4_to_5 also work on Postgres databases.

When creating a new LNT server instance using a postgresql DB server, the creation failed
when r...

8f1b835125bc90e63e61f91df2f0042c4d13c6d7 authored over 9 years ago by Kristof Beyls <[email protected]>
Expose the days option to generate different email report lengths

llvm-svn: 237088

954e8fff0b26b79b153598a1682b248c53ea2a07 authored over 9 years ago by Chris Matthews <[email protected]>
Some nicer settings for Heroku instance.

llvm-svn: 237087

ad793c1da1dbf88980d4b04fd2feb307dd985b8d authored over 9 years ago by Chris Matthews <[email protected]>
Submitting the same rev a lot can be very slow, warn

llvm-svn: 237057

1274ed44e3690c74aaff1e3f71e6fdb436843be3 authored over 9 years ago by Chris Matthews <[email protected]>
Fixup printing result url - this can be None sometimes

llvm-svn: 237012

f13dd179aab0cd100486f5c9dbb7a88afab2956e authored over 9 years ago by Chris Matthews <[email protected]>
A catchall except is the worse thing ever, don't use it

Anything that this can catch should be fixed anyways, so just don't
bother.

llvm-svn: 237011

1fd10489fdde5b1925861a36f74a29501b9fc95c authored over 9 years ago by Chris Matthews <[email protected]>
Teach LNT about 64-bit Mips targets.

This stops the SSE tests from running and failing, due to lack of SSE, on MIPS64.

Reviewers: ds...

58be75e39759d6d1336b568ce9a8863831b5c5f1 authored over 9 years ago by Vasileios Kalintiris <[email protected]>
print a handy link to the results after LNT submits

It is really handy to be able to go right to a run result from the
console. Have the server pre...

20ad89203272d06634d8e386353cd7e887c3cb79 authored over 9 years ago by Chris Matthews <[email protected]>
Fixup command line make paramters

llvm-svn: 236330

cfee24f038fa98f44cb976b869b41bac1d3f0f61 authored over 9 years ago by Chris Matthews <[email protected]>
"Latest Submission" time is incorrect

Latest Submission implies the time the run was submitted. We used the
start time, which could be...

4b24117f23598b15eeb87416959a37363689a47a authored over 9 years ago by Chris Matthews <[email protected]>
Fixup how LNT handles dates and times in the UI

LNT has always confused people by showing dates and times in UTC, but
without adding the UTC pre...

c81196960b5ed1b255f2079fab5abc6f5662d6e8 authored over 9 years ago by Chris Matthews <[email protected]>
[NFC] Make nt.py a little more PEP8 compliant

llvm-svn: 235757

7161f260313688c9adc275d712f67cc484001228 authored over 9 years ago by Chris Matthews <[email protected]>
whitespace cleanup

llvm-svn: 235753

27e54ad039e9d7d3d8eb59bb450b79f5b061a267 authored over 9 years ago by Chris Matthews <[email protected]>
Make the score sample type work with reruns (really this time).

llvm-svn: 235748

1ac8cb31d5cca855ff7285952f0c71824b902638 authored over 9 years ago by Chris Matthews <[email protected]>
Revert "Make the score sample type work with reruns."

I accidently combined a whitespace cleanup with this patch.

This reverts commit r235659.

llvm-...

e509eb813f36930e2340274ba5e0492fba809686 authored over 9 years ago by Chris Matthews <[email protected]>
Make the score sample type work with reruns.

llvm-svn: 235659

75382a6fdd31ccb0e5952c9f1451a36b221fc71f authored over 9 years ago by Chris Matthews <[email protected]>
Make rerun tests more robust to changes in the example database

llvm-svn: 235658

5dec3055c183501cc6c37de21db9647e0fa878a6 authored over 9 years ago by Chris Matthews <[email protected]>
Make runtest tests more robust to changes in the example database

llvm-svn: 235655

0b0a761cedcb6282d107fc6b745737cac1b7fc94 authored over 9 years ago by Chris Matthews <[email protected]>
[LNT] Add a 'score' sample type

This is intended for benchmarks that report some bigger-is-better metric,
like Geekbench's "scor...

bfae11dec49baf56ffccc9eaca2661838e30b300 authored over 9 years ago by James Molloy <[email protected]>
[LNT] Add the ability for test samples to be interpreted as "bigger is better"

The default assumption in LNT currently is that smaller sample values are
better. This adds a ne...

94dbe94be30e5ef84e42487e75a49eadf7915cac authored over 9 years ago by James Molloy <[email protected]>
Be a little more verbose and helpful when project build code size fails

llvm-svn: 235561

107639fa4866c781edffc2e86da5b79d74f3716a authored over 9 years ago by Chris Matthews <[email protected]>
When machine is invalid, return 404 instead of error

llvm-svn: 234800

7adfbc1e1c6718121fd9cba1725bd53cb435873e authored over 9 years ago by Chris Matthews <[email protected]>
Make some small fixes to appease the tests.

llvm-svn: 232213

f3e0100cd27097cf82472792231ca1c6a4bf4201 authored almost 10 years ago by Michael Gottesman <[email protected]>
Make the baseline configurable per database. This enables different projects on the same LNT installation to use different baselines.

llvm-svn: 232207

4ca9a6d2772b153822d5a55a2f36522503630d02 authored almost 10 years ago by Michael Gottesman <[email protected]>
Make awk, not gawk, the dependency for LNT

llvm-svn: 231572

217a3767fd4293ed509865b19e82f99ed470f353 authored almost 10 years ago by Renato Golin <[email protected]>
Drop gawk from the tools check

Adding it in 231484 has broken my LNT testers. As they worked flawless
before, it seems gawk is ...

9500f302b97a079dc14e8dd0e7363e7a4e081882 authored almost 10 years ago by Tobias Grosser <[email protected]>
Adds check for needed tools for nightly tests

This patch adds test for the required tools to run the nightly tests
without failures. New build...

0a3dd714a3976392650372120b7b374e7c61110a authored almost 10 years ago by Renato Golin <[email protected]>
Explicitly stringify datetimes

It seems in some versions of python the jsonifyier does not handle datetime objects. Explicitly...

cd7e1bbc6fe72d1e4da8dc789c58ff596cd14c8b authored almost 10 years ago by Chris Matthews <[email protected]>
Reduce the chance of two concurrent submissions breaking the database

Currently, two concurrent submission can occasionally insert two identical
Orders into the order...

3ece600e6ced3bd620b4d8613c291b08b8a40872 authored almost 10 years ago by Chris Matthews <[email protected]>
[lnttool] Compare parse version strings, to handle canonical version forms.

- In some cases, the reported version will be a canonical one like "0.4.1dev0"
which should ...

5510b7d79a238bbcdce25fb9ee750ee6cd6ea3a5 authored almost 10 years ago by Daniel Dunbar <[email protected]>
Add JSON support for 'machine' and 'run' pages.

Include only the data available in usual HTML form.

llvm-svn: 226763

7ffa1123723d9d0e96cb3c6666bd1b2553d9cbbf authored almost 10 years ago by Michael Zolotukhin <[email protected]>
Add machine overview page in JSON format.

llvm-svn: 224737

92d5385c5632ad1e725d22a71f7b1d0b09152aed authored about 10 years ago by Michael Zolotukhin <[email protected]>
When we die from server error, show it

llvm-svn: 222454

1a4415679c40fae7b64a5903dda473b5e850270a authored about 10 years ago by Chris Matthews <[email protected]>
Update test to use rsync with an exclude so that SVN data is not copied into Output

llvm-svn: 221500

f2637cfb8c5fe6625d01b97aa572749bc6fabdf1 authored about 10 years ago by Chris Matthews <[email protected]>
Fix an assertion that was too strong

llvm-svn: 218902

f45ccdd2ea58f46861c90c1628929a82545a18f6 authored over 10 years ago by Chris Matthews <[email protected]>
Don’t perform reruns on “LNTBased” test extension modules

LNTBased extends the test suite with new benchmarks with custom run code.
These cannot be rerun ...

0662d92df9c63ccde3aa7c68aad5e8aafa2c4b67 authored over 10 years ago by Chris Matthews <[email protected]>
During rerun, fix full test benchmark path to be the same as only_test

When doing reruns for the full test suite, the reruns benchmark name is
being incorrectly repor...

be20a509df32c33de243f8ade20ffca45774d007 authored over 10 years ago by Chris Matthews <[email protected]>
Fix name parsing in rerun code to handle test names with . in them

llvm-svn: 218635

a3b588bcb64ddb97af9065a01397bd542737e1e7 authored over 10 years ago by Chris Matthews <[email protected]>
Add rerun flag: when passed, rerun benchmarks which the server says changed

llvm-svn: 218080

2a9f5eb59df0a5d89f17951a1f7c05a8ad186e29 authored over 10 years ago by Chris Matthews <[email protected]>
Add option to use Perf in nt test

llvm-svn: 218056

c60f59d45f96baa217de11b137076d556807d958 authored over 10 years ago by Yi Kong <[email protected]>
Remove jQuery 1.5 files

We've switched everything to 1.7, no need to keep them in the source anymore.

llvm-svn: 218055

fd9ec59b656c66b2732683e9df033a964c76d45d authored over 10 years ago by Yi Kong <[email protected]>
Rename 'Mean' to 'Geometric Mean' for clarity

llvm-svn: 216828

59ba6a711991a05db7a461996c1e36881a3e963a authored over 10 years ago by Yi Kong <[email protected]>
Teach LNT about AArch64 target

Teach LNT to set corresponding compilation flag to the LLVM test suite build
system for AArch64 ...

c4590a50034a335eef169cd14215eab9bbf1b863 authored over 10 years ago by Yi Kong <[email protected]>
Label the test name if there are more than one plot

This helps distingushing data points when plotting multiple graphs, especially
when data points ...

946b685fbe009a21eea540dbb7049fb11acea2fc authored over 10 years ago by Yi Kong <[email protected]>
Teach LNT to plot geomean trend

Public perf server has moved to PostgreSQL, we no longer suffer from
performance issue. It makes...

ae82462d7bfaa61fc59799c89a580c87e74e97c8 authored over 10 years ago by Yi Kong <[email protected]>
Expose calc_geomean function

Expose calc_geomean to other packages so that it can used when plotting graph.

llvm-svn: 216545

c86a2dc9d1f6025e3da9fb3a581ea8159df9e292 authored over 10 years ago by Yi Kong <[email protected]>
Make sure lit tests pass on non-Darwin systems

lit tests always fail on non-Darwin systems because --use-isolation uses
utilities that are only...

3812e2958db8d38cde9610340060a6c950249cf4 authored over 10 years ago by Yi Kong <[email protected]>
Make not finding compiler version a hard error

llvm-svn: 215049

2d573b40381de1cbd51a6eb9c228e56ecaa5ee65 authored over 10 years ago by Chris Matthews <[email protected]>
Revert "Activate navbar items upon hovering the mouse"

This patch turns out to make navbar less usable.

Reverts r209021.

llvm-svn: 214553

c9f6abf9d88f49d897681298670524ec3a5314a0 authored over 10 years ago by Yi Kong <[email protected]>
Add PostgreSQL compatibility

Make LNT compatible with PostgreSQL.

PostgreSQL is now recommended for production servers.

llv...

be32f9d924e63b3016724d64dc15379546dfe31f authored over 10 years ago by Yi Kong <[email protected]>
Add --qemu-flag to reduce the number of rununder wrappers required.

It functions in the same way as --cflag

llvm-svn: 214065

4a18a4278e888a26b49183b68d35731851be9dcb authored over 10 years ago by Daniel Sanders <[email protected]>
Add a option to dry run email commands, add tests of those commands

We have not previously tested LNT email operations. They break sometimes. This patch adds a —-dr...

d000d170ec7702100101f2d5ce9d753ec958603d authored over 10 years ago by Chris Matthews <[email protected]>
Fix 'Fix crash when no result to compare against'

llvm-svn: 213271

666e1e6fd71fd781e8cae22a97a8760fffb9cc23 authored over 10 years ago by Yi Kong <[email protected]>
Fix crash when no result to compare against

llvm-svn: 213270

0943da7204ad22d3f40fa20ab761111c40893f00 authored over 10 years ago by Yi Kong <[email protected]>