Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/llvm/llvm-lnt


https://github.com/llvm/llvm-lnt

migrations.util: More abstract implementation of add_column

This should fix the PostgresDB unittest which broke with r309065.

llvm-svn: 309167

920903be07f04fa1a6abd21945cf199934a35b32 authored over 7 years ago by Matthias Braun <[email protected]>
Change testdata, so the problem fixed in r309149 gets catched

llvm-svn: 309166

131e31301169b21cb449dc718c0873b9fcb48f0e authored over 7 years ago by Matthias Braun <[email protected]>
v4_run: Do not assume run parameters are strings

This fixes problems displaying result pages after the newly introduced
'no_errors' storing a boo...

0dade71539af6c92a76875e47af5e1590c796c37 authored over 7 years ago by Matthias Braun <[email protected]>
DeSQLify the migrations

The SQL in the LNT migrations has always been fragile. This removes
the SQL in favor of SQLAlch...

4faaf3a0795f5282235e0abda3d01a0fae4fe12f authored over 7 years ago by Chris Matthews <[email protected]>
lnt/tests: Add 'no_errors' to run_info; add lnt check-no-errors

This is motivated by the problem that you often want your CI scripts to
continue to collect addi...

23545d9c40aa60b4ce9136b78e96a5ea5f53c8be authored over 7 years ago by Matthias Braun <[email protected]>
admin: Improve testing and fix some bugs

llvm-svn: 309040

0585d90daf9fc536bb0b8172d66976ac5f28b8c4 authored over 7 years ago by Matthias Braun <[email protected]>
admin: Add machine-info command

llvm-svn: 309011

3421ba2eb8939ce04c403cdb8e5e829fe15c8b8d authored over 7 years ago by Matthias Braun <[email protected]>
api: Match /machines/name to specify machines

For /machines/XXX requests:
- if XXX is purely numeric look up a machine id
- otherwise look for...

abe0f3591618d8a8bcaf1620fe32f13c9b704aba authored over 7 years ago by Matthias Braun <[email protected]>
admin: Rework commandline/click handling

Change code to use click in a more canonical way: Push common options to
the `lnt admin` level a...

f80bf3b57628f6a9cd39b4313bca712f09d249b5 authored over 7 years ago by Matthias Braun <[email protected]>
lnttool: Give nicer error message for unknown subcommands

llvm-svn: 308991

a392bc781f73d2a1bd2041c68c92abc7c7e5ed2e authored over 7 years ago by Matthias Braun <[email protected]>
Add lnt commandline REST client

Adds `lnt admin` subcommands that allow manipulation of the data in an
LNT database. It currentl...

3986500aa880e292c6e41b37e9816c37f824bde9 authored over 7 years ago by Matthias Braun <[email protected]>
Documentation cleanup

docs/developer_guide: Simplify/fix.
- Remove `pip install psycopg2` note: The package is part of...

4cd044aa4f82b86ea7d9082195d59176840203f4 authored over 7 years ago by Matthias Braun <[email protected]>
tests/test_suite: Define compiler before applying cache files

This allows caches files to adapt to the given compiler (like
conditionally apply flags).

llvm-...

b9476f0637b6fe9f5bd7d7b410345ad46b8eb7d7 authored over 7 years ago by Matthias Braun <[email protected]>
builtintest: Use dummy report instead of submitting to dummy instance

Submitting to the dummy instance isn't really necessary and fails when
using a non-default schem...

e4e2c4f2b5f87e50de6a6b6beaa51c81eb208c8e authored over 7 years ago by Matthias Braun <[email protected]>
lnt/tests: Fix more --commit flags, test them.

- Fix more --commit flags similar to r308862
- Add --commit flags to some tests
(fun fact: The...

655e857b3b5f9dc1837b8cc5cbb50423aca84b52 authored over 7 years ago by Matthias Braun <[email protected]>
Also make --commit a flag for 'lnt runtest nt'

This was missed in r308256 and broke some buildbots.

llvm-svn: 308862

d265ee2155fb783824cd91731852b6e0b3951bb8 authored over 7 years ago by Tobias Grosser <[email protected]>
Simplify joinedload usage; NFC

llvm-svn: 308861

5f33a40ec5dc08f85aa7133a8259423d69e1432f authored over 7 years ago by Matthias Braun <[email protected]>
runtest: Do not print result URL when not submitting

Avoid `lnt runtest` printing "Results available at: db_None/v4/nts/1"
when not submitting the re...

b849899f3bc8c5a1af22792c509049c3bb89b73f authored over 7 years ago by Matthias Braun <[email protected]>
Put api_auth_token into example config

Commented out so users have to explicitly enable it.

llvm-svn: 308858

3b86dd9b1ddbbe23d689464ca224f7ada5d60b12 authored over 7 years ago by Matthias Braun <[email protected]>
api: Set CORS

Set Cross-Origin Resource Sharing HTTP header for the REST api so it can
be used from javascript...

854d4e54779afa59ac582f45ba2f5885c9804a0d authored over 7 years ago by Matthias Braun <[email protected]>
tests/test_suite: Add --output option

This is in line with the `runtest nt` and `runtest compile` modes which
already had this option....

229ffb4a9132d9488a5b07b30b56f8ee561f7fc9 authored over 7 years ago by Matthias Braun <[email protected]>
Don't compare order_id either in round trip test

llvm-svn: 308804

55de98ce8994db81f5107ee21ba8faeef812f4e2 authored over 7 years ago by Chris Matthews <[email protected]>
Add Form labels to run page

It is good HTML form to use the label tag on from labels.

llvm-svn: 308805

9f144d5a2d89b7de1215fbec4d0800cc76551f25 authored over 7 years ago by Chris Matthews <[email protected]>
Wrong usage of Blueprint

I was passing templates the wrong way.

llvm-svn: 308796

55694c84081a7c0187d6613891e9fcd4e97b14e8 authored over 7 years ago by Chris Matthews <[email protected]>
Upgrade to Flask 0.12.2 + switch to Flask Blueprints

The Flask Module system we were using in LNT was depricated and removed
from Flask long ago. Thi...

0d414597e46ec3e0c278718a4f7c1c27e56e9623 authored over 7 years ago by Chris Matthews <[email protected]>
Upgrade Werkzeug

This new version works great for me.

llvm-svn: 308793

5fefddf234ee19ddcf06c0493dcd31d3fe232ebf authored over 7 years ago by Chris Matthews <[email protected]>
Round trip test

I forgot to include this with my roundtrip patches. A test case which
pull data out of LNT and s...

8cd88e3ec604036f5c56a49220ef8370a59aa93f authored over 7 years ago by Chris Matthews <[email protected]>
Update to latest stable SQLAlchemy

SQLAlchemy 1.11.1 seems to work for me and pass the tests. Lets upgrade
before I start other DB ...

a87741e05cc791c948b60490717a19c5f8819903 authored over 7 years ago by Chris Matthews <[email protected]>
lnt/server/ui: pep8 fixes; NFC

llvm-svn: 308790

f499082169396bf488681bfcc9eeb81d19e66a5a authored over 7 years ago by Matthias Braun <[email protected]>
api: Add machine merge operation

Add api operation to merge 1 machine into another.

Duplicated machines are a very common occure...

371cae7e6917e501276dab763a7e2580ef027dc3 authored over 7 years ago by Matthias Braun <[email protected]>
api: Write a log message for all modifying machine operations

llvm-svn: 308704

e1505d4015b896d6962d5fa6a3e1b736a194642d authored over 7 years ago by Matthias Braun <[email protected]>
tests/server_wrapper: Increase waiting time

Hopefully this makes the jenkins job more stable

llvm-svn: 308696

1b0893ed3dcc5acaa6e2e7f3ab0a0a54bc523c05 authored over 7 years ago by Matthias Braun <[email protected]>
api: Rework json serialization, add roundtrip test

- Move a bunch of object->dict logic from api.py to testsuitedb.py into
the __json__() methods...

3471851c400593041a0383f22d8f365eb28fd059 authored over 7 years ago by Matthias Braun <[email protected]>
Fix lnt checkformat and add a test for it

This broke when switching to click, and there was no test catching it...

llvm-svn: 308670

8034a826e252cf4b2cdcee75ac2749f01a74ca00 authored over 7 years ago by Matthias Braun <[email protected]>
feedback: this was supposed to no be there

llvm-svn: 308570

6063c8ca3fcb0d883331ce62cd93ca900edfa248 authored over 7 years ago by Chris Matthews <[email protected]>
I missmerged this

llvm-svn: 308567

677dc0327e7b1e9815f34eac64f924c23f9ea2ff authored over 7 years ago by Chris Matthews <[email protected]>
Match the format of the rest of the file

llvm-svn: 308566

ac198407c5b2916853955ee2dd403a2a359b3e8e authored over 7 years ago by Chris Matthews <[email protected]>
LNT API run roundtrips

Allow LNT runs to be downloaded from the API in a format that they can
be inserted back into the...

933692fc0b482c8940c9489aaaf73dd57a214687 authored over 7 years ago by Chris Matthews <[email protected]>
Unused + whitespace cleanup

llvm-svn: 308564

e4f0772a8f0b136da513c1fcd4d8adbe79caba69 authored over 7 years ago by Chris Matthews <[email protected]>
Spelling

llvm-svn: 308563

0e117fd3b232f3a6a8636a5f89b749681c377dbe authored over 7 years ago by Chris Matthews <[email protected]>
Add machine->fieldchange relation

I've seen situations where fieldchange entries for a machine linger
around, even after removing ...

b14b3a6bde5e54bba8617d7ef478444738ca7e9c authored over 7 years ago by Matthias Braun <[email protected]>
Adding transfer-encoding didn't help

llvm-svn: 308514

19173eb8445730150ff4ecc4f2c30830268e6c8c authored over 7 years ago by Matthias Braun <[email protected]>
api: Try if eagerly loading fieldchanges speeds up machine/run deletion

llvm-svn: 308414

52ec21522766c97a7c71f253d6790279a04aa58a authored over 7 years ago by Matthias Braun <[email protected]>
api: Show number of total runs in machine removal progress

Also try whether `Transfer-Encoding: chunked` improves the experience.

llvm-svn: 308413

8d0e3f8a9c672b2c0295e16e4289e5e52dea5dd8 authored over 7 years ago by Matthias Braun <[email protected]>
api: When removing a machine, delete runs in chunks.

For machines with hundreds of runs we run into timeouts and OOM
situations when sqlalchemy tries...

714855745c0ef1ae6840792861b3856a60e0fd55 authored over 7 years ago by Matthias Braun <[email protected]>
Add missing files.

llvm-svn: 308405

8a7c980a224c69f7e843a5363c9516d9dc523fc9 authored over 7 years ago by Matthias Braun <[email protected]>
Improve submission error handling

- Set 400 status on the submitRun response if the 'error' field is not
empty.
- Fix some error...

eb815b4164c7872e809059c85750f157e9f503af authored over 7 years ago by Matthias Braun <[email protected]>
Rework lnt submit test

Only start and teardown a single server instance which lets this test
finish in 8s instead of 35...

b94d0edea510546a1bab5bfca1929dfdc8369b9a authored over 7 years ago by Matthias Braun <[email protected]>
Update links in docs to new URLs

llvm-svn: 308349

8ec781829ccae44c43859abcca23e3b8bc72373a authored over 7 years ago by Chris Matthews <[email protected]>
docs: Fix typos

llvm-svn: 308345

5beeb0fe5a8d933cbd9240ddd0ec0c9521004b77 authored over 7 years ago by Matthias Braun <[email protected]>
api: Implement POST method for runs

Add POST method to /runs REST endpoint.

llvm-svn: 308342

1ade95fbb03c735bba8a91357d7cc55348f8ac6b authored over 7 years ago by Matthias Braun <[email protected]>
views/ImportData: Move flask/ui independent part of importing to ImportData; NFC

llvm-svn: 308341

8497b2b2c2f635d8b0ec2da7e1875a6dce9fd0fc authored over 7 years ago by Matthias Braun <[email protected]>
Change installation instructions to point pip to svn

llvm-svn: 308337

423f3a97d995bc81fed87f3de9b5ffc6b5980d5e authored over 7 years ago by Chris Matthews <[email protected]>
Show ISO8061 timestamps in docs

We want to encourage people to use ISO8061 timestamps, so make the docs
use them.

llvm-svn: 308334

5273d14bc8e9cb91568421cb608d869b60b1a4ae authored over 7 years ago by Chris Matthews <[email protected]>
Add info about auth keys and DELETE in the API

llvm-svn: 308332

0d31291f85c5a11b63fefffda2b055201c9d0d50 authored over 7 years ago by Chris Matthews <[email protected]>
Set `lnt runserver` logger to info; Print external testsuite loaded to debug

llvm-svn: 308258

d12f1a9dee8ad465ba8e9bfdc5d29fa7ebf69b4a authored over 7 years ago by Matthias Braun <[email protected]>
api: No need to require slash at end of route

llvm-svn: 308257

122fa2ae01b4305917e0b00c63e4a33bf273746b authored over 7 years ago by Matthias Braun <[email protected]>
Import: Make --commit a flag; make sure commit arg is always a boolean

`--commit=1` and `--commit 1` is still supported as an (undocumented)
special case to not break ...

b99d63b02b5747d11a3bcfd47d23a90b919dfe51 authored over 7 years ago by Matthias Braun <[email protected]>
NTEmailReport: Remove unused parameter, hide internal function; NFC

llvm-svn: 308255

a4594a4bf8fc71c608d8ad5633d54afc172fc18b authored over 7 years ago by Matthias Braun <[email protected]>
A few typos and style issues

llvm-svn: 308237

4d21076eb1c1328bd3c9ac0395c72a4815598df4 authored over 7 years ago by Chris Matthews <[email protected]>
So we can reingest LNT data, ignore metrics with id in the name

The REST API adds these keys so that you can delete etc, but we need to
ignore them when they ar...

d265bae5ae91bee8c0a57b77ed7380c3b65cc9d7 authored over 7 years ago by Chris Matthews <[email protected]>
Accept ISO8061 timestamps in run submission

I'd like all of our timestamps to be 8061. For now, lets start allowing
us to accept them in ru...

740bd11679d683d5179838c08455b4a61b8ed3dd authored over 7 years ago by Chris Matthews <[email protected]>
"lnt profile upgrade" crashes when output points to an inexistent file

Regression when moving to "click" for command line parsing.
"lnt profile upgrade" crashes when o...

4eaa1dacf9c23162eebcbb740f16435da1a64a8e authored over 7 years ago by Chris Matthews <[email protected]>
Include exception name in error output

llvm-svn: 308229

fa4ea9d98a07924fc8a0666eea0c5da59389cab9 authored over 7 years ago by Chris Matthews <[email protected]>
api: Implement POST request to rename machines

llvm-svn: 308204

7d0e2e501be2c75743d678cb57da63ddfd2c91c2 authored over 7 years ago by Matthias Braun <[email protected]>
api: abort() throws so there is no need to return a value; NFC

llvm-svn: 308201

f1023ac3822db53c61142da4645c9d9c717ef6cd authored over 7 years ago by Matthias Braun <[email protected]>
Fix missing "Produced by" field on Run causing UI crash.

When a given run contains a "producer" value (usually an URL pointing to build
systems), the run...

50e587f800a153495ef22c705a1dce3df8ea1787 authored over 7 years ago by Kristof Beyls <[email protected]>
api: Implement machine deletion

llvm-svn: 307994

0599af8c4eaf8aff903cf1d19ebfb93a1018e03d authored over 7 years ago by Matthias Braun <[email protected]>
Simplify deletion code; NFC

With the cascading specifications in place, deletion is trivial...

llvm-svn: 307993

b9d4622cb14fd0f407431df95134b120004f2f8a authored over 7 years ago by Matthias Braun <[email protected]>
testsuitedb: Specify backrelations with cascading behavior

Apart from making the structure more explicit this should make deletion
code a lot easier.

llvm...

a21658c7a3736eb40015f843e9b358902878e740 authored over 7 years ago by Matthias Braun <[email protected]>
testsuitedb: Request index for Sample->RunId

While this seems like a fatal omission, it usually didn't matter as the
migration scripts add in...

7e960c131dbe871ebb7a482ad8d0c2ad948d19ca authored over 7 years ago by Matthias Braun <[email protected]>
testsuitedb: Simplify relation specification; NFC

- Import relation method and do not repeat the full module path each
time.
- Directly referenc...

d1943d2d6b203566e820293059f9ebdeea327644 authored over 7 years ago by Matthias Braun <[email protected]>
Use yaml schema mechanism to describe compile suite

This re-applies r307562 now that the metatables are upgraded in sync
with the yaml so the fieldc...

f0cb3b33966c216b99e95b0e3a0796f535d67f04 authored over 7 years ago by Matthias Braun <[email protected]>
Refactor and fix schema loading/migration from yaml file

The fieldchange system references metatables from the testsuite specific
tables, this means even...

847716e79402ae734e582e6710ecfd73719c94c5 authored over 7 years ago by Matthias Braun <[email protected]>
Refactor to only have 1 list of sample types; remove Integer

- Remove unused sample_types list from v4db
- Avoid duplicated list in TestSuite.from_json
- Rem...

8d3cf39527771836c35816e5b5bb263bae1a1844 authored over 7 years ago by Matthias Braun <[email protected]>
v4db: Increase sqlite timeout waiting for a locked database

This reduces the chance for problems when blasting an sqlite testserver
with submissions.
It doe...

21ea71886ad166091afe7c6780520043bfe9afcf authored over 7 years ago by Matthias Braun <[email protected]>
view-comparison test does not need an instance

llvm-svn: 307806

e03567cc0622546b0fa92aae801052a10dc733c0 authored over 7 years ago by Matthias Braun <[email protected]>
Remove flask dependency from testing.util

Providing the visible_note() function and playing games with global
flask state in unrelated por...

e358481e147f686fa3cf8f459dd42da68ec513fe authored over 7 years ago by Matthias Braun <[email protected]>
Use lnt.tests list to construct click runtest group

- We only have 1 hardcoded list of tests left in lnt.tests.__init__.py
- Avoid some duplication ...

9cc38f674eef90059be96d55546d2b5fe6309cfa authored over 7 years ago by Matthias Braun <[email protected]>
lnttool: Import things lazily

Import most python modules (except for some used by pretty much all
actions) lazily inside the a...

9ff66df11fe8e866952de765aa87aef7085c81a7 authored over 7 years ago by Matthias Braun <[email protected]>
Fix `lnt showtests`; Rework lnt.tests.__init__

- The command broke in r306534. Add a unittest so this doesn't happen
again.
- Rewrite lnt.tes...

c16a6f9c773c59e7eb19cb421fbe6810d6b38517 authored over 7 years ago by Matthias Braun <[email protected]>
lnt/server/reporting: Fix pep8 warnings

llvm-svn: 307724

5d1a4be86844bbd16f257b84e2e6d3a0c6157f85 authored over 7 years ago by Matthias Braun <[email protected]>
lnt/server/db: Fix pep8 warnings

llvm-svn: 307721

dcdd32b7e831b71b54f3f3bdd602fbfa19122b33 authored over 7 years ago by Matthias Braun <[email protected]>
Cleanup logging code

- Fix some code setting up loggers for "lnt" even though all our logs
go to "lnt.server.ui.app...

ef0179fc409084de6ac26303b40ac5e71c220097 authored over 7 years ago by Matthias Braun <[email protected]>
lnttool: Fix pep8 warnings

llvm-svn: 307710

384362a25c363cee62abc3b52b1361f55a263218 authored over 7 years ago by Matthias Braun <[email protected]>
Get json encoder from flask

Flask seems to be switching between simplejson and json. Instead of
duplicating this magic in LN...

cb4f922753d8ef2338af6d63772c7c518f9add87 authored over 7 years ago by Matthias Braun <[email protected]>
Remove odd if

llvm-svn: 307707

539ea7fa7a7c3189c79306bae635a4530c79df2e authored over 7 years ago by Matthias Braun <[email protected]>
Silence warning message about new_suite.py in migration dir

llvm-svn: 307708

d959e1ee364a2a2f3a24dd907cecc27f45d078a5 authored over 7 years ago by Matthias Braun <[email protected]>
Use simplejson when we have it

Some people use simplejson, and when they do, Flask uses it
automatically. We need to do that a...

6ca318108c10806be585278a32e0d0d6813e9ccc authored over 7 years ago by Chris Matthews <[email protected]>
Fix unexpected keyword argument 'iterable_as_array'

llvm-svn: 307674

92806869ff21d68785b8d5e2241382ac56b4220d authored over 7 years ago by Chris Matthews <[email protected]>
Revert "Use yaml schema mechanism to describe compile suite"

This reverts commit 59f86a68f08ec22040cdca17116ee549aa927579.

Broke the server.

llvm-svn: 307570

3e60c8105edebe7523cc87eb06912e0fdc8102c3 authored over 7 years ago by Chris Matthews <[email protected]>
Use yaml schema mechanism to describe compile suite

This converts the existing compile suite schema which was previously
configured via the TestSuit...

befeecf005f2d841a28d6520597a6845f49f99f4 authored over 7 years ago by Matthias Braun <[email protected]>
Make LNT client print server's error messages

The LNT client just prints error codes. In the case of server 500 errors
this is annoying when t...

1ec3879c68f6b5975c6149edce63a64c2cb01a6d authored over 7 years ago by Chris Matthews <[email protected]>
db: rename check_json_schema_changes -> check_schema_changes; NFC

Schemas are defines in yaml now, 'json' as part of the method name was
confusing.

llvm-svn: 307416

8fc060328a1f63b3ccb4e4db446f633996805856 authored over 7 years ago by Matthias Braun <[email protected]>
Move some v4db methds down to TestSuiteDB

This moves getNum{Machines|Runs|Samples|Tests}() and
importDataFromDict() from v4db into TestSui...

48f01a08acdf072f4bd1114329ca099fa9f00698 authored over 7 years ago by Matthias Braun <[email protected]>
lnt/test/__init__: Fix pep8 warnings

llvm-svn: 307337

36191d0a05537cf9634601cdc3877e26d21c00e2 authored over 7 years ago by Matthias Braun <[email protected]>
Avoid name/hostname clash when upgrading old compile submission

llvm-svn: 307336

da9848e824d01364f36f1046b8262adb25827d19 authored over 7 years ago by Matthias Braun <[email protected]>
Fix another bug when upgrading custom schemas from old format versions

llvm-svn: 307327

81995b250b1a3549201d8812b0ff00df0d5a46a3 authored over 7 years ago by Matthias Braun <[email protected]>
Remove unused detectCPUs function

It wasn't used, also we use python 2.7 now so we have
multiprocessing.cpu_count().

llvm-svn: 30...

b65c6b32023a816dee4758d663aa8c2b5c404b82 authored over 7 years ago by Matthias Braun <[email protected]>
Remove empty file

llvm-svn: 307323

8f6b59430b331255aef56ab13eeca57fd82f2f69 authored over 7 years ago by Matthias Braun <[email protected]>