Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/QubesOS/openqa-tests-qubesos

OpenQA tests for QubesOS
https://github.com/QubesOS/openqa-tests-qubesos

utils: fix handling not enough similar jobs

There could be no similar jobs (yet) when checking instability. Avoid
IndexError on jobs[0] in g...

5cdea0c433d6910666659c1005cbc5d73cf1d436 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix too-fast backup test on real hw

Backup of just sys-net is too quick for cancelling it. Add creating bigger
backup for this purpo...

eb70cceef66bb4613f436192bc684be353058fa8 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
split_logs: fix getting dom0's timezone

Get it directly, instead of comparing timestamps in different logs.

2ebe08729b5ac8217d5a75cd7fd29de4f484197c authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
utils: add get_jobs_ids_for_build()

Allow collecting jobs for a given build, instead of just children of given
system_tests_update j...

b3fb3cebee2a6d4586cd5f73f78180f02d91f932 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
utils: add JobData.get_build_url()

Get an url to the overview of all jobs for the given build.

d4f81ccbce389df9488e987d0c662f606ac36220 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
utils: Move get_labels_from_results to github_api

It is rather github-related function, not a property of a _single_ openqa job

6195824be6448ef23f49c5a9362b0865ae8b3936 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Add needles for no-sys-usb setup

d392531f75352b3f0ba8f556ec6fa1fd96cde9c4 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Remove needles that didn't matched for the last 2 years

This is mostly cleanup of 3.2 needles.
This makes searching for a needle faster, especially when...

08f4746a672bebdfea69728f53c9bca86e9003c8 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
generalhw: Increase timeouts with check_screen

5s sometimes is not enough...

2a68e00a2d46c4fb8b511cfb31cf8f77fefe265a authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Merge remote-tracking branch 'origin/hw' into hw

177e55b3973acb297ccb0c9c6a6b9fd724e5c12f authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Needles update

e5d5ed98538f7e4078c9bc0da3b47d47371576d5 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Add few more packages->repo mapping entries

dac464a73fdc0ed5b3e4ae15b2818f5ee55099ce authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Make split_logs work on R4.0 too

There is no datetime.datetime.fromisoformat() in Python 3.5.

7c0f4a4b9bc39317c8eabd116c4bcbf8975c4bdd authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
wait for firefox to fully start

e1abda2888b42e15082a2b7827281dc71d2a4b2f authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Move startup_fixup completely to the base installedtest class

This allows easily calling it after restarting SUT, without hacky re-scheduling
the same test mo...

129097f61a74752c28aa7e38dfb6d60f0ddcf15b authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Do not restart sys-net after update

The important part is to restart sys-firewall and sys-whonix, since they
have more interaction w...

690df91928cce795c187453fd23a9fea50172337 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
suspend: wakeup using a power button, don't fail on missing sys-usb

Adjust the test to work with generalhw backend.

b288e1669f6f0eb8fff0ca6347a89f480694d7db authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Add needles for tests on physical machine

ec73c42bc991a2dc8164e1c2b2a9b90793be2a72 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Save screenshot 1 sec after failure

Take also a screenshot after a delay, in case the screen wasn't updated
instantly (generalhw bac...

930ff07666914b2ecf538e5be2ea821acef88585 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Handle tests on physical machines

Adjust tests for running with 'generalhw' backend too - it requires few
tweaks only relevant for...

fe77adca302341fec77874b5f4a2622414d8fe10 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Add testing with Heads installed

ac3b03f569695eebcf5f9e5d9205a09b96f50ff7 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Do not override explicit SERIALDEV

91dfa90942ce89dc2aae5636beb494c6be0c7fd6 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix login prompt regex

Do not match "login: timeout" or similar strings.

00a4b7acb42135053c2637db4695a81c330c30d5 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Handle whonix wizard just after installation

Don't wait for the first startup after install (in all subsequent
tests).

e666f74cddd49f94ebabdfec39c820d1175d41cc authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Adjust waiting for still screen

43ac2d026f7f34a7e222a1fcc861065688132ed7 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
make path concatenation more resilient

4c2f4995ed187790c3cc412ef5bf2574a0419ada authored almost 3 years ago by deeplow <[email protected]>
split_logs: handle exception where timestamp is 0

952f5ad9d07ee28791e01f0b99ae0dd8576458ea authored almost 3 years ago by deeplow <[email protected]>
split_logs: add time normalization

Logs would not be correctly split since the dom0 journalctl would
be on the local timezone and t...

9d8983a000fcb55b20c2b9c75fb54f76afb9c983 authored almost 3 years ago by deeplow <[email protected]>
fix uploading of per-test logs

It was uploading from a relative path and not the absolute one.
The logs were located in /tmp an...

53d27defe5416b298d3fcf150bdbf5926201633b authored almost 3 years ago by deeplow <[email protected]>
mkdir idempotently

d59a043a894ed989db5ae326b7c835f82b8429bc authored almost 3 years ago by deeplow <[email protected]>
don't analyse logs for passed/skipped tests

54fd35fe2bd48f9fa4fe9aeb170203c4fc2c63aa authored almost 3 years ago by deeplow <[email protected]>
circumvent nose2 malformed xml

Nose2's junitxml plugin creates malformed xml since it has multiple
<testsuite> roots.

18b7ecc6aebd6bb068efa8c3c888b17d388d0403 authored almost 3 years ago by deeplow <[email protected]>
fix syntax error

e45250309b52c4455d9b4ba18cc58b871f93e413 authored almost 3 years ago by deeplow <[email protected]>
copy split_logs.py to home dir

31ad7c6803a37d902650cbf5026f1b4c0dfd5deb authored almost 3 years ago by deeplow <[email protected]>
fix per-test log upload

Per Marek's review, the machine running openQA != machine running
the tests.

6069d417ef1cdd0a834fb0f941516d8bd0123ee4 authored almost 3 years ago by deeplow <[email protected]>
fix variable assignment syntax

55957a4f47b70065d63843bb10743a77021989f9 authored almost 3 years ago by deeplow <[email protected]>
uploads per-test xen console logs

Logs are obtained by filtering log files based on the start and
end time of each test.

8ce7173ca7433aee9976b400c71c15d8298be5b2 authored almost 3 years ago by deeplow <[email protected]>
Merge remote-tracking branch 'origin/pr/16'

* origin/pr/16:
nose2 junitxml: prevent avoid exception of no timestamp
fix timestamp not ge...

c19063a5127624274dabc03ab565b1e853a11540 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Enable instability reports in automatic comments

bba6dbee6afae7e15ff1ea96504af38ec400fda4 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Merge remote-tracking branch 'origin/pr/15'

* origin/pr/15: (65 commits)
add missing import
improve help text for --db-path argument
a...

77d4c3f09a0444bbf8f07ad26e86df46855a9395 authored almost 3 years ago by Marek Marczykowski-Górecki <[email protected]>
add missing import

c4bf759e089f4a4bdbf6fa30940fce2d1d74da44 authored almost 3 years ago by deeplow <[email protected]>
nose2 junitxml: prevent avoid exception of no timestamp

As pointed out in https://github.com/QubesOS/openqa-tests-qubesos/pull/16#issuecomment-999162166...

6e906c0c8694eb90a974a7672c5cb50978c1a189 authored almost 3 years ago by deeplow <[email protected]>
improve help text for --db-path argument

d3c8099ec37b999cc15a33c104a9dc774be70cc2 authored almost 3 years ago by deeplow <[email protected]>
add db_path as param / env. var.

6c59994fc739d8be9a520780b171f175724a8e06 authored almost 3 years ago by deeplow <[email protected]>
fix timestamp not getting included in message

f0d5d35c669dbd39bf380db92e28bdbfc88f192e authored about 3 years ago by deeplow <[email protected]>
fix nose2 timestamp patch not applying

the previous patch had been made for the master branch and was not
applying in the python3-nose2...

8c0de9bc94d8b47c828ae6de5fdbc8fbebaba917 authored about 3 years ago by deeplow <[email protected]>
simplify and fix --last argument

Per Marek's review the history_len_with_margin was not defined if
not args.last.

a14c3280403f731939fcf5787894eef5f45a2278 authored about 3 years ago by deeplow <[email protected]>
openqa_investigator: package mapping path relative

0711c1237bf831efa67e9414d628ed44a0fd1c1d authored about 3 years ago by deeplow <[email protected]>
fix similar job getting logic

Fixes two bugs per Marek's feedback:
- get_n_jobs_like() should look for the job closest _but_...

d8c90ede16d076c5cb863847c86a1dfd691d2eb6 authored about 3 years ago by deeplow <[email protected]>
Update needles

efe799639f29ef96726e214e7375df4a890ce680 authored about 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix setting qubes_ver pillar

4.1 needs to be a string, not float.

3ef6a192e69f255a1766e55d471a35e1b17b19e2 authored about 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix closing evince, better detect when it's closed

Look for the whole desktop empty, not just a piece of it. Same for qubes manager.

d6336bce4abe3cefc8a0a2dd1533fe1ff8786442 authored about 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Sync x11_start_program with opensuse's version

01da1babc4944a9b04e7c6a2a79fac0ebee4fe67 authored about 3 years ago by Marek Marczykowski-Górecki <[email protected]>
update: set date +5min on Whonix before any apt-get update call

660c3748abb5127cddcf2aa683e4ad917cbcc30f authored about 3 years ago by Marek Marczykowski-Górecki <[email protected]>
Add more examples to README

460355af864beb7f824200d77e26c639606b4d68 authored about 3 years ago by Marek Marczykowski-Górecki <[email protected]>
fix get_n_jobs_like()

7829f48308e5f2a75f75a8b31625a41131e0af6c authored about 3 years ago by deeplow <[email protected]>
improve color palettes for 'un-hued' plots

37758880e5382ce05204a96cd5d69c91b6e3753b authored about 3 years ago by deeplow <[email protected]>
fix simple plotting by replacing it with strip plots

214866f44d6ef315661510c31f0380689b7a7c0f authored about 3 years ago by deeplow <[email protected]>
Check for empty screen after exiting screensaver

Sometimes application finder remains open, if the command was mistyped. Detect
this earlier.

cfa78243cd599bc2322fa4526deaca1883d5af09 authored about 3 years ago by Marek Marczykowski-Górecki <[email protected]>
add timestamp to fail message

In order to improve the ease of finding the correct video segment
and appropriate location for e...

d74cae6333c7f8f05e0ad9866ecb16555be6ff8e authored about 3 years ago by deeplow <[email protected]>
utils: determine instability based on the updates branch

Per Marek's request the instability is to be determined from the
updates branch. This will ensur...

2b33e78272807ad603e85474d5fc7a4b0f37084e authored about 3 years ago by deeplow <[email protected]>
openqa_investigator: add verbose flag

a6cd3cfb437b6ce583041fd05b07680713155c29 authored about 3 years ago by deeplow <[email protected]>
openqa_investigator: early "no jobs" detection

f95b95e822459a9a8414accc4f1a4923e8076e3e authored about 3 years ago by deeplow <[email protected]>
utils: add version and flavor to openqa_investigator

ac4cf3640bc652a4416460600b968fd1792d2bde authored about 3 years ago by deeplow <[email protected]>
utils: don't make plot if there is no data

b57824885bfa5c46aa2c581ff7140e239122c696 authored about 3 years ago by deeplow <[email protected]>
utils: remove dead code from "read-only" db access

3085c734f57a94cf3a060be2026c40f6e8a2749a authored about 3 years ago by deeplow <[email protected]>
utils: github_reporting add verbose flag to log

811d04729db7f6f5cdd72db147bb032fe3b11cf4 authored about 3 years ago by deeplow <[email protected]>
utils: move children job creation to orphan jobs

Since there is only one level of job nesting (orphan jobs have
child jobs) there is no need to c...

4797c9e32890e868cae1429c76141f30c6fbbee7 authored about 3 years ago by deeplow <[email protected]>
utils disable verbose db logs

bc5e9c62850d055bde046497b2537f5549513c58 authored about 3 years ago by deeplow <[email protected]>
utils: remove template not in test name warning

The warning is not necessary since it can be safely assumed that
when an integration test's name...

6346d2b688bfbc229d8b7023175ee74c25efa119 authored about 3 years ago by deeplow <[email protected]>
utils: remove db "read-only" mode

It was initially created to add the ability for openqa_investigator
to avoid having side-effects...

517eb0d88b4a30f95e1903d714cdb48d43d2eb1c authored about 3 years ago by deeplow <[email protected]>
utils: reduce verbosity in stability feedback

24ae385db88a09c1d6c793ff0dfec57672dac76f authored about 3 years ago by deeplow <[email protected]>
utils: fix: get_n_jobs_like return in right order

ad3366a05a28072b50cbc6b958671c92650d4b46 authored about 3 years ago by deeplow <[email protected]>
utils: bugfix: pre-populate database added

Due to a wrong method call when running instability_analysis only
the job_ids were being obtaine...

7aad27a42808344b1b14915447ab06bccd6dfe1f authored about 3 years ago by deeplow <[email protected]>
utils: bugfix: add missing condition instability detector

The instability detector method for tests was missing a critial
criteria: being unstable when no...

74360f22335bdd8f544a5e19ba298476ac1b0197 authored about 3 years ago by deeplow <[email protected]>
utils: add "MACHINE" property to JobData

This MACHINE allows us to identify the machine type (UEFI, 64bit,
etc.). With the future of use ...

d1cfc5ddb751aa94b0b9dccc8d291b134966fd92 authored about 3 years ago by deeplow <[email protected]>
utils: save job_details in DB replacing requests cache

Also removes a problem with the requests_cache where it was caching
also requests for new jobs. ...

9ca69f9aae3f4f869ad804b413eadb4897412b98 authored about 3 years ago by deeplow <[email protected]>
utils: bugfix double instantiation in commit 63445

The commit 63445c6f was supposed to fix the double object creation
but instead it agravated the ...

b97534bf18a42615ed52854f8b850d0d9990e6e7 authored about 3 years ago by deeplow <[email protected]>
utils: generalize test stability analysis

- now adds "[unstable]" when reporting on failed/fixed tests
- created classes for storing insta...

805d64c38e5a5b4ca5b388517983e82d8656c3a1 authored about 3 years ago by deeplow <[email protected]>
utils: make plot_tests shows as a strip plot

This way it presents more information

5ed7c1f0846f92ffb9d2ce9f6897c13e23a003ed authored about 3 years ago by deeplow <[email protected]>
utils: bugfix make plots show correct order

The plotting of tests was in the wrong order (the time should flow
from left to right.

71a345a1089aa258db5f05fb54944fe25834cb73 authored about 3 years ago by deeplow <[email protected]>
utils: first iteration of stability analysis reporting

5de89cd16a8d4f33e0e304c6ff2872832bf9f415 authored about 3 years ago by deeplow <[email protected]>
utils: add job retrieval for previous similar jobs

eea6096fb4c641b38546e0e4cc87932b37000f7e authored about 3 years ago by deeplow <[email protected]>
utils: bugfix add history limit to investigator

The openqa_investigatory was querying the database for all the
available tests without honoring ...

454b8474bc195ffdd49774b9a4e0df64e28951fe authored about 3 years ago by deeplow <[email protected]>
utils: change /add job fetching methods

Adds ability to fetch similar jobs

1f1304e2ca4e13f2dfeaaa49ee40c5515c469413 authored about 3 years ago by deeplow <[email protected]>
utils: move stability analysis code into new file

277c0bcf5760ccb31b3d150c7988d15c2acbd6e9 authored about 3 years ago by deeplow <[email protected]>
openqa_analyser: re-add support for "error" filtering

a90da1b1b8600f8547a279a94ecf0791c6417154 authored about 3 years ago by deeplow <[email protected]>
utils: add missing get_job_worker() function

6f349bc5ac1383b74e73580939a2ed766630601e authored about 3 years ago by deeplow <[email protected]>
utils: assume default template when test name not descriptive

22d07ce4b1807bf128192b9a6f7949ee0e8797f3 authored about 3 years ago by deeplow <[email protected]>
openqa_investigator: cleanup dead code

2f08fd6d7cd4fee292be2e3e8d1b0627368c6708 authored about 3 years ago by deeplow <[email protected]>
utils: re-add worker plotting (improved)

9431cd592fb1f8e57e9cff3c1ca20ac49bfb6abc authored about 3 years ago by deeplow <[email protected]>
utils: re-add main plotting methods

2baedf3f361a096dee4fa499798aee0041b61c4b authored about 3 years ago by deeplow <[email protected]>
utils: investigator: add redo report gen suport

bada745160396227248a10d1b799a42410da889e authored about 3 years ago by deeplow <[email protected]>
utils: refactor openqa_investigator work again

The addition of a local database of tests failure had the
intentional side-effect of breaking op...

6b52d433e02d63cfbe5be0b3cc8da850a700bce8 authored about 3 years ago by deeplow <[email protected]>
utils: add ability to use db session in other files

We have to use the same session in order to access the database
contents. Hence we're adding the...

f7d4a7d07ceb42c46d95d0758eb407d13034e289 authored about 3 years ago by deeplow <[email protected]>
utils: add job validity attribute

dae30724fb1a889c8920c71347b4e18725869e6f authored about 3 years ago by deeplow <[email protected]>
utils: avoid recusive db object creation

There was a recursion bug because we were trying to create the
children for a parent job and the...

63445c6fd8b23d8af80fffcb2093a03e73352ec7 authored about 3 years ago by deeplow <[email protected]>
utils: fix parameters type

0d863492d141b3cd34dcdbd19658febfc5feb6f8 authored about 3 years ago by deeplow <[email protected]>
utils: move is_valid() check to ChildJob

The test validity check only applied to child jobs. For parent
jobs it must be slighly different.

5b8a331ba7e0831dc2183e7d5bd5842f9763d91d authored about 3 years ago by deeplow <[email protected]>
utils: move format_results() out of openqa_api

format_results() is presentation stuff. As such it should stay in
github_reporting.py. It also d...

2b186541faa76594de89e0da9977ca3977c424c0 authored about 3 years ago by deeplow <[email protected]>