Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/QubesOS/openqa-tests-qubesos

OpenQA tests for QubesOS
https://github.com/QubesOS/openqa-tests-qubesos

Improve updating Debian

Handle buster testing->stable update

9059e985540f8488ea47e8b2ad7137da67c0e04e authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
qubesteststub: fix setting default qrexec_timeout

Reset _default_function, otherwise it takes precedence over _default.

101b63cada399b196c4c559b601640e0abafb4d8 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Merge remote-tracking branch 'origin/pr/2'

e51ed8f9b7a6b40fb2556a935df7d9bf32d82477 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Fixed Default Kernel not being restored to a sane value

f76b725a92cf732a58f881be90826806d4e58a00 authored over 5 years ago by Marta Marczykowska-Górecka <[email protected]>
needles: Qubes R4.1, Whonix 15

eefe11d59164a4eace20670b101fdbbdaef1c53e authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Handle changed firstboot order in R4.1

In R4.1, firstboot apply configuration after clicking "done", not just after
exiting from qubes ...

3b52ee257cce5aebf6bb96d6a862eba0ee233c21 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Some more increase timeouts, don't use killall

- killall isn't installed by default, use pkill.
- increase timeouts for system boot and test pr...

28339b32703f080dcfd17fa94e2c0f6b2149fee0 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Increase system tests timeout to allow more templates testing

It's possible to request more templates with UPDATE_TEMPLATES option. Increase timeouts which we...

de64ef9be4ce999387f3f6a522e4700d60e02e9a authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Include qubes-manager tests

5e4fc5f3df6dcb6f18fb21b5bc8d0ef2bae812a2 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Adjust for assert_and_click API change

See os-autoinst/os-autoinst#1075

c5fe34999db08e90e6cd7fa495227a942a223ea6 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
updated needles for qubesmanager

db068203e191aa987737868b97cfaa1de30053b5 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
needles for grub2-efi

93fdac773527ca2f5ee31a0f10dec9a6dd30f129 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
needles for R4.1 installaion tests

fc7691db204393f71eabf8cf9fc1c71cbd9bfa57 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Be more flexible about USB tablet emulated by QEMU

Updated QEMU reports different serial number (it isn't 42 anymore). Accept any
serial number.

1c9b0734f80991342960eb34c9ef17d5fb9f528c authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Test for failed service(s) startup

Generic test to detect if any startup service failed.

0424d0f4f62ee547eb054db53c31907bdc3709f3 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Mark text LUKS passphrase prompt as soft failure

It should be graphical.

8b79b6bb6be77b6f2c1e14a4d622978250a8af33 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Reset keyboard layout in non-US installation

Danish installaion defauls to different keyboard layout. Instead of adjusting
all the tests, res...

acd13f6fcd8d9c72fa96220c15c2ddfbef72e963 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Handle grub2-efi

QubesOS/qubes-issues#4902

a68e773ffb3150f887f665e0573d67684f3a1e2f authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
system-tests: add option to test selected templates only

8701aa90888bbd91cacb9020e4d5d4e802a6bacd authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Improve handling slow system...

82c5fb597978c21237e6590ad383cd274eb00b1e authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix checking mount and boot options

In perl it's 'ne', not '!='. And in some cases logic was reversed.

354cf373b85f28fabf673eb66edfd0e2446712c5 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Include salt minion log when something fails

This is useful for analyzing firstboot failures.

0bea226826c6d899fad87c9ca43e8c387a672203 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
system-tests/update: disable updates check for the installation time

On Debian, update check takes the dpkg lock and prevent other instance from
installing updates -...

70155b362840174c89b85830e3e8fce5aa180e4f authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
system-tests/update: remove jessie-backports and Whonix onion

jessie-backports is gone and shouldn't be in Debian stretch at all.
Whonix onion repositories ar...

7449a6db65ff693a95fbac0f761be6f101af9056 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
system-tests: log 'error' as 'failure'

OpenQA UI displays 'error' same as 'skip', so it's easy to miss. Lets report it
as a failure.

63e0ab17a596389423e19f355c7ed58f42276b2d authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Include GUI tests in templates

42147ce494153abee273ae27ee4316a14a3685d4 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Add yet another needle for vm settings

44ad837ee5a97f0565d41b11d55b4fb88d94e0b0 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Merge remote-tracking branch 'origin/pr/1'

* origin/pr/1:
Fixed whitespace and indents
Mechanism for running all gui tests in main.pm a...

b84f6aad3b960cd9bb9419009da036f26d07a9e9 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Fixed whitespace and indents

b1907b2a4eeb3a9f120cc5c6fb588f2e85fb9fae authored over 5 years ago by Marta Marczykowska-Górecka <[email protected]>
Mechanism for running all gui tests in main.pm and minor fixes to startup_fixup

1f1b52ea8c4bdd6d0fcbe10968c2c16050e9dd20 authored over 5 years ago by marmarta <[email protected]>
Cancel any qrexec confirmations left after system tests

Some tests, especially for split gpg may trigger a qrexec call that isn't
automatically accepted...

3f12cf558dc8f66aaa59317a23e5d784ec9f1a18 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Make whonix firstrun handling more reliable

Since mouse works, it's possible to actually click on the wizard, not just
blindly control it fr...

b2aff8d3089d4a8c358c4efb37c99cad4ef2c0c7 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Enable mouse usage in tests

Enable input proxy for USB tablet. This is a bit hacky, because QEMU emulated
tablet is specific...

294af50f3a8a877e588eb438241c623794753003 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Do not create snapshot after just 'startup' or 'startup_fixup' phase

At this stage, the system isn't good enough to rollback to it and successfully
execute other tests.

d942c889f75c668b57877202c61e42cedcbfb8d8 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Increase timeout for qubes.tests.extra

Apparently 4h is not enough anymore :(

19a5e467f399084d9b394f283194d7c17251c367 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Do not upload empty 'system-err' field from system tests logs

38481ba4f428f746caa7b5aaae62e3868854e7de authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Installer needles

14617e24dc53cfdbecd245ad8b5f15509da3e23a authored over 5 years ago by marmarta <[email protected]>
Tests for qubesmanager.settings

8c9f450b338313b9190d0e6c86b88ffaa92c35fc authored over 5 years ago by marmarta <[email protected]>
Tests for qubesmanager.create_new_vm

bdffcb4c2b23422790d6c152fb3b80ce4c31d0c4 authored over 5 years ago by marmarta <[email protected]>
Tests for desktop-linux-manager.qui package notifications

f3d3314f1709ec878e146270622418e91fb44359 authored over 5 years ago by marmarta <[email protected]>
Tests for desktop-linux-manager.qui.tray.updates and desktop-linux-manager.qui.updater

033ea270f4e693a33e0d771c4d15823df98d793c authored over 5 years ago by marmarta <[email protected]>
Tests for desktop-linux-manager.qui.tray.domains

22ebd3066f1a1c71fbc5de2587772d335578851e authored over 5 years ago by marmarta <[email protected]>
Tests for desktop-linux-manager.qui.tray.clipboard

7af26aff963a51ea24ec8eb28ed359dff8ae7826 authored over 5 years ago by marmarta <[email protected]>
Tests for desktop-linux-manager.qui.tray.devices

c5b9558f84b77dded78b8c3608bd6819ab1b6f10 authored over 5 years ago by marmarta <[email protected]>
A set of fixes needed for qubesmanager and desktop-linux-manager to work

92aad3a18b5e24ca0778af092d7bd7bb73f8785c authored over 5 years ago by marmarta <[email protected]>
Tests for desktop-linux-manager.qui.tray.disk_space

174c5b5410234b2137e221fad63cb14802dfa534 authored over 5 years ago by marmarta <[email protected]>
Tests for qubesmanager.template_manager

36308cc322fbee9f5b7d52605513ce9dc598171a authored over 5 years ago by marmarta <[email protected]>
Tests for qubesmanager.backup and qubesmanager.restore

5a5274e9ac41a1389390fc48adbffb61e967f4e9 authored over 5 years ago by marmarta <[email protected]>
Tests for qubesmanager.qube_manager

b6a69d9254e2ac74678d047dd3913f5ccbfbfd66 authored over 5 years ago by marmarta <[email protected]>
Tests for qubesmanager.global_settings

06212812762c5a06def3767ad8742e0d79cd1063 authored over 5 years ago by marmarta <[email protected]>
Properly wait for NM "Connection Established" message

Do not simply assume a timeout, properly wait for it (and fail if it isn't
detected). Otherwise ...

f280cbbe710ebf45e3b11f565d60e4cf69888474 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Extend README

4df169d53d1175935e2553a62925ea9d8f398c91 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Exit early if curl-wrapper.sh fails to download

It's used only late in the process (especially update tests), so better fail
the test early if i...

179a3f5eec2d46921547009888397b3f0f6bd63f authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Upload /var/log archive even if some files were changed in the meantime

tar will exit with non-zero status if any file change during the process. But
upload the archive...

9a8b51c6804fc1f2f61ca26e7b883dfe75c88682 authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Include Whonix proposed-updates packages in tests

76e7933c9b47cf308b012283b1e2d36dc2dcd24b authored over 5 years ago by Marek Marczykowski-Górecki <[email protected]>
Call whonixcheck with LC_ALL=C

Otherwise if vrms complains about locale, whonixcheck treat this as non-free
packages are present.

3e604b521eb4d4e1b8ff40ad9e278d63d9a3baa3 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix collecting packages list

a76b260359eb28f906a922500395a1c14c264b05 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Increase timeout for vm_qrexec_gui

4600fa4134b63477f0aa1ef4bfdf2fbdfeda2df3 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Use private hdd asset instead of public one

There is no point in publishing intermediate hdd images. This will help
automatically cleanup ol...

83f7345e03e23ba1d328a3c65e7595b38a349352 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Rearrage tests to run whonixcheck as a separate job

Do not fail "update" test (on which depends all the other system tests) if
whonixcheck fails.
Th...

ef7e87deb7af33d282f0f560c46f1a96851438fc authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Workaround salt bug about enabling apt repositories

pkgrepo.managed fails to enable apt repository, if it's already there but
commented out. This ap...

78b6d33bfa38851377c4f8108e25c93d46bd42fe authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Mute whonixcheck warning about python-pip package installed

python-pip is installed for system tests.

0307d5937090211995397e5cd5cc3b331696754f authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Send curl wrapper through a file, not type it

This function is too long to reliably type it over VNC.

9e9a1642c56e0c1a14c11c7903fb9a11a0340897 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Add whonixcheck test

433b562d7d2cc51b6c0c2bb82205badb95c436e9 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Mark whonix_firstrun as milestone step

Save the system state after initial whonix configuration.

b9a607116f53783367f8d8aadc4b9e2e29779b88 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Add support for updating whole templates, log packages versions

58d02d436f0794b02ea761a44b52bcd849865942 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Make packages update separate from installing test-related packages

When testing freshly build templates, it would be better to _not_ update
anything, to test what ...

78d3c9fe5d65aecc2409f688b5a695b8cd701bed authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Move post-firstrun fixes into separate module

Do not require update.pm to be loaded for them.
Especially make them run before whonix firstrun ...

c1f27949ca821dcdf2df3fdba55cb2dac16fdf51 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Few more needles

961a98a9b0702318031b3fdfdae97b463b80b310 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Workaround for unreliable network backend when running in nested virt

Sometimes network backend miss notification about new device, which cause
toolstack timeout to s...

e11ddc55c761a0e717814311a961bab9cc7c6e13 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Increase timeouts

Make tests fail on timeouts only when really something hangs, not when it's
just slow.

a729881fadfe3a90411dfccfd0fc3cd7ffa0fa4d authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Follow pvgrub -> grub test module rename

qubes.tests.integ.pvgrub -> qubes.tests.integ.grub

But keep the old task name, to correlate tes...

07be3e5c73e4836567e96876f5492aa314f72d3c authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Avoid duplicated tests before and after update

Run tests/mount_and_boot_options.pm and tests/usbvm.pm only after rebooting
after update. Which ...

c4886a266892c35576394e6e4d0eb5d3822b0758 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Install additional packages for tests

git and python3-cairo are required to install and run dogtail (used for
splitgpg tests).

db14a4d684d97eaaa3136934906bf29a5d638b40 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Exclude /var/log/journal when collecting logs

This directory will surely change while making the tarball, which will prevent
uploading it.

1732b8cad9a8723b92cc75ded8265c29b8755fe1 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix repo definition cleanup order

After an update, remove temporary repository, but make sure it is the last
step.

70d00ebeea87b0a5d3e99d86be451d5f8873994a authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Make libvirt verbose output configurable with VERBOSE_LIBVIRT variable

534f5d5b75739f844b664bb910fcc93a9b218d7a authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
system-tests: Increase timeout for qubes-dom0-update

d4c366e830c98c2ada98b9c31690876664c0cdbb authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Drop workaround for QubesOS/qubes-issues#3655

It's in stable for some time already

0b0f0667b7823ca775cd81cac487433cad85f4ff authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
system-tests: install createrepo_c on fc29

67b76f48bfc2a4a4beb5c9851d957068fdae0c61 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Improve log collection even further

Print VM's logs to console, with dom0 timestamp added, to collect them later.

Also adjust log l...

ba829e07c55b178bf0116ed96148cef28f828c63 authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Improve /boot size check test

Fix free space getting and make sure the test finishes until getting to the next module.

d206349b02a62f6207759a4322a7ebab15665c2f authored almost 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Improve whonix firstrun wizard handling

3e676dcfab336484c723c743dcebb9c61be01d63 authored about 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Check for /boot and /boot/efi partitio size

QubesOS/qubes-issues#3224

8e400df08f14efe968e7d407c8c1ead7cc651449 authored about 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Install updates as a separate step for systemt tests

Install updates only once, save the disk image and use it for actual tests.
This is more effecti...

bba53f3ac18f0bfc55a31bcd81f3ea105664f3f9 authored about 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Extend update before tests

- Provide onion service for whonix.
- Disable update repo after using - will not be available wh...

e3ebc0ef34c464aa74dc798ef605ad403c09248e authored about 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Improve log collection

Log output from VMs journal to console (which is archived in dom0).
Log more details from libvir...

799df0248857ef0b6553c7c6560947b764655fb0 authored about 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Try hard to give (back) focus to xterm window after system tests

There may be some leftovers from failed tests, which could prevent uploading
logs and other resu...

1f46a7dbd56ae63026f0e4773d3a81277ccb8a05 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Add templates for system tests and group them separately

Also, upload uefi installed system. But don't use it yet for tests.

8002414f22b07dfa812ad61f5624a177b01f4f11 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Reload salt after installing python-apt in Debian templates

6c149a6faf1a9cea2e96aa11adcd4a63224f2d5a authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Salt formula for packages useful during system tests

a6a822959de4ddd68247a6399594b63ced791b80 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Some more logging to serial console, until network is up

When trying to collect logs, it may fail to enable networking. Log enough
information to serial ...

43c12e9727620a215f49c879f5c1423b454b1053 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
needles

276ef1ac9b8da6e6eef2f5b19de32ab11d531ef1 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Adjust firstrun handling for Whonix 14

bbe316f428c49225925b1f8f8d0d87ac587f1124 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Misc fixes for tests-specific workarounds

- make initial extra-files tarball as small as possible, otherwise typing it fails
- fix core2 p...

d126061441dee422c55039029b0701191d80f683 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Check if smt=off was added to Xen cmdline

Reported by @rustybird in https://github.com/QubesOS/qubes-vmm-xen/pull/45#issuecomment-419654082

397575639e2e097955c1064b11861d4601217ec2 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Run system tests

Since Qubes OS tests are (finally) compatible with nose2 runner, so it can be
used here and nice...

8f4ec6f7c1abfa533d00be9d287a7c14bbeae921 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Add xen_scrub_pages=0 to workaround slow nested EPT

And install kernel-latest-qubes-vm, the option is only there.
Note that this applies only to tes...

b2a2cde94a21c854a10170acff530cb19fb87e15 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Adjust test templates

ae7668b05db5af6bf93d06f32b9f616e8b2ca2b2 authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>
Fix detecting shell prompt

Don't match user name repeated by getty.

ffb9ef333433de7ddeecd4b8de9d8c53613da98b authored over 6 years ago by Marek Marczykowski-Górecki <[email protected]>