Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/buildtesters/buildtest

HPC System and Software Testing Framework
https://github.com/buildtesters/buildtest

adding Jenkins shell scripts to test software stack for Pfizer Durham

cluster eb-2018 stack. Also include script for listing unique software
and unique software versio...

07fcc987148634ecc9e1428b44ef0de22d485a93 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
bump version 0.6.1

9b1cfd8fded1f4539e793b5a9e6adc0f7e8928c7 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
bump version 0.6.1

d8e95b9e94b0bca65464df506e68dddd1c65ae02 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
incrementing version to 0.6.0

09652f69cab3018cbfd114cc6fc024814ab4d3a7 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
bump version to 0.6.0

5b4585e2ee93644074890ce9fece3e0a32eba522 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
add option to _buildtest run

--all-software, --all-package to run test for all software and system
packages

8a1113f2ee0dc426b6cc8428afa3545bf5ead2ae authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
update options for _buildtest build

--system is changed to --package, short option -p
--all-apps is changed to --all-software
--all-...

5f7d255fa08fbbb0ee5f603a9a032f22822d9390 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
rename option for _buildtest run

--app to --software
--systempkg to --package

87916482acda11343dde3f08c0f9c70ff5e929a6 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
change the following option

--app to --software
--systempkg to --package
-- all-software-yaml to --all-software
--all-system-...

93bc97773fe9b8eb15605af095125c1d3b9fb05d authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
adding binary test for remaining software packages using _buildtest yaml --all-software-yaml

a47e56746ec8f23df67232bc5a629be7cdc49352 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
options --rebuild and --overwrite can now work with options --all-software-yaml and --all-system-yaml to rebuild all yaml files.

8202283bd85d19f813e8383ce03e189295c5ed85 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
adding java 1.8.0_152 binary test file. Add description keyword

in the custom yaml files

da5cfd01430b975fdc05424de64c84f98bed6136 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
add option --rebuild, and --overwrite. If yaml file already exist, then buildtest will not do anything. --rebuild will recreate yaml file if file exist and name it as different file. --overwrite will rewrite the content to command.yaml. The option --ebyaml and --sysyaml are renamed to --app and --systempkg along with short options.

4d6e866d45107395e1eb7599be0db930aff27e91 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
crete subcommand "yaml". Move option --ebyaml, --sysyaml, --all-software-yaml, --all-system-yaml.

cd4ec88c056fd15e769e79465015f8c4f6f2ae67 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
count passed and failed test. Report summary of test statistics at end of each run

bbca390a38dc7265faa4429d2babbc54b2c189db authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
got source test working with yaml files. The source test are now in BUILDTEST_CONFIGS_REPO/buildtest/source/

21bec6b023825178a40659c86d10b11f63a3f3d8 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
rename method name

a4b11dd12e2b1ed80d324e0c274e2787f71324ce authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
Default behavior is to redirect output to /dev/null when --output is not specified. Implemented --output for option --systempkg and --testname.

4ce745bea505a83cd7e4aba0b18d5c9e0127f24c authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
add --output option in run subcommand. The _buildtest run -a option works with --output which will redirect output to /dev/stdout or /dev/null depending on value of --output option.

d0fb7d2abd60dcda3f454c0bc092567f1346c772 authored about 6 years ago by Shahzeb Siddiqui <[email protected]>
fix implementation for _buildtest build --all-apps. Automatically builds tests for all software packages. for _buildtest list -bs added print support with for json and stdout. CSV is not supported yet.

2436669ff0275a2391fa50b987f91e1239b7e65e authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding all system package binary test yaml configuration that

was generated using _buildtest --all-system-yaml

d38238a1df520a74af0996cf4cdf334f838613b0 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
complete implementation for --all-system-yaml. Using which instead of find when doing binary tests for system packages.

1c38f32c2485f8317ffaeb5acc1a9b35a9e0d9e4 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
deleting all system package tests, will recreate them automatically via

buildtest

71635712d80204c8fec21f56079e317b926f4744 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
add option --all-software-yaml to automate --ebyaml to build binary test for all software packages. Added option --buildtest-software in list subcommand to list software packages that can be tested by buildtest. Add options --all-apps to automate building software package for all apps.

a3cd5766dd6c747851444cf73229c37c3ff6f680 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
generating binary yaml configuration for all software packages automatically

using --all-software-yaml

79e2f1228b095bfb86af8e08d8ac8504c1178dbc authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
cleaning up some extra command.yaml files in source directory

1a36dd0e7a59cdb6efa979c28dd150e9d418b0bd authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
removing all ebapp command.yaml will generate them using --ebyaml

move buildtest custom yaml files for compilation examples to source directory
with each software ...

6dbf690b5f2d713d05566e2c28b97edf958ec5e5 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
add --all-systempkg option to build all system packages with a single command.

d759ac64d44a651513570350e7c937f289a55560 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
move -mns option to build subcommand

56ef5840f90128b7b1ec1ee87b942fa358a4d811 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
bug fix #80

16f9f849658d32341a2db0c43d6c70409b2c456f authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
bug fix #81

13c003e4275b1a78146101b5031d59860b2be69b authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
bumping version to 0.5.0

c6b8d72b63b39280fde619a826fedeaa77615a24 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
bump version to 0.5.0

update setup.py script
in check.sh automatically, build python wheel for all buildtest repos
and ...

837c63464e4c45022397d0b0aadb1e44c534c105 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding option and full implementation for _buildtest run --systempkg for running system package test suite

fc060c95d1d93eb3c205fb7e3093997babe07210 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
complete implementation of _buildtest run --app

choices are generated based on directories found in BUILDTEST_TESTDIR
for application. Runs all ...

6d18986a19f4dc4b0b61afe7c2e3443b4d9d8ef7 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
fix bug when application name is a toolchain module. No need to strip modulename, just

return as is. When software module in Flatnamingscheme has toolchain in module name then
we need ...

8dfe78bce930e23eb2242e4e4666f926bf60131f authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
creating subdirectory under buildtest/test/run to place python modules for _buildtest run

f6ab256ba0ffd8734eeaed6c4f8af241dd779519 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
rename options --runtest to --interactive (-i) and option --run is changed to --testname (-t)

8266b7f6d2c5ce1b7d172531d4b6f3de9a5ed9b4 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding run subcommand. Adding test directory for unittest

2ca983ba509a391dc908a37f3bdad9ec89b135c0 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
move option --enable-job and --job-template to build subcommand

4cdb50024e7c6101002a7578762703e30642c290 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
move option --ignore-easybuild to build subcommand

add method strip_toolchain_from_module
tested option for python, r, ruby,perl package and they work

e9a1d98356078d4e846d11e615e6e1330fcbaa42 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Needed to set "dest" field when adding subparser to avoid bug when attribute func was not found when passing buildtest options. Now regular option and subcommand option are working. "_buildtest list -ec" is now working. Fix an issue with --runtest when no test are found in systempkg directory by printing a message and redirect to same screen

82466bd63b85279c1b38bffe49e44276219f1dcc authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Move option --clean-build --clean-tests --testdir to build subcommand and all options passed test.

9a391b43bf137e5a7ee5edeef1fbc2c6f2e4285c authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
bug: no method get_module_ebroot this was replaced by get_module_root

8017d48c10cee706669ae5b56077640722442571 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
add subcomannd build. Move options for testing under build subcommand

Move code from main.py for -s and --system logic to build.py
Remove import calls to buildtest.to...

67834d45ebfcbf492910fc609fd6771566d100ff authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Add subcommand "list" and "build"

Move options -ls, -lt, -svr into list subcommand
Add option --format to control how buildtest out...

417e1a22d37156f3fcacf6f3eff1da8fa08551bb authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Add sub command "list" with suboption -ls, -lt, -svr. Removed option -ls, -lt, -svr. Add option --format to output format in json, csv, or stdout

Fix dictionary layout with keys being the modulefile path and value is
the application name. Add...

c4f45b33d7f7857c5742d8afee5abb4f042b761c authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding .gitignore file from

https://raw.githubusercontent.com/github/gitignore/master/Python.gitignore

45b23b97795ed33bbc99b62b39d7271f7457b217 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Rebuild all command.yaml tests via --ebyaml, now all yaml files have field

"description"
Moved GCC yaml files to GCCcore
Fixed OpenMP test by changing envvars to environment

f6ac2835a3c78ac0c17d88c744b58cc0ea6c4a87 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
--ebyaml now generates command.yaml with date-time stamp.

buildtest now parses only "yaml" extension, previously there was no
check on file type
Add GCCco...

a5968263e4faeac0b65386b22d9b1d5cff604185 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
add 755 perm for test scripts generated by ruby, r, perl package tests

41806c0cd811436544e4a7247c6e8520eb3d4c6a authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
tests now have 755 as permission when created by buildtest for source test and test generated by --python-package. Also test created by "iter" key word are also set properly

6a2570e9d547b0fb3ab81a14770583a192092224 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding option -r, --run to run test from buildtest

Choice field is populated for --run option to only run test generated by
buildtest

80f53c093544cd6b5d0df24ef25015982e7d8ded authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
sort yaml field dictionary and add description key

Minor changes
Remove _buildtest --system all functionality

df76efdf43be1c333e516c0aacb1c7ccfc748c04 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
buildtest parses command.yaml for yaml verfication using parse_config

command.yaml name format changed to datetime format to allow repeatable
runs but only command.ya...

69157374d93ec13a6832069215957fe43a7302aa authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
rebuilding all system yaml test. All test have keyword description

d7fd5801dda335765b7327c6f21b7279fa5d6dae authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Error handling (#76)

* using try, except to catch errors. Exit 0 when running --version

* switching os.environ wit...

ff2ec4e524b6225936686a03ba9e308eded1e2d5 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
bump version to 0.4.0

fix bug with --sysyaml and --ebyaml due to subprocess command return in
byte and note string. Ha...

586db688fb337494fb2cdc94956ff1c84687a349 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Rewrite code to work with python 3 and fix identation issues. Remove buildtest/buildtest

Currently tested with Python/3.6

343956da61109eac1cfd930d017af6942ed907c5 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
fixing package requirements

7d1f1356200b6c30f8dffbf0a7260b8d22789386 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
bump buildtest to version 0.4.0

add package bedtools and system package at

1fc8d4a0e46aae25e3fbf7d5f57cdef96e59dd51 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
remove cdash directory from MANIFEST

014e2c07a786cc9810ede045ca98eee33f97f039 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
simplify output of --scantest.

Output is sorted alphabetically

83dad2b0866a75d88bc2dfadce53a24204842f90 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
fix bug wth --runtest where software or system packages were not showing due to directory error.

The if conditions in eb_menu were not setup properly.

8fbbde8fe1966452d0741b30219119584b35fc8b authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
move override_configuration and check_configuration in menu.py which catches any error priot to reaching main.py

Add extra check in check_configuration for variables
BUILDTEST_PYTHON_TESTDIR, BUILDTEST_R_TESTD...

7769f30180547b52532ef3dde83ccdf26a682b58 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding extra configuration variables in config_opts. Fix bug with --sysyaml (#73)

* adding extra variables in config_opts that need to reference specific directory path many time...

b43ab7feeabb486873940a8b9fa2e57b22fb9c42 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
removing --testset option this is now replaced with individual option (#72)

for testing python, R, perl, Ruby packages

6600dafff70bb91e85b3487775f8e661b883c7db authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding support for pypi package (#71)

* updating setup.py and adding MANIFEST.in to build pypi package, package is available at https:...

e97463b559958ba76b9dab4a03456321d12550f6 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
got setup.py to pick up the data files properly. Needed to add __init__.py

e695f723aec9c06f8f7a92e4f9136345767cf874 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
moving the files to buildtest directory, adding README and fixing MANIFEST.in

70e59a0375a0ae20fb27abe19eb3ea409fe83e35 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding LICENSE, and fix setup.py and MANIFEST.in

0a3fb3d6dfe6d03fc60eb1aa84be7ef33eb1104d authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding command.yaml generated by --ebyaml

93903b729ec988ebba277778a638bafb32f0d1e1 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding option --show-keys to display yaml key description (#70)

2fe05d5ad55f2111a2b561e725ca072172aeb6c1 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding --perl-package option to build perl tests (#69)

2fb47694966b25c50fd9323572e75083195d2ba0 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding option --ruby-package for testing ruby packages. This will deprecate --testset Ruby (#68)

60e51e16fd595b02599b8dae16056d8a1c1a4df0 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding Singularity recipe file for CDASH (#67)

* adding Singularity recipe file and configurations needed for building
CDash. Need to work on ...

644732fb13485532abcd487df199a9eec3aacec6 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding option --r-package (#66)

* adding year 2018 in header of each page. Minor edits to all files

* adding option --r-packa...

de792b75efb1eec93e5a57ebeabf8d46b35c8eaf authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
add option --python-package to build python packages. Choices are automatically generated and checks if python library exist before creating test. Fix cmake behavior and reuse prototype cmake methods in writing test to CMakeList for binary tests (#65)

a677a22488f5930bb2a2fc388952e0c834690d32 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
sha256sum check before writing binaries (#64)

* Add complete support for option --ebyaml.
Binary yaml configs will be stored in each version ...

51101f3e373dea5d510d4cb6b0fae6ca0ecbf1db authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Add complete support for option --ebyaml. (#63)

Binary yaml configs will be stored in each version sub-directory since
test may differ amongst...

ea2ef33c0a1d5d38f0959ae226bc5835e0acb2f0 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding hdf5, hmmer, hwloc, java, m4, ncurses, openmpi, pcre, ruby test.

Add system package singularity:runtime
Delete reference to old command.yaml files

cb39fbfc44338ae001fb181d281f06be15c75e1d authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
add test for autconf, automake, binutils, bison, bowtie2, bzip2, cmake, cuda, gettext, git-lfs, git

Removed old reference for command.yaml

a9d5b5ee087789963af4334f33464b51966494e9 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding test for gcccore, guile, icc

The binary files (command.yaml) are now placed inside a version directory
since each software ver...

6a3caae38bc030e0bcb1a9dbf0826a634ec0bf0b authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
slight modification to contribution section (#62)

* slight modification to contribution section

* update Branch to Feature Branch

605a02f4dbfa2abc45389613f32406e538afc152 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Merge pull request #61 from shahzebsiddiqui/detect_os

Acquire system details and write to logfile, prototype get_os_name method

375613accc3636cce6ae6fbc5683b9c8f73587a6 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Acquire system details and write to log file. Use utility method get_os_type() to detect whether to use rpm command when using RHEL system. Need further testing on other Operating Systems.

6e5bff76abba1670208d17b5dec105fb5fc12e36 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Add option --clean-build for deleting test directory before writing test

Fix identation issues
Fix CMakeList issue where not all test were written to file.
--clean-build...

0882ab58331b701c36a251cbdda573c5db167561 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
rename LICENSE file

add option --module-load-test to conduct module test of all module files
in $BUILDTEST_MODULE_ROO...

3bbfb6cb2636d63ebafd00e505d44cc9f7d88b17 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
rerun --sysyaml on set of packages to get full path of binary.

Add setup.py to package buildtest-config into pypi package

a0930d9c32a4c94caa8bde0de010aa482b3ba0ea authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
rebuilding the command.yaml using --sysyaml to get full path to binary.

Adding test for acl, atop, and openssh

ea5f6b11495e05ca740be3ce2bfa09a5cee2afbc authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
cleaning up cuda directory. Adding binary test for autoconf

20cdaec029b534c447dff90d7a2dab09e4707a7b authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Merge branch 'master' into devel

2dce4d177206ca4f34c93f182bdb1feb23da79d4 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
rename some functions

move variables inside class buildtest_menu

1f83910ccff6746a4076c23a62b200b1c74308f3 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
--testset works properly with HMNS. Needed to add toolchain in

module load for checking python, R, Ruby, and perl packages.
The list PYTHON_APPS and MPI_APPS ne...

6ba20527d72b29cc8a0a5b55a9ebf26762aff6db authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
update version to 0.2.0

ad6269e77635f417a81602efa1f089b800405b53 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
adding logic for checking ruby gems

4630f36c2c7b454efb653ae49bb657b29a5de7da authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
need to lowercase appname to ensure --testset works with module name format other than Easybuild

Add method to check R packages and perl modules prior to creating tests
Added debug and logging ...

827301df5c958801d6ee1c6acc6def8a024c3632 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
Python package are now generated only if package exist, this avoids creating tests for python libraries that are not present.

Change output behavior of buildtest

325d30a65c8d4c211131d9ee5b1e846b0c85a91f authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
fix identation

--ebyaml option can show valid choices which are autopopulated.
Implementation is not complete yet.

e04b225ead10625a6492665bb24dbeaefec5d13d authored over 6 years ago by Shahzeb Siddiqui <[email protected]>
renaming directories to lower case

0cb8e0d0e101f7861839dc36153a478fde831b79 authored over 6 years ago by Shahzeb Siddiqui <[email protected]>