Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/buildtesters/buildtest

HPC System and Software Testing Framework
https://github.com/buildtesters/buildtest

automate documentation for build examples

c5aea915a779c4a7d7456d3c6242a0e1c01eb3a0 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
Add the following tests in pytest

tests/test_inspect.py::test_distro_short
tests/test_build.py::test_get_system_package_binaries
te...

02faf9513e375ad6303745e72a9b1b9d88b5196a authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add method clear_builds() that implements buildtest build --clear

Add the following tests in pytest
tests/test_build.py::test_build_report
tests/test_build.py::tes...

0cd05bca924c60f21e1ba96bf7d22a6683e9e57c authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding module purge or module --force purge in test.

Fix #122

59967bca40a334e7b171fbb32dc409eb8a792e23 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
change output for easybuild and spack module retrieval.

regenrate documentation.
Fix pytest issue related to directory expansion.

f243b1bfe34c624c7c601f05c29d042a66c06d07 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
rename slide names

5dd235a71ccc7e60a670e5591ac74f66ff5942e1 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
typo in link

3f8d74e8d62dbf083bcfb109d293774fa3c40369 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
missing > in slide link

0cfe15fa00569aaf71d70f8a802b9eba6cc76968 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding slides for hust-19 and updating references.rst with link to slides (pdf,pptx)

6dd98475d6df0b24034b34e4ea7d1f7d7d098157 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
fix some more code style issues reported by CodeFactor

remove docs/README.rst and success_tests.sh.

f9edbd1a6eba447d795e67c86c822a7c3bf5e8e8 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
fix code style issues reported by CodeFactor

two tests were failing in pytest because directory was created and not removed.

3f8a29ed1ab99a5789f3533dcbb0c57d9ba7e165 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
enable cuda and intel in "compiler:" key

Add EXECUTABLE, CC, FTN, and CXX as shell variables in test script.
nvcc will be set to $CC in te...

e63f1d27945efda7e818683185830e237f73f604 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding architecture and build-pipeline diagram.

update documentation related to build pipeline.
Minor edits to documentation
Rebuild apidocs and ...

6d310a66c288c4830f34c324d7435b70fb913666 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
rebuild apidocs

bump version to 0.7.2 and update in documentation
add dry-run section in build
minor edits in doc...

2ed188bd24843070ef35bc469c37b23c74f29db4 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
automate doc test examples for module collection operation with exception

of module collection update
Minor documentation edits
Fix bug in bsub wrapper when multiple tests...

e3c793e7b212d4d8449217c9ad7bb6070b377da1 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
automate doc examples for easybuild, spack module retrieval and listing

parent module dependency.
Update Feature Overview page with reference to automated tests

395992b1866290efbef320690e59c7b15c79ff42 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
automate doc examples for adding/removing, and setting module tree.

12e406c144e6251667238b65421b6df5b0ca13a6 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding more commands to automate doc test examples

fix path error bugs in program-output

24b0e5097d09e27278c6dee55da4e6ed07ab2966 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding buildtest system [ fetch | view ] output to documentation.

Fix path error bugs in program-output

44fe98c5e75e7052669763a5e9286377d9306b07 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
autogenerate helper documentation.

Update documentation reference (program-output:) to scripts in docgen directory

2d942cde5b801f0f6ae07401506a820c2b3befaa authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding python script to automate test creation for documentation purposes.

Initial implementation is for helper method and introspection commands.

0b52893c05bbcf4605a14a4f7265d1e38c14e5b3 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add dry run option (-d, --dry) when building test. This prints content

of test script but it doesn't write the content of test. The dry run mode
does not work with -b o...

3222366f1f665fe27a2e11a26288015d6b2be879 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
remove BUILDTEST_SHELL from framework.

binary test will be written with magic string #!/bin/bash for now and
file extension is .sh
remov...

e35390d26667088c15c416dac822faaae8af3747 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add method clear_module_collection. This will not delete the file, but

rather set the collection to an empty list and rewrite file.
in method func_config_view() set arg...

7db4c17f2909df8418662fa19477032cf8c94b93 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding codecov badge to README. This redirects to codecov page.

Set codecov to devel branch as default.

5447482b65f0f247b13a95322129348a56bec1ac authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
install coverage, codecov, pytest, pytest-cov

adding a .codecov and .coveragerc file.
Testing coverage reports see: https://codecov.io/gh/HPC-b...

b7682d6a62c7ef516abcd1295e07d64499bf077b authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add section explaining how "run" command is generated and the use

of {pre_exec}, {post_exec} {exec_opts} work in building the run command.
Adding pytest examples f...

b6bf2f0514b57ab2f08d74e7ee612bd09c377b8a authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add method module_tree_list() for buildtest module tree -l

add directory expansion for adding and removing tree
add test for spack and easybuild module retr...

2759804f453f56e5d7ba79e2e0a49ca845a3649f authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add directory expansion using os.path.expandvars() and os.path.expanduser()

when creating files or directories.
Add test for creating and checking directories and files with...

7c2ca36cce37be97ef7576de8a4aeb0b83c6d80b authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
fix bug is is_file and is_dir related to variable expansion or ~ operator.

This was fixed by using os.path.expanduser() and os.path.expandvars()

Adding tests for checking ...

37f8632658bccad3001e1a9122a816d5031184ea authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add badges in README.rst

add license in vecAdd.c

16c014fe22f16d53d6c5be04794d301ddf9f183d authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
summarizing changes for version v0.7.0 and v0.7.1.

Pushing uncommitted changes for auto testing.

95f98b152cc5f98d439e8dd81a51d63a512f7616 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
bumping version to 0.7.1

ab1f19bcc91edfde4ae5fc2d1e3f2badf8b16cfb authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add key TESTDIR in build.json which points to location of test.

This is used with buildtest build run to locate test directory location.
Enable module permutatio...

489ae0c25e21294dbac2c591f1e6894fd67d5048 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add the following options to bsub wrapper: -n, -W, -M, -J, --dry-run.

--dry-run is not a bsub option but one provided by buildtest to allow
user to see submission comm...

0abfb1c314b5f0cd91e49333c1f2f0aa8d1e5b64 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
merge building_with_scheduler.rst and mpi.rst into one page (build_examples.rst). Add OpenACC documentation example.

Add LDFLAGS variable in test script when its declared.

2bccca360189d7724bc50be2e95212d44c66a4af authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding mpi example for documentation.

a5f04b71d8a45acf7bda4564c23ca0540984a045 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
removing mpi documentation. Will rewrite it again.

rebuild documentation test and fix bugs in docoumentation.

306fa8997f80cc006963ef2a7e66b03b7a405016 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
update documentation

adding introspection.rst with "buildtest system" command
yaml.dump() was causing test configurati...

c430b2adcf6ca0439b30f0a0660aace8d9f4e89a authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
Adding documentation in build.rst with pictures describing the test dictionary mapping to the test script.

Merge LSF and SLURM job examples in one page
Remove unreferenced files in documentation
Adding pr...

e9f958f7b745090cbe6f4d95fbe881728152b873 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding hello fortran test configuration.

Removing openmp dotproduct tests

4a58551a75a62b75f496b10f88ae710ed9aa1de9 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
adding mpi hello world example and test configuration

add key launcher_opts to pass launcher options for running mpi jobs.
Fix bug in condition pre_run...

0843c5fd2eb0596b8285198fe533eb575389d2b3 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
"buildtest show -k singlesource" will print the schema of SingleSource class in YAML format.

Add logging in class SingleSource
remove yaml.py

4dfde761280e5915ef7afbc09323d6340a421d24 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add license tag to source code for tests.

removing all source code for test and yaml files not relevant for now.
Will only contribute tests...

8f3f29cd332d1e8ae7eea3ff6275418eb64a6346 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
changing to MIT license

removing license header from each source file.
Removing unreferenced methods in framework

38462975397631f995254ea341e2989f61d9b6aa authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add sbatch key and a slurm test example

add example using pre_exec and post_exec option
add test example with OpenMP
Remove outdated test...

9424134c32de1b244b3037d4782f3d2e78384984 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
Reimplement the core framework for building test.

Base class BuildTestBuilder detects compiler, mpi and language.
class SingleSource inherits from ...

becb4ef43ff1b464e51de333b0799c83a77f03a5 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
Adding documentation on "buildtest config" commands to view,edit and restore user's buildtest configuration.

Minor updates in documentation.

5a812e78d7f168c3c34ceb1a6f2bb8344c655512 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
Remove --suite option from build subcommand

Remove buildtest run subcommand. This is replaced by buildtest build run
Rearrange Build section ...

98c34d17cb600cc62f164aca74d678d37857fe69 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
moving all test configuration up a directory.

Removing ohpc test configuration.
Random bug fixes

3eb345d1ed6cb70c2dabcc713200ed257f2a32fc authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add option "buildtest system fetch" to re-write content in file BUILDTEST_SYSTEM

get lsf configuration such as resources, model, host_types. Move method
get_lsf_configuration to ...

6281b601865e61783cbc7f40bdb398c43f141a97 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add option "buildtest system view" to print output of system.json

add option "buildtest config <edit> | <view> | <restore>" to edit, view and
restore buildtest con...

6910481a42b0b39e6960a6905b8d46692b833340 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add --check in "buildtest module collection" to perform module load on collections

add documentation example on --check
update environment table

9a9c10b621229e1cbb98b9552ebdc59046919a83 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
remove BUILDTEST_LOG_DIR and BUILDTEST_RUN_DIR. Log files and run files are now stored in BUILDTEST_TESTDIR under "log" and "run" directory.

Removed outdated features from documentation
Fix Reference page with links to video and slides.

01f0bb1e3cc17c72db1b18dd2549762959f7dfdc authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
remove "buildtest yaml" submenu. Moved maintainer feature to "buildtest testconfigs maintainer". Add section on how to add/remove maintainer from test configuration

4b9a938816a4cc95597ecb3798af7b591aa50705 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
remove option "buildtest status" from menu

move status.py to tools/buildsystem
rebuild api pages

74da033fe561c9692880471de57adace54ba760d authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
move binarytest.py to tools/buildsystem directory

Remove buildtest run options -S, -p, -s. Now tests can be run via buildtest build run

7ce3469870de71a9177745eb7aebb7999e011894 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add subparser "buildtest build run" to run the tests from the specified build

id.
remove documentation example for --clean-build, --testdir in build.rst
update section build_s...

689e92236fb200eac1a87239604f6676cdc6c075 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
remove BUILDTEST_CLEAN_BUILD and BUILDTEST_TESTDIR from configuring_buildtest.rst

rebuild test help menu (buildtest build, buildtest module collection) for documentation. Add sec...

227a8d56223fdb9a19c65c3d7eaeb0f894f87079 authored about 5 years ago by Shahzeb Siddiqui <[email protected]>
add option --clear in "buildtest module collection" to remove all module

collections

f13341f79bbb6aa2d548d1f28ffc43545d312384 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
replicate options for buildtest status to buildtest build. Eventually

will remove "buildtest status"
add option buildtest build --clear that will remove build history ...

26308b0ff6d6dd144bfb47c5b080060ea1279231 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
remove START/END time with BUILD Time in buildtest status report

TESTCOUNT is now done by retrieving list of files in test directory. This
fixed issues where test...

d563f172ec4875f29df223c2757c88d50ba65c0d authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
all builds will generate a unique directory (BUILDTEST_TESTDIR) that also

encompass build_id that is incremented after every build. BUILDTEST_TESTDIR
is now consistent acr...

491d55573277ed5eb6ace81118379367a8fb5c10 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
write output of private variable "system" from BuildTestSystem() to file (system.json)

Detect Architecture and Vendor for current host. Modify path for BUILDTEST_TESTDIR to encapsulat...

a8f3dc69e4de497c18fae8790f6660a27fadae0a authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
adding sourceme.csh file to setup buildtest for tcsh or csh users.

0ed393789d97615c316908abd5ca3ce17df7beab authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
adding buildtest slides from HPCKP17,18

d836f0bedc4093505fbbd6ea40a4328d22a05045 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
update documentation example for "buildtest run"

remove outdated doc test for buildtest run
update section in "buildtest module --module-dep"

507967a0f10efe5aaf16352491b02d9720179dd8 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
remove "buildtest find" command. Now test scripts can be retrieved from "buildtest status test".

Rebuild documentation api and remove doc example for find section.

5ee8f98576ab286ff3606afe462577efd972a8c9 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
add buildtest workflow diagram and explanation

remove YAML subcommand page
fix documentation test for module collection and mpi examples

bcf0458425c6b83bd9f4e40dc78af0e244e97c81 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
add documentation on build status report, a sub-page under Building Test.

Rebuild all documentation test and update auto_write_test.sh

3473174efb4e0cb93269a64a31e9869fb0a0cdbc authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
Move subcommand "buildtest build status" to "buildtest status"

add command "buildtest status test" to view test generated based on build ID
docstring formatting...

ca1cb5d61b0a2ad141868799a99ff484436eabb4 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
adding command "buildtest build log <ID>" to report build log based on build id.

Change format of build.json.
Add method get_build_ids(), get_total_build_ids() to retrieve choice...

8e89e253d1ad82112ff7bb07193a8f6aec74ef19 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
adding command "buildtest build status" to report history of builds

buildtest will write file $BUILDTEST_ROOT/vars/build.json to keep track
of build history includin...

3e67d1b4d36fbd9b607acadf89b8946baeed0eed authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
adding badge for documentation and slack to README

18088d9efd2d177cb833ad04681e1507a51cb639 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
update docstring for generate_binary_test

two optional arguments package and module can be passed to generate_binary_test
to indicate if it...

38fdb475e0d29437d5c75f5f616ed0fc829dd1c8 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
remove method func_build_system

add message when conducting binary test with no loaded modules to end gracefully.
update help on ...

87b9e55b39fd62b8dd606e7b2b685cbbc97fb03d authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
updating docstring for remaining classes and methods. Testing

sphinx-apidocs for formatting. Need more testing to ensure all docstrings
are formatted properly.

4d6dc18f9099e6f23a43ecd28ba0cd3d16fc9997 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
move method func_module_tree_subcmd to tree.py

remove unused variables from conf.py
Add variable BUILDTEST_MODULE_FILE to reference $BUILDTEST_R...

ad0b0ff925d2ad2d5c550a31c52dff489793a864 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
add docstring for methods in build.py

remove --clean-tests option Fixes #117

c3cc6cfb23e82b0d6747fbb207f37c0f6884c5a2 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
reverting change for build.image to "latest" the custom docker

is not a valid option

51489ae04f4ca8e4dc520064c46aa91d6f1b79f8 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
using custom docker container with Lmod to test rtd build

53e78a56756e1c8a88397804fad88207a2844a69 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
BUILDTEST_ROOT needs to be set in environment when building documentation.

The error in rtd build for apidocs is due to fact BUILDTEST_ROOT is not
set upon build.

cf1fb782b7c570e33c61691748968a3f0b50cbb2 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
recreate apidocs for testing.

Add option -T -E for sphinx-build in Makefile.

17825428055c06ffa59ddcc705f68c27be6ea325 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
removing all apidocs

b1f6318296d536d4162d608f1d3a28d365a7d005 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
rebuild api documentation. Testing sphinx-apidocs feature

50cdb88f11c9e73c0fab49fa1283943878a37135 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
rename module collection test for documentation.

Add usuage for module collection and module tree commands
Add section on setting module tree

d3ce416901b5351859ec89afda03baba32fbbde6 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
rename default.json to collection.json

move method diff_tree to file module_difference.py
add variable BUILDTEST_MODULE_COLLECTION_FILE ...

4844aec35e53e96df9b16b6916edeb226f8c6c03 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
adding __init__.py in modulesystems directory

3009b4bd2200880680c924fc8de1ae090ef264ba authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
Update help argument in subparsers

moved file collections.py to modulesystems/collections.py and update import statement
add option ...

670e8bd6e95f0d574c6ffb1a0960df65e17ce8ec authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
Add documentation on Module Collection (add,remove,update,list) in Module Operation

page. Add test examples for each command and automate test creation using
auto_write_tests.sh

620b132841697fc2eab6d2062945a87343f045fc authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
add option -u to update module collection index. In this scenario, a module index

is updated with active modules in environment. When no modules are loaded and update on
module co...

b388179b4d8a4aabb44e591cf01bc0a1fd35fd47 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
print output of module permutation without -v option

Add remove option (-r, --remove) in buildtest module collection to remove
module collection index.

2aff143f86c3e28af3b35eea76c92714b898df55 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
missing test examples for documentation

af211d563ece86b6e0ce66d0478bce896b7eb0a0 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
rebuild all documentation test examples.

test are now built using new testconfig name scheme.
add test examples for module collection for ...

73b997cfa6ae981fbffe253dfa55426cdae3e2f7 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
remove option buildtest find --find-config and delete example reference from documentation

Add page "Additional Features", and add page on "Managing Test Configuration" with
command exampl...

49f136e0ae5a2f3ccdaf9252bf637b2c8103e87f authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
add command buildtest testconfigs with subcommand "view", "edit" and "list". buildtest testconfigs view <config> will display a test configuration. buildtest testconfigs edit <config> will open configuration in vim. buildtest testconfigs list will print all test configuration.

All methods related to testconfigs are in testconfigs.py. Moved some methods from
show.py to test...

86eca9233e89cb14c7bfe9d245991e1c4fb528e8 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
add description key in YAML and provide brief description for test configuration.

Add option "buildtest show testconfigs" that prints test configuration and description field.
Exe...

63189a48b68200c5d2a28527ca5608822ade1d29 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
Add keys "openmpi" and "mpich" in mpi to specify which MPI implementation to

use.
Add mpich hello world test configuration
Add orterun and mpiexec.hydra keys in show key opti...

2f692b3a71a8c08ab8b3071cd1c3ada6c5ef2d11 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
update documentation on show configuration (buildtest show --config) because

some outdated variables were documented no longer present.

efb3616e695a4f228273f2ae45ad3eb4c2232a26 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>
BUILDTEST_MODULE_FORCE_PURGE can be set as environment variable to override

configuration value.

df9dc57dafa9546e615edcc59358fe4e02e37dc1 authored over 5 years ago by Shahzeb Siddiqui <[email protected]>