Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/buildtesters/buildtest

HPC System and Software Testing Framework
https://github.com/buildtesters/buildtest

Update index.rst

44c509382e710f1fbf9a8862fb012edc055094a5 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update README.rst

fcfa1f038206e9036ee13d63dbff312d3ae19ca4 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
rename workflow and merge all commands in one job. (#495)

This was a causing workflow to fail across jobs since buildtest command was
not persistent acro...

047e9c951a0243135fd99b2442b093e7f3a701b1 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update CHANGELOG.rst

92b01e07dbada24c26f252554a50639273403c43 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add field network, tasks-per-code, tasks-per-socket field in batch definition.

Set additionalProperties:false on batch field to avoid extra key=value pairs.
Add example tests f...

8189c1f53a8f5fc520a8290e813f0acada503dd2 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add keys begintime, email-address, qos, tasks-per-node in batch object.

Sort keys alphabetically in schema and update docs

467d0b1c0d8dcde872d0240112d37065d6092c79 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add batch key for scheduler agnostic configuration.

Currently we add support for 7 field attributes: queue, nodecount,
cpucount, timelimit, timelimit...

4184dc5df42b921c67daad2e25bba67ff952213f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add documentation on batch field

18c75c18c5b3c3c6b1e7ce8b91319c80ac937711 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
update documentation for contributing docs. (#492)

add page for contributing to schema docs.

67dcf2a06fd3f4429e7554964d261b07bad52c4c authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add setup.sh used for installing buildtest. (#491)

* add setup.sh used for installing buildtest. Only tested with bash.
bin/buildtest invokes buil...

a351f12227f9e02d3d48603092425db6d152402c authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add pytest markers "cli", "utility", "schema". Add pytest.ini file (#490)

f3944b12facde35f5a1ca45ae7e142b34e0cb62c authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove ssh executor from schema since it was not implemented. (#489)

* remove ssh executor from schema since it was not implemented.
remove examples referencing ssh...

7f2889a5d27f04203d0cbbf7524339a9212fb40b authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update jsonschemadocs.yml

8dbbc67c3359753987437d97b13a4fc7a4e0002f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update jsonschemadocs.yml (#488)

b31e2dfa9181fc18c9f5c6f54daab1a94e2e6686 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Add custom RefResolver to resolve schema files locally (#487)

* Add custom RefResolver to resolve schema files locally instead of fetching from internet.
Cha...

a2cdfcbef5763e5cdab6181b12d6d6a32267c262 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add definitions for string_or_list, list_of_strings, list_of_ints, int_or_list. (#486)

tags field can be a string or list.
returncode field can be int or list.
Add valid/invalid tes...

9bb169b7befa4e67d8b04688691e70f0287fda4f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
rename _definitions to definitions.schema.json this was not (#484)

resolving as URI for some reason

5967734bf92f60b3a06d5d45be9b6dccfed28bd9 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add _definitions.schema.json which declares all definitions. This (#483)

is now removed from global.schema.json. Change $ref links for all
schemas to use _definitions.s...

b279046b476fa58a8f4c4d63931bb4c1691bc154 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
change link for schema docs in documentation. (#482)

Add jsonschema2md badge

196ad9bff9442f047367ca684a70232c948add7e authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update jsonschemadocs.yml

e58038f5155625851d415b9210a688cd8c60d9ac authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
upload schema examples in git workflow so they are published in gh-pages. (#481)

Sync schema examples

90537a74a42b649811b6f5cb9aeaafcf467f3953 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add regression test for schemas into buildtest. This attempts to migrate (#480)

tests and schema deployment implemented in https://github.com/buildtesters/schemas to
buildtest...

ee360f428e0e55b2f53d8403e64a98bc2fac489b authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
change returncode to list in schema so fix this in implementation. (#479)

* change returncode to list in schema so fix this in implementation.
Refactor pass_returncode.y...

850baab6150a25c7b8d251f384dfd792db600c90 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
change output table columns for buildtest build (#478)

* change output table columns for buildtest build
Add some clarification in getting started gui...

e4f2fdc75c02d36fbe236338071599625bbec4c6 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix build error with python executor. The generate script was merging

shell code with python code. Now we create a separate file for python code
and invoke the script ...

90a4b597ef1902156e90b28154035e84e1c143e8 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
modify path to test destination directory so that every subsequent build

for same test will increment counter and create a directory name 0,1,2...
In each directory we cr...

c2b67b19f4a30570a348608a5824bee788631832 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix issues reported by CodeFactor

25ce7e91c15a3800564dbd12878a0f9e12b2ad5f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
the before_script.sh was called twice in script, the one after test should (#476)

call after_script.sh
accidently printing buildspec file in buildtest buildspec find

e1444eeeccdaa2063121430cc062fbaddd9a71c2 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add --rerun option to buildtest build to enable running test multiple times (#475)

* add --rerun option to buildtest build to enable running test multiple times.
It must be a pos...

c37f6734b10c7d3a4065fd90ff14981bc36ed408 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
bump version to 0.8.1, update CHANGELOG (#473)

Change release field in sphinx conf.py

b3a1027e8be70ad309487e612abb24f6bbc7ed5b authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
reformat docstring for entire project (#472)

add missing argument in docstring not documented

1ab8884791c248873ede6955c57b156e4ba6c7b5 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove buildtest --docs and --schemadocs and replace with positional (#471)

arguments "docs" and "schemadocs"
Add documentation on before_script and after_script for executor

636a5a38ac4c570d7fef1592f7feb5facd53481a authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix length of test to 32 char and description to 80char (#469)

d193a68e13c3d87828dca0d0f8e36f491fce43c0 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update CHANGELOG.rst (#468)

bf3626c6f27f39b7f04b8e7cc58c80ddcb031fd3 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
update buildtest workflow (#465)

* Update buildtest_tutorials.yml

* Update buildtest_tutorials.yml

* fix format issues repo...

d029267be2ffc6d7775d58018123419238dddf1b authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add buildtest buildspec find --filter and --helpfilter field to filter (#464)

buildspec cache by tags, executor, and type field. This mimics
buildtest report --filter behavi...

62cf2f1f07462c4f5fbe60141828d22f05d6c72e authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add buildtest build --executor option to filter test by executor name (#463)

This option can be appended multiple times.
Add documentation and example on this feature.
The...

7784954786f7ca660b28bcd24bab63f957f6ba3d authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
now we can build with multiple tags in "buildtest build --tags" (#462)

Fix bug where we didn't raise error when we had no buildspec to process
after parse stage. This...

acb0f97216089efe926a4502d4987f3a045955bf authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update buildtest_tutorials.yml (#461)

* Update buildtest_tutorials.yml

* typo in argument

ab032d60fcd3d4b6886260149427749b3ace9845 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
invalid executors are checked in BuildspecParser. This means 'executor' (#460)

field in buildspec file is checked with list of loaded executors based
on buildtest configuration.

7e4aacd85901114e5c738a40ebf7dc43fc9e9997 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add run_phase method and move main implementation for running (#459)

tests into this method.
Minor format to print sections

1ca4ff3fc243010279d51cc9415d4541d30f84e5 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add Scripting buildtest page in documentation. (#458)

* add Scripting buildtest page in documentation.
Update workflow for test_scripts because we mo...

eda07766eb27080d93c8c9da1dbdb8136b16d1ac authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Add method build_phase and resolve_testdirectory and workflow for testing buildtest scripts (#457)

* Add method build_phase and resolve_testdirectory by moving implementation from
main class fun...

226e0dbec5f7785a684fdc7ca8712a09da71e110 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add discover_buildspecs method that is higher level method that is (#456)

responsible for discovering all buildspecs by tags, buildspec files
or exclude buildspecs.
Add...

859287db72f87ddd47d563194cc39725c8af9c90 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Create regression.yml (#455)

* Create regression.yml

* Update regression.yml

* remove coveralls push

cfd1291bdecb0b21847d6057af30db426e0e7ca9 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
move content of introspection.rst into getting started page. (#454)

Rename page "Schema" to "Writing buildspecs" and rename directory "schemas" to
"buildspecs"
Re...

b0019c86a94bb3d19937d6d58666b0eec4bf6579 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update buildtest_tutorials.yml (#453)

* Update buildtest_tutorials.yml

* fix indentation

* issue with building by tags

* Upda...

2466876080f3141c4e02f0360b8fa99df9722701 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add --docs and --schemadocs option to view buildtest and schemadocs (#452)

update CHANGELOG and format headings in introspection.rst
Add section for accessing docs from c...

4deea040e5a5f50c5ef9d94c9e4ac6ddbdf29994 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Filter docs (#450)

* add report filter examples in documentation. Automate tests
in docgen script.

* add exampl...

29542937662aea8f3194ff1ab30f4bdee4fcb9f6 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add option --filter and --helpfilter in buildtest report (#449)

* add option --filter and --helpfilter in buildtest report
We can now filter by buildspec,name,...

e16b7e60ecf551df160fad0370ca975acfe654bf authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add option --list-executors in buildtest buildspec find to show (#448)

unique executors from cache

b062c63fe3bc8bb57b1ac11d4bbaf1e7f2869032 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
buildtest version v0.8.0 (#447)

22dc49f84c18a779d2956b78e02dda08bbbcc93d authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add documentation for 'buildtest buildspec find --tags ' and 'buildtest build find --buildspec-files' (#446)

* add documentation for 'buildtest buildspec find --tags ' and 'buildtest build find --buildspec...

3ba07f7c6a80d8ca6d8978f92122880750dceec4 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add two flags in buildtest buildspec find called: --tags and --buildspec-files (#445)

* add two flags in buildtest buildspec find called: --tags and --buildspec-files.
These options...

ea4018123cda2f3149f023b034ea9f2a088f0bdd authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
rebuild documentation examples (#444)

922fe4c474c4668e107054b6031b9a7fc1597b49 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
bug fix with sbatch --parsable (#443)

a321f75ea19b9b15eac749cd239f8ce4f3367538 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
retrieve jobid using sbatch (#442)

* use sbatch --parsable to get JobID this is part of job submission as pose
to use sacct to que...

8e2dedc2ed27bf84668268df4360574d5ec773db authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Fix lsfexecutor (#439)

* add changes to LSFExecutor that include
1. initialize self.result to empty dict in dispatch...

e0a0f436d9c294d57703680c4e52638d60c18db5 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add builder.metadata["jobid"] once jobID retrieved from SlurmExecutor (#438)

this is used in poll and gather method since each builder must contain
unique jobid and not res...

16eb762e36b13ca5d12b632726b46e1df7283ed6 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
print JobID in stdout after retrieval in SlurmExecutor.

update builder.metadata["result"] when called from SlurmExecutor

d7ca36ded3cf891a2b1f33d8318bdd5f843ff8c5 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix bug when setting "tags" in report file. When tags not define

we set this to empty string

60f0c9bb3125852f3b48519c3d751203a4ded62b authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix bug where self.result from LocalExecutor was overridden by last builder that

called class. This was because self.result was initialized in parent class
and used in subclass s...

0a3ae63db8d8d48fbfb41cab94b78c7a8aece741 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove files that shouldnt be commited to upstream. (#436)

04ba851fcdb2462a05c6bc9275d2ff361e5a5f47 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update CHANGELOG.rst (#435)

178324deef3d84c6c9fa4aee2b3c628bdb3f2764 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
move shebang, sbatch and bsub lines outside of method generate_script (#434)

Remove run.sh file that is generated and now this is added into file
generate.sh

c0547c8f68b77883ec0182212c2f7bd282957168 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Fixups (#433)

* rename run_script.sh to run.sh
Minor fixes

* add tags column to output of buildspec find
...

b938bd2c870917572fe69ea3e81fbe26fb74ea79 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add Parser Schema Validationg Diagram (#432)

Minor updates to docs.

76fb9b2ec208fa2b029cf7a9e9d3ab58c9378f76 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
use subprocess instead of BuildTestCommand to get output of all doc (#431)

examples in docgen script. Rebuild tests and remove compiler_schema
method and merge into schem...

bd34024d80c113b98a8b92b4651da1ef8f4decfc authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove logic for searching in buildspec_roots during discover_buildspec method

when user specifying a buildspec. Fix pytest build errors

eb5785caa9257b66f7c48e73bc0a9a5243a19f67 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove before_script and after_script written in test directory, instead

these commands are part of run.sh
Added set -e in the run.sh script to ensure we exit immediately...

112e03c1dc7c87d48c761a26282cf144aef5a424 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add before_script and after_script in executor section for schema from PR https://github.com/buildtesters/schemas/pull/85 (#428)

buildtest will write before_script.sh and after_script.sh in var/executors/<executor-name>/
whi...

b0205064e29d15ecbf1ffdb51ad77aaea755997c authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add LSF JobName, output, error into jobscript. Fix lsf executor validate bug (#426)

* add Jobname, output and error bsub options into job script automatically.
Fix bug in LSFExecu...

ede9e4bec2e0e08e0a21a1c617d62c6bcb4e3372 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
move implementation of each executor (LSF, Slurm,Local) into separate files.

Move BuildExecutor implementation into buildtest/executors/setup.py
Fix import statements as resu...

4f01cee5530641e2e8e8807b8cba1703def9539e authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
predefine job name, output and error file for #SBATCH in test script

when buildspec is using slurm executor. This is defined in get_sbatch
method

12ce44ffb0ddab7f3f8752ecb196cce37d658877 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
rebuild buildspec cache when running build by tags fix travis build

8c96435c7f78f223db29491fc291ee4819974867 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
rebuild doc examples again

149fae409a847f0464b8d156f74087fe14572dc4 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add --stage=parse and --stage=build to control buildtest build behavior

now we can stop between stages. Add stage for parse to see all buildspecs
that are validated befo...

d8d8920a26073292d764be27304068caabe082dd authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove unused argument 'version' in BuilderBase initializer.

Fix endtime field in report. It was not showing up properly.
Add sub-directory in the test direct...

edb4fa2c2749388d267aa8c272421b01f3ec04c0 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix starttime and endtime for LSF and Slurm jobs. Using start and endtime

reported by slurm job as posed to buildtest methods. We don't need to
invoke self.write_testresul...

25601b0cd84773a2212df12a6fb8cec1142555de authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix pyflakes issue

697254b633f67428ba41ca037be553327b659511 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Sync schemas and change layout of schema examples. Update docs (#421)

* sync schemas
rebuild doc examples
add section target audience and use case

* move schema ...

0a1cc590d0b7a9ace3e14d81185522e7882586b7 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add diagrams and new page builder.rst to cover BuildspecParser and BuildExecutor class (#420)

2966a2c32ef890f0c41657f23e1ea10c295803b3 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
bump 2 to 5 second for jobid retrieval from Slurm (#419)

238d7a1e322343c8b40f45eb83a7313517f39b14 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Pre & Post field for build and run section in compiler schemas (#417)

* add pre_post_build_run example buildspec and documentation example.
Update url paths for sche...

3540b431655d0c25c5ed38629c7dcd02559c06b7 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
sync schemas from buildtesters/schemas repo (#416)

* sync schemas from buildtesters/schemas repo and they are now in same-level folder in
buildtes...

16e8df3233cbfc7f4b2df22f4f028001785d1cb8 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Fix typo (#415)

f263cd2dee120911ef63f4cfcf2922e08eb70132 authored over 4 years ago by Paul Mure <[email protected]>
add example section for building by tags (#414)

move related projects to under what_is_buildtest.rst and add section on deprecated projects
inc...

f8eda57d6b0ec0d8366b8310b156220cab922e56 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add --tags option in buildtest build. Build tests using tags (#412)

* add --tags option in buildtest build. Build tests using tags, which
searches the buildspec ca...

1718e806135417a1e19145e812ce34ac80866a5b authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
documentation for OpenMP, MPI. add executor name in test directory (#411)

* add OpenMP, MPI example to docs.
add slurm executor as part of sub directory for test directo...

3398455159e35f48caafc8f30a8af42d6f7ed3f5 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
buildspec roots documentation (#410)

* update requirements.txt missing pytest package
buildspec cache and error file are now in var/...

53bd8f662b49c8c45c6a987253ba44c570809404 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix bugs reported by travis (#409)

* fix bugs reported by travis

* fix pyflakes issue.
Fix bug reported by travis

* address ...

88adbed506c739cab42d150fb5aa0739a0e68c31 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
move Slurm and LSF Executor docs to batch_support.rst (#408)

Rename executor examples
Remove reference to buildtest repo and undefined refs reported by Sphinx.

a04f200a6064c8d9cbcee79b717eccaa7f35dc9f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
regenerate requirements.txt and update to setup.py (#407)

* regenerate requirements.txt and update to setup.py

* upgrade pip in workflow since it compl...

05fea38f13b5eb6888b3e5ded1f5507db1058eb0 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add buildspec_roots key in [config][paths] to specify root of buildspec (#406)

* add buildspec_roots key in [config][paths] to specify root of buildspecs to search
change beh...

a1bfcf78756f0c9969515062a6963cfccb163ef0 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove buildtest repo command. Remove reference from docs and examples. (#405)

Create subdirectory under "var/buildspec" where we can keep buildspec content
Update layout of ...

3ed30e7883016878416e45e9fd813bdaa28058eb authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
remove buildtest config reset from docs (#404)

Add note on default configuration in configuring buildtest.
regenerate documentation examples

121a4d8dfb84f40e9c13ec0f21a3f4038af8b46f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
change startup behavior of buildtest and add tutorials to search path. (#403)

* buildtest will read DEFAULT_SETTINGS_FILE which is provided by buildtest,
file is not copied ...

d5caf722257f448108520d900627c6adddcc1fad authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
inform user to install via pip not python setup.py install (#402)

Update setup.py and MANIFEST.in

876970506f717e3162d49eddf67c89726786a035 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add LSF Executor support (#401)

* add LSFExecutor class. Add methods for load, check, dispatch, and poll.
Add bsub key in globa...

7e4327fcdc77aded6028c60bc24648f895501831 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
workflow badges (#397)

aa34a3403420930e05284cfe783f31ae075d1864 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>