Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/buildtesters/buildtest

HPC System and Software Testing Framework
https://github.com/buildtesters/buildtest

fix bug where modules were not overridden from values specified in (#573)

buildspec file. There was error processing run section when specifying
launcher paramter.

20199bdae6057f624d3d1f672111ba77b40e12d4 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
fix bug in buildtest config compilers find when using (#572)

environmentmodules.
There was KeyError when adding new elements to compiler if its not
defined...

72866e263cada35a0f4627cb44130f91950a5595 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add documentation on configuring buildtest + compiler and fix bug with buildtest compiler detection (#571)

* add documentation on configuring buildtest with new compiler find feature.
Reorder sections i...

2c08e52e804c34b38221177aa90f2f9f127cbfbe authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add link to whitelist in urlcheck and increase retry to 5 (#570)

* add link to whitelist

* Update urlchecker.yml

777e30018b4aff00a77f1000feb34b080572b65d authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Change compiler search to regular expression, previously it was a string search. The schema

property under ['compilers']['find'] was expecting a list, now its a string.
Add option -d (--deb...

facc9251c39bb35c5b74a2a63650d78ef086dfe0 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
move exception checks for moduletool in BuildtestCompiler from __init__ method

to find_modules method. This allow class invocation to retrieve compiler settings
from configurat...

4b6c37063fe74a9da08970e63e85f3788b809f6f authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Update compiler schema layout for multi compiler support. The 'compilers'

key allow one to select compilers based off regular expression using
'name' field which is a list...

4047fe23647bbd6be42558d34c39ad6708c0d208 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor valid and invalid schema examples for compiler-v1.0.schema.json

Add regression test for class Hasher
The build phase table now prints script and compiler builder...

1d9af7c675e3469f583d2e67745da0b4ab5f5d0b authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Update .gitlab-ci.yml (#565)

* Update .gitlab-ci.yml

* Update .gitlab-ci.yml

4b1d7f74e39f27cf72946b61c8dd053611bff60a authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Create .gitlab-ci.yml (#564)

* Create .gitlab-ci.yml

* Update .gitlab-ci.yml

* Update .gitlab-ci.yml

5c37c0796ce38c584c436c91b5f41cf4d6d95764 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add regression tests for Builder class. Add tests for invalid file and

file extension when using compiler schema
Refactor CompilerBuilder class when generating compile ...

69471bf21fa014bf95d9c82f87b262220c9e9b5e authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
change structure of module section in compiler declaration in settings schema.

The settings schema was using $id to full path, this needed to be changed to use local
file path....

3ea4cbd6e298af0adc0e42cfe3394d359e811c39 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add Builder class and move methods from BuildspecParser related to getting

builder logic into Builder class. Refactor tests, and parameters to
some methods

573d542cbc1a7b753eefe609e731588584d9195b authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
remove deepcopy for creating new objects. Revert back to for loop

when creating builder objects when performing multiple rebuilds

5d0f496a71372dc711fafd49bc26f47275fd53a1 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
rewrite scripting examples. Bug reported in CI checks

700bd79caf7905d4637aae24dfae0cde099e9971 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
fix slurm bug during job submission. (#561)

* fix slurm bug during job submission.
Add method _set_metadata_values in BuilderBase to set va...

fb12c1040bf488cec6c50bf7d57a949caf441f44 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
change structure of module section in compiler declaration in settings schema. (#560)

The settings schema was using $id to full path, this needed to be changed to use local
file pat...

d8e0190ca1b32cbbf44ec0c7bde6f74b912771a4 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor run_phase method by moving poll section into method poll_job

20f644ab6fae91f1c99e459a1efaa83e18554a4f authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
remove abstractmethod decorator from executor run and load method. There

was an error instantiating class
Change ABCMeta to ABC when calling BuilderBase class

b7d8a594e10914dbe266ff9c84a905e3bd041d52 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor code (#557)

* refactor code

* methods implemented in subclass are marked as abstract method

cd4e30d4945eae2461a53d02dccd90fc1b96115d authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
change module property from list to object (#556)

* change module property from list to object with key names 'purge', 'load', 'swap'
to allow us...

15f0cf79290fab873ae66c9a26415006dc2b96f9 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor buildtest report into class Report (#555)

* refactor buildtest report into class Report

* rename input argument in __init__ method

c54a32ab8f2266fe44248d47508577d8a9bf359d authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
udpate tutorials/vars.yml with variables defining literal string, (#554)

singlequote, doublequote, and variables that store linux commands.
Add documentation section on...

4ead9cc454a9da40b080abd1cb4c85a695b398ca authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Typo in branch name

fbabd91a6899793f1c709137a48303df912c082f authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
version 0.9.1 released (#552)

* bump version to v0.9.1

* bump version to 0.9.1

bed3e46b54a40f89a703f16fcf12903b18b8f44b authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
changelog for v0.9.1 and remove travis, manifest, setup.py file (#551)

* remove travis MANIFEST.in and setup.py. buildtest no longer needs setup.py
to install buildte...

48359f62b22efbfbb5df55273d4d2a2376f6536d authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
bug in format field in 'buildtest buildspec find' command. The field

name is 'file' according to --helpformat but we were using field name
'buildspec' which didn't ex...

068db9b6ffa0930d642c9238f8743f550d1e5ec2 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add option --group-by-tags and --group-by-executor which shows

buildspec cache by tags and executors.
Regenerate documentation example and update docs section.
...

ce3214fa9bff9720bbe3cf001860531c41a259a9 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add test coverage for option --group-by-tags, --group-by-executor.

Fix errors in CI

46bbe3cd07b45b1d07c8d43584a507e34025fff3 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
update cli workflow

9a7f5fa142ede7b5d8b371317c771c5eae90bb45 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
remove 'view' and 'edit' command from buildtest buildspec. Remove 'editor' field from settings schema (#549)

* remove 'view' and 'edit' command from buildtest buildspec. Remove 'editor'
key from settings ...

b8479b4b0b3da9eaeae95ba06c2b4458986e57cf authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add key load_default_buildspecs key in settings schema this configures if buildspecs are loaded (#548)

by default.
Add option --root to buildtest buildspec find command. This allows user to specify ...

dac4444b42a07b5c8f281dd0458df09e08e75383 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Update index.rst

672f7cacdc2328d6b14a6f3fa90afe23e125aac5 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
update readme with badges

ed8dbfa6791043d3e742d54471b18c7f988306cc authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Create gh_pages_master.yml

267f7f913cd8e1b5303b1af42aa307bfe76ee3bf authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
update version of workflows

ebbcb127dbe4b09333c76b7ba983a6f8647974da authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
urlcheck daily cron check for master and devel

eb601b4610a32b8f41cf919f5e6877584247d869 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Update jsonschemadocs.yml (#547)

8930a73bc094a647704f264d2705e10a8944ff31 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
maintainers list must be unique list. (#546)

Add invalid test for duplicate maintainers in test

945457d3a31eaf119ce56902406a1b89bcc8be88 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add cobalt in scheduler enum field in run_only. (#545)

Add cobalt commands in generic tests

d47187daa04c71692e3cf7510783200be9926471 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add documentation on configuration and finding compilers. (#544)

In Getting started we add docs on formatting buildspec cache
with --format option. Regenerate a...

c971341a7cb1e17199ece0138d6a4482c084001d authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor code in BuildspecCache reported by CodeFactor with complex

methods. We add methods _filter_buildspecs,
_find_buildspecs, _write_buildcache, _filter_buildsp...

ad49399377f25fd3dc873746e8bf7aafed90d7cd authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
change structure of buildspec cache. Add top-level key "buildspecs" where

buildspec files are stored. Add two new keys 'unique_tags', 'unique_executors'
to store unique ex...

2870583b630f72541da01c15d548016af1fec8c4 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
error in CI failed to remove buildspec cache file during --rebuild

option when file doesn't exist. We add check to remove file
only if file exists in addition to --...

9212934184c9fe8a359959364947590801f96cfe authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Made following changes to buildtest buildspec find

Rename --clear to --rebuild option
Rename --list-executors to --executors
Add option --paths, --h...

e7ec378389dfa9b9e07e98eaf4c0990b958a2177 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
move methods for 'buildtest config compilers' to file buildtest/menu/compilers.py

Change sys.exit to BuildTestError when raising exception.
update docstring

b25998fa1863624a4d2041538b244b0b8ea3e82e authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Add class BuildspecCache to implement logic for buildtest buildspec find. Previous

implementation was merged into this class as methods. Old implementation was removed

d348e9f4ba41632517dd3ec3238053215c4cf6e8 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
fix bug in regression test

74ea4f6e49c6d1dc4bf7727a3d173ebc64a238ac authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor BuilderBase class by moving logic of test creation into

private methods that are scoped. We add methods _get_scheduler_directives,
_get_burst_buffer, _ge...

3d4660eb19a79ea84e660e906b90fd648a23f62a authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
fix issues reported by codefactor

868e3549cddaed3993e7536275c76e6a4b769c60 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
applying black

53debeb8b707105f2882296af02b6050e803f008 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor BuildspecParser class by adding methods to class. The get_builders

method was doing too many things. We have separated filter logic into
separate class methods that...

c63c8e3a34ef2c4e0164c1354ec6b8d63f5f8aa9 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
install zsh in CI workflow

1899a286650641a8c062ff6099cc4aaf0e7e19e0 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
raise BuildTestError instead of SystemExit for read_file and write_file methods

84b914c20d125c17869695ec4a6c23e7e2877503 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
fix pyflakes issue

fix codefactor issues related with type redefinition
refactor checks in BuildspecParser class

0b167d6c9bf371aee533d0b849c4d69907fc3283 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
initial attempt to add support for finding compilers. We add

lmodule api in buildtest to detect modules using Spider. For environment-modules
we detect module...

2e25b6381377fb7615da52c9462355837ad9c17d authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
refactor code for finding compilers. There was redundant code for testing

and updating compilers based on lmod or environment-modules. This feature has been
tested on Lmod...

3656b950c502320005172675ea052d952ae47bee authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
compiler query and section and improve scheduler detection (#539)

* add options -l, -j, -y in "buildtest config compilers" to list compilers
as flat file, or in ...

cc4fa0cbdd27eacd4194e87a76424ef750ae7cac authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
define metadata result key in BuilderBase class (#535)

fe09c9891c460a9d766ccb4bf62a0e01d8c9ed03 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
update docs

d3913abce743bfeff94d02e8927ceac15a59e5e7 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add documentation for cobalt executor with example configuration from JLSE. We (#534)

add example job build running on JLSE.
Add column in batch translation table for Cobalt with li...

d52249f6e6b3589089361c4406fbcd09a030c041 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
saving my work

a29a0c5c594e435e8e002ec9d36782e72d5bceda authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
fix bug in definitions.schema.json caused failure when loading schema

add cobalt executor example in regression test
add 'cobalt' key for compiler and script schema
Fi...

ef38b7bbf23de354edfb5d5c971c49ca13ef2261 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add CobaltBatchScript class that adds #COBALT directive in job

script. We also add support to translate subset of fields from
batch field for translating fields...

b5318ca9d34cad2f9c4ed255f0bc9005c5798bc3 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
saving my work

fc9c5efc6897a636579345b4ce8b962e556f8283 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add Cobalt Executor in setting schema. We add 'cobalt' key

to specify job parameters like #COBALT in test script
In addition we add CobaltExecutor class to ...

b63dc6bcc8c8728a42f45ea0995cbd1cb668c567 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
reference self.builder.metadata["result"] when referencing results

from a builder we were referencing self.result which was getting
confusing since final values are...

d6935ee40f7a9d41583d64553bb64ba6e1dde9ef authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
remove #COBALT -o and #COBALT -e from test script, this is causing

issue in Cobalt where job fails to write output/error file so we
let cobalt resort to writing out...

a27e36dcce375a681a563e44252312e78347bc18 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
fix job timeout issue during poll stage (#532)

* fix logic of executor polling, change return type to dictionary, we
now return properties job...

84b6539c216de21ffb6773b8491fcbaba33cdd32 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
update what is buildtest page with preview of buildtest (#531)

remove section in builder.rst for images on BuildspecParser and BuildExecutor
class. This secti...

ca7e6f8619e521e5778bf8638cf0f0687b62f664 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add new maintainer checklist in contributing page (#529)

3ee6325e096ac421a0b46afe13e7c02096791b2c authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add to settings schema the following (#528)

modules_tool to select module tool used for system
add 'clang', 'cuda' section in compilers
ad...

0fd1606ad5a8bf3216a4f5033914a94bc4e53efb authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add compilers section in buildtest configuration. Update settings schema (#527)

accordingly, we can declare gcc, intel, cray, and pgi compiler. User
can specify cc, fc, cxx op...

94335ecf3af5e2b5a780568fcc57241de762919b authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Burst buffer docs (#526)

* add BB and DW property in schema for specifying datawarp and burst buffer
options

* add do...

0dac820213b4d50608eeb09bea0e2135ce4ff19e authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add BB and DW property in schema for specifying datawarp and burst buffer (#525)

options

ac831fdda6ad489571ba6abf58d4b61c13955556 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
job directives were added twice when using compiler schema. This was a (#524)

bug that was fixed by letting _write_test method handle the job
directive and call the generate...

f6f8a021565a1b8e3289b2dad1962fc585602c6e authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add csh, tcsh, zsh shell support in script-v1.0 schema. (#523)

* add csh, tcsh, zsh shell support in script-v1.0 schema. We can write tests
using csh and tcsh...

52f1679f5cc823279fb65c29cf7a108a799ff33f authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
bump version to 0.9.0 (#520)

remove Travis from documentation
update CHANGELOG
Add image for buildspec structure

d6e1d611fb8f0541e05d0b91c3526ec62e7faa6a authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
disable travis and enable comments in codecov (#519)

749d372af31f3bff35916fb51437107ca11fc69e authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Record job attribute in report (#517)

* query slurm job via scontrol show job and track this
in report. Add job attribute in report
...

9f9d5ac85602c3a87383958d10b1e1670dfb3f5a authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add buildtest inspect command for viewing test. (#516)

* add buildtest inspect command for viewing test.
Remove SSH Executor reference from codebase s...

2a20f07c67c52d8fda407ce299a21dc012b62750 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Update README.rst

9c75087412b93a140b6e0318b959120f6591919e authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Update CHANGELOG.rst

33ef4edd27c7d9ed7becd28128496059bff62ce1 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
add 'account' field in buildtest settings. This allows user to specify job account (#514)

to charge jobs. This field is passed by command line directly into job submission. We added
sup...

d655f4e2ad892f2b6d4c23d2b54bd1911818a987 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
update documentation (#513)

cc932869c6e7713e2171efaa92366cc79fc1b129 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
remove buildtest config edit command (#512)

move editor, buildspec_roots to top-level out of config section.
Fix schema examples.
add argu...

b6c96e90a7aa081ccc270683fa86e632f95a3572 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
rewrite configuring buildtest page. (#511)

Add example using max_pend_time field where buildtest cancels job

0e25e35e80d956bacf711e2758c734939eca773d authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
initial attempt to implement max_pend_time configuration for LSF

1a56b7b92a6e1d379f1e897dfeada3e97f536b49 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
test functionality of max_pend_time in LSF cluster. We successfully tested

one job cancelled once it reached max_pend_time via bkill.
There was an issue installating buildt...

5ab4cd6a24abe4511c9d057ed503b4058b434595 authored about 4 years ago by Shahzeb Siddiqui <[email protected]>
Max pendtime queue to cancel jobs in Slurm (#509)

* add max_pend_time value in schema to cancel job if job reaches max pending
time this is used ...

bc00eff2d35fd58598cd23af186faa4fb6eaafaa authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
change unique testid behavior, add support for --rebuild option (#508)

* We changed unique test id as date timestamp to a uid using uuid.uuid4() the
default is 8 char...

a02959f013ac0d4f062b1c0f9857f660f725510a authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add property run_only in jsonschema definitions this is inherited in script (#507)

and compiler schema. There are four fields - user, scheduler, platform, linux_distro.
The run_o...

077144091db1deb2e6018de9da14a3029cb5ab71 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Update contributing docs and minor updates, enable Travis again (#504)

* remove Travis badge
Add section on Coverage, Coveralls and CodeCov in contributing docs.
Mov...

ed94f594f71f2f333a9aadcbc3bb0e2f5de37d7f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
disable travis, add setup.csh for CSH installation and update CHANGELOG (#503)

* disable travis build by changing filename
add setup.csh script to install buildtest for tcsh/...

d4a55102504898b24c399bf5a30f5e707e5c58d0 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add option --validate in buildtest schema. Change behavior of --examples to now (#502)

only show schema examples previously we validated the examples. Now these options
are separated...

fdd1f28518e9c35a25e5b1ec258ece489299574c authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
fix bug #500 when finding tags in buildspecs. Regenerate docs (#501)

e5abedbc12c2bda34bb92e0b6a2d3f4fdd63a5ea authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
Tests are now run directly previously they were invoked via bash generate.sh. The shell (#499)

and shebang field both customize shebang line. We had to modify shebang line
when using shell: ...

76a60d668ad34c34f72b4d402f7abfd1ce7f381e authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
add lsf tests for lsinfo bugroup bqueues bmgroups bhosts (#498)

33f8351ec92c02449e0cd668cfcac6df4246b871 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
adding generic tests (#497)

* Move buildtest/docgen/main.py --> scripts/docgen.py
remove __init__.py since there is no sour...

53683130b16858cbe19a7e2a6113d7dc36ffc27f authored over 4 years ago by Shahzeb Siddiqui <[email protected]>
update documentation (#496)

* add documentation for tags and examples for valid and invalid tag examples.
Add explanation o...

730de1211e8e1ceaf58c2bf77fc5db6d5b7fd411 authored over 4 years ago by Shahzeb Siddiqui <[email protected]>