github.com/chaoss/grimoirelab-sirmordred commits

[config] Add a set_param method to change a config param

4c66ee48663f5f993423c29f8f629042943400f6 authored over 7 years ago

[projects] Remove DEBUG mode. Use tests for debugging.

a4ae5b9842d38abfb7e09bd1d6d4592992e0d3a9 authored over 7 years ago

[tests][projects] Add tests for TaskProjects

73cf398d3bc1deee3f87687d15ff70ada5f63ced authored over 7 years ago

[projects] Add support for getting the diff when updating the list of projects

a346fc46c487464e220d0434823bbbaaec5108df authored over 7 years ago

[projects] Use Lock to control access to the shared TaskProjects.__projects variable.

When getting the TaskProjects.__projects return a deepcopy of the dict so
it can not be modified ...

77923a6e33c69143686539a0fe770ccf4644834e authored over 7 years ago

[projects][eclipse] Drop IRC support

fcba434fce3eaaaf7f202d778669f18d2d5fbec0 authored over 7 years ago

[mordred] Add support for only collecting and enriching from bugzilla, bugzillarest and gerrit data sources

when they are included in the project TaskProjects.GLOBAL_PROJECT

Those data sources are downloa...

5f7b07d0a53b1913e6c3f0c99ae1972bb1c67efa authored over 7 years ago

[task_projects] Complete the Eclipse projects support

2c35afc46ebf95ed2e454993b5d7c2e796dd5bb3 authored over 7 years ago

[mordred] Config refactoring, logs refactoring and dynamic repos support in collect and encrich

[tests] Update tests to support the new config API in all places

c9fb56f715149eeef71c1ba4cd93466c1a2d5a6d authored over 7 years ago

[task_projects] Add the new TaskProjects task which manages the projects data for a dashboard.

This tasks just reads a file with the projects info, or get the information
from Eclipse project...

8cd6bf2e6492ce4c4d1dbb390634b62f21cd8c1d authored almost 8 years ago

[release] Add new elasticgirl.5.1

cb4475d8c963856a421fc8f049b373f6b8522e6c authored almost 8 years ago

[release] Fix GrimoireELK version included because a potential memory problem in mbox enricher

30bf14db6ccd44d48628eb7964365baeeb1b3c17 authored almost 8 years ago

[release] Add new elasticgirl.5

fdf45d9832fbb431d515670babf6eef277b6ceed authored almost 8 years ago

[config] Add new method get_data_sources to get the active data sources in a mordred config file.

Used in reports and clearly interesting in general to get the active data sources
in a mordred c...

b58cf0e3d7e5ffd163acc88ce42fcf60f51e6dbc authored almost 8 years ago

[release] Add new elasticgirl.4

4f53892cd3ed3f4ad58ec42704e436f49e642fdb authored almost 8 years ago

Revert "[mordred] Improve how logs are shown from mordred main file"

This reverts commit b10a72250dd35d86590a040c04feddf623769647.

With this change no logs are show...

3adfd4738b11d239a20d0e41c55e4c8c1f42d160 authored almost 8 years ago

[config] Add type checking for all config params

b62d5e37b94effe71db6168160ad8b4be5747bc9 authored almost 8 years ago

[test] Fix test config file so all the param types are right

15d7480e38a0ed33d3b5e30fc77fe27f5f00b110 authored almost 8 years ago

[config] Break down config so task config could be moved to each task class

538afa1f698fb769323c1eb4937c451c7ead2fc3 authored almost 8 years ago

[mordred] Improve how logs are shown from mordred main file

b10a72250dd35d86590a040c04feddf623769647 authored almost 8 years ago

Update README.md

2aebeeeb887d819ca661b099ad30b6df3d5c3613 authored almost 8 years ago

[test] Add git github and stackexchange data sources

c881f0b0c5386fc3d5bb0443b94681c6ddb78e46 authored almost 8 years ago

[test] Upgrade all tests to work with new config system

2712b21d3113ce35818613787bcb409d17fc4a87 authored almost 8 years ago

[config] Remove github_token param from global section

23233d0dcc83b9403601bd01993adf5fd8a63870 authored almost 8 years ago

[test][projects] Don't use filter-raw in git in order the test_enrich_all.py works

afeae473310b33969dc66092e12114a0de808070 authored almost 8 years ago

[mordred] Add a new option -p to execute the a list of phases different from config file.

In this use case the update param is set to True to execute only the first iteration
in mordred.

0e6b6f4908b389112b439d35a9f41ffb648dead3 authored almost 8 years ago

[track_items] Add options to configure raw indexes for git and gerrit upstream data

0a94d7b1126531fb8307764632c974f587be1582 authored almost 8 years ago

[task_report] Change string to raw string so sed command is executed correctly

ce6e888231800c17271ad04b3102c7e1e91b0ec7 authored almost 8 years ago

[task_track] Pass mordred sortinghat hat to track items enrichment processes

715a3430d23ea83405c6bd50d36bb3275d698009 authored almost 8 years ago

[release] Publish new release elasticgirl.3

594157f5e5ecfdb1bf45958ddb25b97c08b1f371 authored almost 8 years ago

[docker] Add reports dependencies: prettyplotlib and elasticsearch_dsl.

Fix pip3 install.

d25858fb02d9df235c12ec87ec82bf8c7805b66f authored almost 8 years ago

[docker] Add reports repository to stage script so it is installed in the mordred docker image when creating the container

78f80b69de5fbc0ec9d0a4b5c680775091281dd5 authored almost 8 years ago

[config] Fix optional_false params logic so they could not be present in a section

622dc3de831ddb5e1a9f0acc8fe95efdbc1c2737 authored almost 8 years ago

[track_items] Add a new config param upstream_raw_es_url with the ElasticSearch with the upstream raw items

3bb817db52a6d281f7714fbee86eb8cafad92440 authored almost 8 years ago

[task_enrich] Fix formatting

465fe5eb11986e95d4d1ef5866fa7bb058137300 authored almost 8 years ago

[Task enrich] Add unaffiliated_group to configure the name of the unaffiliated org name

9e308140d2767bc988724a16dd3c221797b45e9c authored almost 8 years ago

[report] Implement PDF report generation

3e5dbb8372350135558896a67f5e63f2956ea70c authored almost 8 years ago

[task_report] Initial version for report support in mordred

6b4c20dbd1e12ff989f6d8e9aa4a7ca03801ff2d authored almost 8 years ago

[task_track] Add new Task to track items upstream, including config and task implemetation.

acc23ab7137664f718dc7d00290d511d4b48a0dd authored almost 8 years ago

[mordred] Check that there are tasks to execute in update mode before executing them

0043d6e65a8b84b6bc1c733e28783805f7047ec1 authored almost 8 years ago

Clean unused debian packages (#22)

4132c217b183dc6ebd3e9b95c954f39a9c020af8 authored almost 8 years ago

Merge branch 'master' of github.com:Bitergia/mordred

a07fb1ba091973b149a1226ba6def8923abfcada authored almost 8 years ago

[config] Use string for defautl value for kibana version param

645e612e8bf3f04d962289af7cccbbbb0232abed authored almost 8 years ago

[task_panels] Fix how kibana config param is detected in new config system

d40a86daf8e529c7c242b8cb4171ae6c107450c3 authored almost 8 years ago

Install pandas package in the Docker image (#21)

0631bc4236fa4e9179936b27924d7c37b3bb49b8 authored almost 8 years ago

[release] Publish new release elasticgirl.2

d66eb603612b8209c4ee75a5178eb0ae8c7cf64e authored almost 8 years ago

[task_enrich] Fix log error message with a non existing field.

Improved log error message with the exception.

2b1e27dedf5894718f84854a7048b7eba7b8c104 authored almost 8 years ago

[mordred] Don't execute the initial load if it is not configured.

Code refactoring to help in the above feature.

9087d49b5efe908c0bf6c47618a5b24dead0d26d authored almost 8 years ago

[config] Add new param skip_initial_load to avoid executing the initial load and start directly in the update mode.

Add optional params to the config with their default value.

ef88060f66354c701dae438d9d3114859fcc9239 authored almost 8 years ago

[task_manager] Log as debug when a task is going to be executed

ea9feaeb6e554ce822fe42826f189a7a5a42fd6e authored almost 8 years ago

[task_manager] Log exception error directly from TaskManager to find error in logs during execution

eff9d1a0503d3494c2f9315dd6184bc847fab26e authored almost 8 years ago

[panels] Add new aliases to remo indexes to fix freshness issue with new index patterns T2394

b2626b74e748f83b0da84869989e2a4444399c2e authored almost 8 years ago

[config] Add missing params "identities_file" and "no_bots_names" with their implementation

ad429f5e9c2ca1e96675592c65045d03c43a5b74 authored almost 8 years ago

[config] Build list params for perceval using the new config values that are real lists directly

f839e6729f5faffb5de294c48bcad618639903d3 authored almost 8 years ago

[config] Implement list value format as [val1, val2, ...]

Fix some sortinghat config issues. All ready to be moved to production.

612f83f611141a2dffeabafbf22abda05cfa8d9a authored almost 8 years ago

[config] If a value is inside "" it is always a string

7617bdbc67da27d945594fa7cf6a77b4caa8155d authored almost 8 years ago

[config] Add support for None types, and to strings with , when start with ".

Remove not needed code for accessing config in the old way.

aba0903d7f482002bf95c8d1db4832d931947fc3 authored almost 8 years ago

[config] Add Config class, config testing, config generation and general refactoring.

9f47a4a151a188598f5701be8442720b1f687459 authored almost 8 years ago

[config] Move config management to its own class

de4b8ac4016ffa4472294dc61b28c13f0ecdd26c authored almost 8 years ago

[menus] Convert menu for kibana5 to use one level menu entries for Overview, Data Status and About.

The final format for the menu is: Overview, <Data Sources panels>, Data Status, About

8697865c8ad3169c76b663f9401a9f3c6c341257 authored almost 8 years ago

[menu] Readd TaskPanelsMenu so dashboard menu is created.

For some strange reason it was deleted in ea190e4710677c76f2dd5d6f3abfd53001ef4f78

a85eb0921c1a62cbd951233d53ec3d27138df322 authored almost 8 years ago

[panels] Support that in menu.yaml there are several entries for the same data source

fa0635bcf5feff575b9c820a98f293c093425ba5 authored almost 8 years ago

[release] Publish the new release of GrimoireLab T2246: elasticgirl.1

478d0c5f1b501ee50abf95b297b6c25625b7a7bd authored almost 8 years ago

[mordred] Change ERROR log with INFO log for a normal state in loading identities

9d8e0a28cd94f76dd470c20d02ddf374b0302caa authored almost 8 years ago

[docker] Add g++ in order to compile pandas installed using pip

d05eba737c926506a68f0ba4afcbffa44c06a3c1 authored almost 8 years ago

[tests] Improve mordred test config file to use simpler names for indexes

8d7b5c92d296e617867437c67077d32193f91c59 authored almost 8 years ago

[tests] Improve cache handling in complete enrichment testsing

7df31ee968933ba4eb911534391f90b4fba96492 authored almost 8 years ago

[tests] Extract perceval cache and do collect and enrichment one time in test_enrich_all.py

79d2efe3aa62367b5177655d28ba09936c5bbdc1 authored almost 8 years ago

[tests] Add tests for collect and enrich tasks. Add tests for checking the results of enrichment.

48585869011cb7f0fd5962e2d6c7f5931e63590c authored almost 8 years ago

[task_enrich] Use logger for logging messages.

94d0f1cc32b462ae80d64b4fb466d1840600a552 authored almost 8 years ago

[mordred] Convert _get_repos_by_backend to protected method so we can use it in tests

b795d0aa6c1da4f2a5bb8ddcf8abb20a4ef6a48f authored almost 8 years ago

[tests] Fix test_get_collection_url test

52b5bf9967ea2d017e810ac8aa37a84d85e3487e authored almost 8 years ago

Add support for the new param jenkins-rename-file to use a csv file to rename

nodes in jenkis.

3edd04dd60b5bef9660c649bbfbaf07eedce21bf authored almost 8 years ago

[release] Publish the new release of GrimoireLab T2181

46edc29d8a42fcb3262535469eb371d62032adfe authored almost 8 years ago

Add github.py library to deal with Github files (#19)

* Add github.py library to deal with Github files

Github instance will allow us to ready file...

61a6771d25cd4cd63ef61121175520fb6265c816 authored almost 8 years ago

Merge pull request #17 from Bitergia/fix_t2031

Improve the Exception handling for threads by using queues. Fix T2031

742ffec4c328903f5e06aaff98876d9ab0a50521 authored almost 8 years ago

[identities] Don't load identities if a backend does not have collection

d9d50a2841df4b2061f8d2a3feacb6ab5b3eb6d3 authored almost 8 years ago

[mordred] Evolve lcanas exception logging from threads for using

a shared queue created as a singleton (constant) in TaskManager.
Check for exceptions after tasks...

be63fe772cec0ccd37a85aff96dad9732ea827b5 authored almost 8 years ago

Merge branch 'master' into fix_t2031

f0bbc4337769be6b2a4cf3287958771e27db1ad4 authored almost 8 years ago

[release] Create dagger release

f4154b259c11b26c599d0b9d3b0e6e73b9f2478d authored almost 8 years ago

Add missing mordred/error.py file

7d054e8e6f219ec92e351e476309c740c3211863 authored almost 8 years ago

Rename Task method name run() with execute()

Method run() was renamed to execute() so we avoid the misunderstanding
with run() method used to...

c91737b11d8eff97dab43e1e845417acd87e8d0a authored almost 8 years ago

Merge branch 'master' into fix_t2031.

Manual changes in order to respect the new backend_section feature
and the communication queue w...

deb1817245798f5e8995303bc9a59b8ccef3ac70 authored almost 8 years ago

[panels] Use "-raw" as suffix for raw indexes.

Convert ":" to "_" for aliases in multidatasource sections.

0b48cb8554f8e09cd883cd3a31eac86c87c08cb9 authored almost 8 years ago

[task_manager] Fix the doc about backend_section

ddfc4631a394cee28d5c3a6bfc85ce8f8c8c097c authored almost 8 years ago

[multidatasource] Change backend_name to backend_section to reflect that this variable is

the name of the backend section in the config file (remo:activities) for example.

69be21a6c88b4aaf4e1abb53a865b680c4ac6be7 authored almost 8 years ago

Merge branch 'master' into multidatasource

c921596f02948dc6b79039573e635c63277dfef8 authored almost 8 years ago

[panels] Use the new location for panels in kibana5 at panels/dashboards5

7f42d4bb0c236865633f9f0b45de851f5e8a002e authored almost 8 years ago

[task_enrich] Add support for filters_raw_prefix so the raw items to be enriched

can be filtered using a prefix filter.

For example, to enrich only git commits in specific files...

ec27373e7aa6153ff42f9afc6d04948354166043 authored almost 8 years ago

[task_collection] Use real field name to avoid mistakes in API usage

64ae5f53bc9c7b290801a9fd804c484a5be5f43f authored almost 8 years ago

Merge branch 'master' of github.com:Bitergia/mordred

bf329f9398b3a47de88c1d81e44b0fe0a1eeb1c3 authored almost 8 years ago

[panels] Check that panels exists for a data source before using them

6c739a02410c66ddb2b558f4f94f9926d9218545 authored almost 8 years ago

[tasks] Add support for having more than one data source config for the same backend.

For example to have remo and remo:activities data sources sections
one for getting the events an...

22982279acd766c3b220617feb4f5fc887ebc3b8 authored almost 8 years ago

Update README.md

6fb47117fb75562d71cbcb3babdfb718a69b3c8e authored almost 8 years ago

[docker] Usa panels upstream once discourse panel has been added

b6689a95c572f923438b33870690f780c50dee57 authored almost 8 years ago

[release] Release GrimoireLab dagger.beta with improved raw filtering and Mozilla Club support

c5e331ca2a738974faaadbffb22f3049838b647f authored almost 8 years ago

[release] Add arthur alpha release to start testing the platform in production

3b9e06d170fadb0d28ed8fb72c820fb312d7cefa authored almost 8 years ago

[docker image] Start arthur and arthurw when creating the container

c9580c0c6b58a86438ca3bfd6ddc2a7934d0b2fe authored almost 8 years ago

[docker] Add python3-redis dependency needed by arthur

cf00dcfb1f959c4ed7c5bd4268f57cf4a19a5afe authored almost 8 years ago

[release] Publish minor release to add support for multiauthor in git committers

88e1a19afadef25799fa346c79189abaa832890c authored almost 8 years ago

Ecosyste.ms: OpenCollective

github.com/chaoss/grimoirelab-sirmordred