Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/chaoss/grimoirelab-elk


https://github.com/chaoss/grimoirelab-elk

[enriched-bugzillarest] Change logic to calculate `timeopen_days`

This code changes the logic to assess the number of days a bug
is open. It relies on the attribu...

186c77c15753e1afb120d742849b5a628cffbe33 authored almost 6 years ago
[enriched-utils] Fix last enrich date calculation

This PR fixes the last enrich date calculation. The
previous logic was calculating the minimum v...

52e9be1474d7edf7c7d0bb1c767f86ca8eec1379 authored almost 6 years ago
[enriched-utils] Add filter raw text to retrive last enrich date

This code includes the text representation (taken from the projects.json)
of the filter raw to t...

1790e835f3b347ad1ffe51453b6627045efbe17e authored almost 6 years ago
[elk] Use filter raw info to assess last enrich date

This code passes the text representation of the filter raw
to the function `get_last_enrich` in ...

32370712b84154c6223a357e76260826117d25a8 authored almost 6 years ago
[enriched] Add metadata filter raw to enriched items

This code includes a new field in the enriched items,
`metadata_filter_raw`, which allows to lin...

f3e658f05a35cdd38089802c78f8bc926cdaea70 authored almost 6 years ago
[enriched-enrich] Add `metadata_filter_raw` method

This code includes a new method to set the filter-raw
information included in the projects.json ...

59e442cb0ce838ff9444c47486335bf5bc82c253 authored almost 6 years ago
Update version number to 0.49.0

Signed-off-by: Santiago Dueñas <[email protected]>

6069ec12208f74893653a845fcaa864282dd1a0d authored almost 6 years ago
[raw-jira] Update raw mapping to avoid immense term errors

This code modifies the raw mappings to handle comment bodies
longer than the maximum length allo...

45a5b7cb594c2b79209558fcdde8007ed3bf718e authored almost 6 years ago
[elastic_items] Add method `set_projects_json_repo`

This code includes the method `set_projects_json_repo` to
the elastic_items which allows to stor...

1814b98eb0db27157de28f8b6ddcbe193e45758e authored almost 6 years ago
[elk] Set value of `projects_json_repo` during enrichment

This code sets the value of projects_json_repo during the
enrichment phase (`enrich_backend` fun...

6d4f00098cb4709c85f6272e506d3038b04eaba4 authored almost 6 years ago
[enriched-enrich] Refactor `find_item_project` method

This code refactors the logic of the method `find_item_project`,
which now relies on the variabl...

77ec7b9c39abbdc37b06f9dbd0a3d34557f6dcf9 authored almost 6 years ago
[elk] Set value of `projects_json_repo` during collection

This code sets the value of projects_json_repo during the
collection phase (`feed_backend` funct...

6c9249a4040e67df726eda1b7c85b45da7691082 authored almost 6 years ago
[elastic] Check presence of `properties` in mappings

This code checks the presence of the attribute `properties`
in an enriched index. This check is ...

e4bd6e087b7caf461ef7476c01ff6a199a33d6f0 authored almost 6 years ago
[enriched-jira] Add comments to enriched index

This code includes Jira comments to the enriched index. To do
this, changes have been made to al...

5e25209b3b13135253db6ae7ee37e9437f24dcde authored almost 6 years ago
[elastic_items] Handle commas in filter-raw

This code allows to handle commas defined in the values of the filter-raw param
within the proje...

6c4890bb43d46acdb7b3fcc2802f62cd558228f4 authored almost 6 years ago
[enriched-gerrit] Use grimoirelab-toolkit calls

This code replaces datetime, time and dateutil.parser calls to equivalent
calls of grimoirelab-t...

15fbc6f6d0022887ce5d7f1704d8927259aa0f43 authored almost 6 years ago
[elk] Handle empty sh uuid attributes

This code allows to ignore the uuid attributes which contain
empty values, thus avoiding ES erro...

23a29f9cd435377090635f337c9f34e01a4dac68 authored almost 6 years ago
[enriched-git] Fix handling rev-list command error

The try..except block including the rev-list call in the
method `add_commit_branches` is extende...

277fb86849421c46ed651e0c4e847e7ad9df00a4 authored almost 6 years ago
Merge pull request #603 from chaoss/alpgarcia-add-mising-cell

Update row with missing aggregatable value

67e906b517604b0de0b75c711c3b64ffaae9732c authored almost 6 years ago
Update row with missing aggregatable value

Signed-off-by: Alberto Pérez García-Plaza <[email protected]>

297dcdc7499e172cafd4ccae0390235503411d80 authored almost 6 years ago
Update version number to 0.48.0

Signed-off-by: Santiago Dueñas <[email protected]>

2e7b2ae6c9aac501cde50c9464d025309c235480 authored almost 6 years ago
[enrich-meetup] Avoid failures when 'rsvps' field is not available

Due 'rsvps' is a classified field, it might not be available
when items are retrieved. So far, t...

217e782654deb9bd9a3d9dc51837a74f187f1af9 authored almost 6 years ago
[enrich-git] Handle rev-list command failures

Calls for the git command `rev-list` are wrapped in try..except blocks
to deal with production e...

bcddecb9bf25cece405a90cf2104ed3d4e9fd31e authored almost 6 years ago
[enriched] Fix missing ancestor title in confluence enriched items

This code handles ancestors which miss the title attribute. Tests
have been provided accordingly.

672f45f6710847033bb0fe16b1fdd835027f7982 authored almost 6 years ago
[elastic] Get all attributes in index

This code includes a new method to retrieve the list of the attributes
contained in a given index.

bda0c97a4ffb92b02f2da8d69f7029e376071bd4 authored almost 6 years ago
[elk] Add methods to delete identities

This code includes tow methods to delete identities from SortingHat:
- `delete_inactive_unique_i...

7cefce30325c4b874c4fbb222847e9298fcfb47a authored almost 6 years ago
[sortinghat_gelk] Add method `unique_identities`

List the unique identities in SortingHat.

a99f5b06f4ff12f8aaee45d0efcb4d605493476d authored almost 6 years ago
[sortinghat_gelk] Add method `remove_identity`

This code add the method to remove identity from SortingHat.

0f5ba0b3b6188486b80ed63af2f08ca38cdac5c1 authored almost 6 years ago
[elk] Fix docstring in `do_studies` method

This code fixes the docstring of the variable `retention_time`.

7bf3e609670d3c55be798d4b0186c492e3a3f28a authored almost 6 years ago
[sortinghat_gelk] Add method to remove unique identities

This code includes the method `remove_unique_identity`, which
allows to remove a unique identity...

95c36e86b4b917077f13f6aebf970a9df440b901 authored almost 6 years ago
[elk] Retain identities based on identities index data

This code allows to delete unique identities in SortingHat
based on the information contained in...

e1ef0725e9f0b7c6517efd49cacb0a2f1301bf21 authored almost 6 years ago
[elk] Store identities in use in dedicated index

This code populates the index `grimoirelab-identities-cache`
with information about the unique i...

7846bf16f58675ba874e1e6d1196304072ca9e72 authored almost 6 years ago
[utils] Add param mapping to `get_elastic`

This code adds the param `mapping` to the function `get_elastic`.
This change is needed to allow...

f53a4808ab69ce1703e134ea7c536f6c4828bd98 authored almost 6 years ago
[elastic] Refactor method `delete_items`

This code moves the logic to calculate the retention date (based on the
current time minus the h...

dd74976b91613cd34ab7828c33d50f7f214383ea authored almost 6 years ago
[enriched] Add function `get_diff_current_date` to utils

This code includes the new function `get_diff_current_date` to
calculate the time minus the numb...

4592f32f264f6330973a780180b3199e551f6760 authored almost 6 years ago
Update version number to 0.47.0

df0cf56e3921df1fbb99319aa115dc5883f74a30 authored almost 6 years ago
[tests] Update finosmeetings test data

This code updates the finosmeetings test data, which now includes the
`cm_type` info.

0a2532bb14f92fe53d21cfb89b235724a8c5be77 authored almost 6 years ago
Update version number to 0.46.0

000cfe0817b1c00e51380943f77458034d8a153d authored almost 6 years ago
[finosmeetings] Change project value to cm_title

This code sets the project value to the cm_title, which was
previously cm_program.

358621fd33022f3be54fccaf562e176a286edfde authored almost 6 years ago
Update version number to 0.45.0

381bc4b575b7cbbcf5d0dea9166dc7bd8a8e587f authored almost 6 years ago
[elk] Handle filter-classified param

This code allows to pass the value of the filter-classifed param
defined in the setup.cfg to Per...

210e877b5419d11487278547bb592ae2f7138e81 authored almost 6 years ago
[meetup-enriched] Prevent to access filter-classified attributes

This code includes a check to avoid accessing the filter-classified attribute
`group.topics`, wh...

3dd7993afcb0ba8886979de80bf0bd7c0e315342 authored almost 6 years ago
[enriched] Set project name to cm_program for finosmeetings enrich

This code sets the cm_program value as project value for enriched
items of finosmeetings.

bf277406b13e52bb829eb3e24784c4f76fedc02f authored almost 6 years ago
[enriched] Add sortinghat identities info to finosmeetings

This code includes the information about sortinghat identities
in the enriched items for the fin...

7393ccc43ce3572a99ea6d9afb8b28f760afa681 authored almost 6 years ago
[enrich] Prevent timeout when using ElasticSearch DSL

This code adds the param `retry_on_timeout` when initializing the ElasticSearch
DSL object, thus...

c55aa4d26663de0ac485dabfd054a169e46a2179 authored almost 6 years ago
[enriched] Fix `Too many dynamic script compilations` in git enrich

This code fixes the ElasticSearch error `Too many dynamic script compilations`
which occurs on t...

10688a3b5eae0b6cf7186e18e656333fdaf54b70 authored almost 6 years ago
[jira] Handle missing fields during the enrichment

This code handle missing fields that are used to create the
enriched items. In particular, it ch...

a27ac1edbd4036fa8c70a10cbb2a2958af8e9eaa authored almost 6 years ago
[jira] Handle multiple type values in `release` attribute during enrichment

This code adds the mapping to the Jira enriched items to avoid ES mapping
errors on the attribut...

2497f47958f54ca49a678cdf2edab5b385bc2359 authored almost 6 years ago
[stackexchange] Handle missing `answer_tags`

This code handles enriched items not having `answer_tags` field. Thus,
it prevents the error Key...

5b2685903a422e1e8d5be2b578df5e789d558b6a authored almost 6 years ago
[enriched] Apply retry mechanism HTTP 504 errors

This code allows to extend the retry mechanism to the 504 HTTP errors.

ccfdc700cd6fa3afedf751fd89626342f7485e4e authored almost 6 years ago
Update version number to 0.44.0

70275cce28c6e4cb63c169520a0846fe5147bb81 authored almost 6 years ago
[tests] Update finosmeetrings backend test to the new schema

Due recent changes in FINOS Meetrings backend, some of the fields
of the raw items have been ren...

3fd86759f492f8f061dea7b5b5656a9ef28b362d authored almost 6 years ago
Update version number to 0.43.0

5a543a9dba6dfba95ea88b826916dea37bf3c57b authored almost 6 years ago
[utils] Change assessment of last enrich date

This code changes the way how the last enrich date is calculated. If
the enriched index is empty...

a471c1a4a79a6ad37befe455d1f44e8efed84baa authored almost 6 years ago
Update version number to 0.42.0

8c8ffc1c505327474711621a401087534faf472d authored almost 6 years ago
[enrich-github] Add url field to enriched repository items

This commit adds the missing URL field to GitHub repository
items. Thus, it is aligned in data w...

b1c686cd4075bcebe3d5217d1b98a37926e9f0aa authored almost 6 years ago
[elastic_items] Add set_from_date method

This code includes the method `set_from_date` needed
to set the last enrich date obtained before...

559795815fcf9ced5e57d79de718c2b281239cae authored almost 6 years ago
[utils] Use `last_enrich_date` for incremental enrichment

This code allows to use the value of the `last_enrich_date` (obtained
before enriching a set of ...

bad7172326070743c126e52d2e602769eb26c9f2 authored almost 6 years ago
[elk] Add `last_enrich_date` to enrich_backend method

This code allows to pass the value of the last enrich date
for a given index to ELK. Thus, it al...

e6238f45a3b40b8005d9934abd8fcb67e89a91eb authored almost 6 years ago
[schema] Add demography fields to Git

03b21d72f8ecebcaf495ca5ee53d957d5b249949 authored almost 6 years ago
Update version number to 0.41.0

962a4e16322387abca176cf813daf3027c37df92 authored almost 6 years ago
[utils] Add connector for finosmeetings Perceval backend

This code includes a new connector to be able to fetch and
enrich data coming from finos meeting...

83dc542c295129452b12f931cdbce2a6b306c190 authored almost 6 years ago
[raw] Add connector for finosmeetings

This code includes the connector that is in charge of storing
the data coming from finosmeetings...

73b8707e4c6bc0d096de2215c5dd52ddcb936f18 authored almost 6 years ago
[raw] Change mappings to convert `date` field to keyword

This code changes the mapping of the attribute `date`, which in some
cases is not a well-formed ...

74556979c0b59ab173ff178662376b4ff877de91 authored almost 6 years ago
[ELK] Rename finos_meetings to finosmeetings

For consistency reason with the corresponding perceval backend,
the connectors have been renamed...

fabd0e7f0586b57760dd8ca48f4245668859b212 authored almost 6 years ago
[enrich] Add connector for finosmeetings

This code includes the connector that is in charge of enriching
and storing the obtained data, f...

ccecadaae4be22d37ba8da510f7e3a8a92bb374b authored almost 6 years ago
[requirements] Add perceval-finos to requirements.txt

This code includes the repo https://github.com/Bitergia/grimoirelab-perceval-finos
to the requir...

f6334a671e88a8f53c9a375d91dfb74a2cbc6cd2 authored almost 6 years ago
[tests] Add tests for finosmeetings

This code includes tests to check that the collection and
enrichment of finosmeetings data work ...

eb1a593a2e850038cea02d56ae43ad466d2ac9f1 authored almost 6 years ago
[setup] Add perceval-finos to install_requires list

This code includes the dependency for the new perceval for finos
`perceval-finos>=0.1.0`.

2210d2fd0daa47538ff776304691232180ee4c10 authored almost 6 years ago
[enrich] Change mappings to convert `date` field to keyword

This code changes the mapping of the attribute `date`, which in some
cases is not a well-formed ...

f593e86c41eba63e7899a154500a331795a9c97b authored almost 6 years ago
Update version number to 0.40.0

845a6f10699a8d104eb29e6f2bbf175df0e2d416 authored almost 6 years ago
[utils] Add missing header to run scripts as Python scripts

a6fb9368556070bd6353c2481f26cd59eae39739 authored almost 6 years ago
Merge pull request #577 from valeriocos/fix-project-field

[elk] Handle project name for filtered repos

355444156a9cdb592fae6bf6dbaa8f2c3f9157b2 authored almost 6 years ago
[enriched] Remove `get_item_project` for bugzillarest enricher

This code removes the redefinition of the `get_item_project` within
the bugzillarest enricher. F...

8adefc7519950fceb11658d0aa0e0b7c8209e4ef authored almost 6 years ago
[enrich] Assign default project name to repos in unknown section

This code assigns the default project name `Main` to the items coming
from the repos included in...

44f04db42fe74eea47c3d9128d5cfb14cd842b8b authored almost 6 years ago
[enriched] Update `get_project_repository` for bugzilla enricher

This code updates the logic of the method `get_project_repository` within
the bugzilla enricher ...

07940eb9abd08efb208ac97b0f70a612f8ffe60d authored almost 6 years ago
[elk] Add filter raw info to enrich backend

This code sets the filter raw information to the enrich backend. The filter
raw is needed to be ...

fe6e5e3d7b3653a2864d5d980291c921fe80efac authored almost 6 years ago
Update version number to 0.39.0

2140b8f6f4230a3cc3bc2e4f17ff54c75cf4f54c authored almost 6 years ago
[enrich] Add onion study to gerrit

This code includes the onion study to gerrit. Thus, now an onion study
can be defined via the se...

f28b6d5faec7e69005ab24f01d85494b0069909c authored almost 6 years ago
[p2o] Add None value for param `cfg_section_name` to p2o

This code includes a none value for the param `cfg_section_name`, which was
recently added to th...

62e6b8a39a0b99ee8f1a888ca114343b8cd96442 authored almost 6 years ago
[enrich-confluence] Add ancestors data to enriched items

This patch enriches Confluence items with two new fields related
to ancestors data.

The field '...

23c5e371b6ee527f75d60e155989d1eff5ed22a8 authored almost 6 years ago
[utils] Set default value for variable analyzers

This code allows to set a default value for the variable analyzers, used to
initalize the elasti...

44e746131228d53bba478b7044c5ffadea66e687 authored almost 6 years ago
[elastic] Add method `delete_items`

This code includes the method to delete items from an index before a given
date. This change is ...

e7a208b66a83b3b28bdec5e43ccc5690649673ec authored almost 6 years ago
[elk] Apply data retention policy to study indexes

This code allows to delete data from indexes created by studies. The
deletion is based on the pa...

1eb9202a009eef3fc1789f3475fa8302b40659a8 authored almost 6 years ago
[enriched] Add refresh param to update_by_query and delete_by_query

This code appends the refresh param to the update_by_query and
delete_by_query calls, thus preve...

44d8c18b5ad904fc1ae24ce4cea5239c5234dd4f authored almost 6 years ago
[elk] Remove filter-raw-* for enrich backend

This code removes the filter-raw and filter-raw-prefix which were set
in the `enrich_backend` fu...

fe2b07d8c4e0ff2e1d56416c1d1a2fe419770a71 authored almost 6 years ago
[enriched] Handle hidden editors in mediawiki revisions

This code handles revisions which have their editor hidden, which
are marked as `HIDDEN_EDITOR`.

d2725520e24a8590be592e8426c555dc81899dee authored almost 6 years ago
[raw] Prevent mapping of data.ancestors.extensions for confluence raw items

This code prevents to index the data included in data.ancestors.extensions
in order to avoid par...

185b9a44bc735b096713da42d4c158fc7056ec6e authored almost 6 years ago
[elastic_items] Support for filter-raw-prefix

This code modifies the way of filtering data based on prefixes. This
change is needed to due the...

21ac0dc6ac3b38cee7735798c8a56f0eb80f24c9 authored almost 6 years ago
[raw] Remove `get_p2o_params_from_url` from Confluence raw connector

This code removes the method `get_p2o_params_from_url` from the
Confluence raw connector...

2b7f1800b6e696bcc18f819baf3d457d18a8d63f authored almost 6 years ago
[raw] Remove `get_p2o_params_from_url` from Git raw connector

This code removes the method `get_p2o_params_from_url` from the
Git raw connector. which now use...

f7df2271ce7c7b522235f577de0368a8c901d68e authored almost 6 years ago
[enrich] Remove raw filters when getting last enriched item

This code removes the raw filters from the filters used to
identify the last enriched item. This...

41a4c1ed20dc4abe87ea08ce34ed965e66b900f2 authored almost 6 years ago
[elastic_items] Support filter on multiple attributes

This code allow to support the filtering of raw data using
more fields.

9d2e3e132f79c8cb302988cc9869467e9129ed32 authored almost 6 years ago
[raw] Remove `get_p2o_params_from_url` from Jira raw connector

This code removes the method `get_p2o_params_from_url` from the
Jira raw connector. whic...

fc1d064ecaf99f305650cf311c1c08db4f30c25e authored almost 6 years ago
[elk] Remove logic to create filters

This code removes the logic to create filters which is now
included in the elastic_items.py

c854d98a9dc7791e4afb5ba08e4719e647291f7f authored almost 6 years ago
[raw] Remove `get_p2o_params_from_url` from Bugzilla raw connector

This code removes the method `get_p2o_params_from_url` from the
Bugzilla raw connector. which no...

697e4e06805b951b122a4faf99cbeecfa6432031 authored almost 6 years ago
[raw] Remove `get_p2o_params_from_url` from Askbot raw connector

This code removes the method `get_p2o_params_from_url` from the
Askbot raw connector. which now ...

6afe5f8b4a1e478c25a93b24ec607a7e297ad72d authored almost 6 years ago
[raw] Remove `get_p2o_params_from_url` from Gerrit raw connector

This code removes the method `get_p2o_params_from_url` from the
Gerrit raw connector. which now ...

8ab6d5f64ab6021e481b6efec7120217ae61ec98 authored almost 6 years ago
[tests] Add tests for `get_p2o_params_from_url` method

This code includes tests to check whether the method
`get_p2o_params_from_url` is able to parse ...

f4b083a49c484ee9af3c871ff539bd7e8a8b6231 authored almost 6 years ago
[raw] Parse filters passed in the projects.json entries

This code allows to parse the filters declared in the
projects.json entries. This code applies f...

4b0fc13679dbb13de7aafe372de59fef6c2a5050 authored almost 6 years ago