Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/chaoss/grimoirelab-elk


https://github.com/chaoss/grimoirelab-elk

[ocean] Fix mappings to index Bugzilla data

This patch prevents to index long and short descriptions of Bugzilla
issues, which may cause fa...

5439f829620afaec09532faf54a94d2b89ffcd0c authored almost 7 years ago
[ocean] Add Launchpad backend

This code includes the ocean backend for Launchpad

f74d81ad2955627e24b54cde9edb69ede1e6290c authored almost 7 years ago
[ocean] Add PuppetForge backend

This code includes the ocean backend for PuppetForge

175079e0c3dd3c0f858162f9620e1ca7f749dd77 authored almost 7 years ago
[ocean] Add GitLab backend

This code includes the ocean backend for GitLab

70532d939ea86f5bc14aca5428e17389acb1d4ee authored almost 7 years ago
[elk] Remove gmane connector

This code removes gmane from the connectors, since Perceval and
Arthur don't provide support for...

47604dc2c000fed1b3fcf79924ee95fa466838e5 authored almost 7 years ago
[ocean] Fix mappings to index GitHub data

This patch prevents to index the body of GitHub issues and
their comments to ES, which may cause...

425b9f1856c88aa1595a7361797138316478c122 authored almost 7 years ago
[tests] Update tests data

This patch changes how the tests for loading raw and enriched
indexes are done. Furthermore, it ...

7a539c25897667a6f25708f7ea620551f4e6a306 authored almost 7 years ago
[elk] Update enrich_items method of Kitsune for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

b62b0b5a5d64bc88780bf634c4fe2361c5352914 authored almost 7 years ago
[elk] Handle NNTP uppercase Date field

This patch allows to handle through the MBox backend the case
when the Date attribute of the JSO...

1afb0b0be490fa02caf4d84d1ff179e020696477 authored almost 7 years ago
[elk] Update enrich_items method of Mediawiki for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

e5ad870f337ab298aac3dba0558cc869ea1f473b authored almost 7 years ago
[elk] Update enrich_items method of Meetup for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

8a7e92584a0abdca2392e06de7be1bbec0a92e92 authored almost 7 years ago
[elk] Update enrich_items method of MozillaClub for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

583c9769a5b33545d88c94d75fd64d51f6f4fcbf authored almost 7 years ago
[elk] Update enrich_items method of Stackexchange for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

e1e850b7350f33456978399744d1eccf603a3ae2 authored almost 7 years ago
[elk] Update enrich_items method of Dockerhub for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

a811cea9d3a6001386cadbf7f2f5bd32c76641a0 authored almost 7 years ago
[elk] Update enrich_items method of Discourse for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

908976eae9200d35e05871990a615cae6ffb0893 authored almost 7 years ago
[elk] Update enrich_items method of Askbot for new tests

The enrich_items method should return the number of items
processed. This value is then checked ...

5bb8ef819da717299f4c32c7ec56f789af0db6aa authored almost 7 years ago
[ocean] Add warning when json items are not inserted to ES

This patch adds warnings to the method _items_to_es within
ocean/elastic.py. It is thrown when a...

cbbf5427cef320f4b9a17f3e9f321a72188da974 authored almost 7 years ago
[enrich] Track storage exceptions when uploading enriched data to ES

This patch enables the ElasticSearch component to handle storage
exceptions when uploading enric...

281b62e8f9b94d7eaaee131422a9fa447d9279c2 authored almost 7 years ago
[travis] Add delay to make ES start

This code introduces 15 second delay before the build script
starts to let ElasticSearch starts....

99c2ed141ebf351a6ce7db8747dc45c27c259205 authored almost 7 years ago
[enrich][crates] Return always a correct SH identity

3fca74bffcfafb7dbcaa5a9005d30775937e0785 authored almost 7 years ago
[enrich][git] Use git_uuid field in the case of pair programming

5509feb3134e7d105b175e4280168ff613c63bd2 authored almost 7 years ago
[enrich][git] Add a new param pair_programming to activate this enrich feature

4152bac5f44d2cfae08b7ee1a2edff74b23508d9 authored almost 7 years ago
[enrich][git] Don't use git_uuid as identifier yet because is not available in legacy enriched indexes

a5fa31a5df9e1dd06cdc795bb578b3b2f36bec3f authored almost 7 years ago
[jenkins] Remove data.changeSet.items.comment from index

This fix prevents to index the comment on a changeSet. Due to
some large comments on changeSets,...

911275aeba1f8425713c6ae08435524409135d58 authored almost 7 years ago
Merge pull request #173 from acs/refresh-identities-git-p2p

[git] Fix for refresh identities in pair programming git

8cc6201a579831cd9c72acb0fb40ec2ea1904230 authored almost 7 years ago
[enrich][jira] Include release field in enriched index

23244f49ed87d86185f64595bd7f4de2956b5681 authored almost 7 years ago
[enrich] Remove not needed comments and debug trace

5dfc21d84b776be6b8f97f4d4144cbbf07602e87 authored almost 7 years ago
[enrich][git] Add git_uuid field which is unique id in pair programming

In pair programming a commit (uuid unique identifier) could generate several
commits, so the uui...

db71025c6ecfe7873aaaac049f3e81aee0d2d456 authored almost 7 years ago
[flake8] Fix flake8 issue added in a hot fix directly to master

f79c72654d3922ca65dee0c142e06ada2eccf35d authored about 7 years ago
[enrich][git][demography] Fix the demography study logic so it works in incremental mode always

The key is that the new enriched commits are the ones that don't have
the demography study field...

8521e68763dd06eb1dc7b8ea4ddbccd49ab11106 authored about 7 years ago
[enrich][slack] Don't convert boolean fields to int in SortingHat fields

d095787a7540f01e7cb7290d4afc9e7e81c447d7 authored about 7 years ago
[elastic] Track exceptions when uploading data to ES

This patch enables to handle/track ES storage exceptions,
which were ignored before.

637274fa9387926ef359d4efc0b9274678d0c63c authored about 7 years ago
[enrich][git] Add a new field git_author_domain with the email domain for the Author of the commit

8956866d9347dad91258aad2fe4f143ad6c3b1d9 authored about 7 years ago
[enriched] Fix stale print command.

A print command was included for tracing. This is just to remove it.

adbddf6a4f49bdcce09aae2c673486cf6b2b5f66 authored about 7 years ago
[release] Update version number to 0.30.23

cbe790508f8519517d520e28dad9f339e81f8e3e authored about 7 years ago
[enriched] Ensure that we have a method for refreshing whole indexes

Add code so that when refresh_identities is called with Null as
a parameter for the filter (or w...

09cffeec53a784d6b6e886fb1678df64a4acb284 authored about 7 years ago
[ocean/confluence] Filter out body.storage.value from index

This patch allows to filter out the indexing of the body content
for confluence items. Thus, avo...

9466316a204331e05641e94ddd3dfe6c490e4823 authored about 7 years ago
[utils] Retry by default total times = connect error times

40b02dd0aef04eaf97184fdc9bdbf6508cc4400d authored about 7 years ago
[elastic_items] Remove log error when there are no items or the items index does not exists yet

In arthur scenario it is normal that we try to enrich a data source
from which the index raw is ...

a88ae1b3bb6e60bec504f45f88e762a9245e03d1 authored about 7 years ago
[ocean][pipermail] Define the url and dirpath params needed by arthur when using pipermail

9b985f3341e63a52a639f337ead44355cb90c8ff authored about 7 years ago
[enrich] Add missing headers in PUT queries to support ES6

d236d0ef860ecfdb776b48412913363ba15f85ce authored about 7 years ago
[enrich][phabricator] Fix enricher when an item has an array with None as first item of projects

c86201d57449ff88afcfa532012b9bc28389bad4 authored about 7 years ago
[release] Update version number to 0.30.22

bf76647ecb4602d3b69ac0d040b26136d367f1ab authored about 7 years ago
[elastic_items] Remove empty intial filter because ES 6.x does not support it

This query which works with ES < 6.x does not work anymore:

{
"query": {
"bool": {
...

d5bb1b46a4ebd19ee0a8b7bc57307f40135efb4b authored about 7 years ago
[release] Update version number to 0.30.21

88acf8a4d9cb8a7200640d6326fc6952f6b82d86 authored about 7 years ago
[mappings] Fix enriched index mappings with fielddata fields

In elasticsearch >= 5 in order to use a text field for doing
aggregations using the tokens analy...

a43c757d58ea98f09c22d8b4d4a061077ee03124 authored about 7 years ago
[mappings] Fix enriched index mappings for the text analyzed fields

By default the text fields (string in es 2.x) are mapped to keyword type.
But when we want to an...

fbb8eb772650c2b0311b65138f0c5cb66cc13c79 authored about 7 years ago
[ocean][confluence] Avoid creating the mapping of data.extensions.position which mutates

This error fixes the problem:

java.lang.IllegalArgumentException: mapper [data.extensions.posit...

3ed3937a4f9c1b8ac286958979735ec567ec3a6c authored about 7 years ago
[git] Add Elasticsearch 6.x support for study in git.

Some queries to Elasticsearch needed ES 6.x headers.

84e87018babe6ef2e0a2614cda410d50c9ca9d0d authored about 7 years ago
[filters] Fix bug checking filters contents during incremental enrichment

2243faff63f53e1c07485ec9466df8c2b891b9ab authored about 7 years ago
[kidash] Remove kidash (moved to a new repo as chaoss/grimoirelab-kidash)

5115d8368dd70be1f36a56a2cea40883e0af54a3 authored about 7 years ago
[flake] Fix minor issues reported by flake

eb6c06b6b2051b1a2cf16cee3512ad95ab7fed20 authored about 7 years ago
Merge remote-tracking branch 'upstream/elastic6' into elastic6

Resolved merging.
Added a new function in ElasticSearch class
to detect the release of the Elast...

4612a0ec7a9b33ac48cc743b969aa46feb5d5b47 authored about 7 years ago
[elasticsearch] Support Elasticsearch 6

Add changes to support Elasticsearch 6, while maintaining compatibility
with Elasticsearch 5 and...

85fc4fd4c954d0489dabe68746fa60b80d857108 authored about 7 years ago
Update version number to 0.30.20

0c03e5aaa743416a8f5449084a7acf51cf6c5dea authored about 7 years ago
[kidash] Fix error getting the title of an index pattern

90bd62f6e11bce724c5131d2018af6a4293f263b authored about 7 years ago
Update version number to 0.30.19

6ddf954ac66ad9e425e7a1c35a10216785700ed7 authored about 7 years ago
[kidash] Unbundle kidash completely

This commit unbundles kidash completely from grimoire-elk.
Now, all of kidash lives in the kidas...

67ebae548fd1338623b968325602b6e2ae8cb4b0 authored about 7 years ago
[Jira] Move enrichement of fields property to a classmethod.

To be able of testing the code, we need to move it to a classmmethod.
This allows to call it wit...

2f05bc1906ab3641cc0362352ac2f6ae65ba13aa authored about 7 years ago
[Jira] Extract timing for a sprint

If the issue references a sprint, extract the start, end, and complete
times for the sprint.
Mod...

4d82f2f8eecf069ab0c15e616e96804998adab7a authored about 7 years ago
[setup] Add kingarthur as a dependency

Removed all extra dependency on arthur, and updated some other dependencies.

8f98fdb535fd14307df947af30a3de2f72f7ca1d authored about 7 years ago
Update version number to 0.30.18

1d7aa769faa5b806f1518e914ccc4076583f89d2 authored about 7 years ago
Update README.md

069c0e247d8ca1f63c060181b2e71f62c7baae3f authored about 7 years ago
[doc] Link to GrimoireLab tutorials as the main page for using GrimoireELK

75f7e70389eb384341cff559393ec99280fa6b4e authored about 7 years ago
[ocean][git] Map data.message to string so it is not a keyword because it is large field (>32K) in some cases

In some gits the exception raised is:

java.lang.IllegalArgumentException: Document contains at ...

64874fb3fc872ffc3d310757504d1a4c4d630a2a authored about 7 years ago
[panels] Change the API so dashboards can be listed, imported and exported with a JSON in memory

It is not needed anymore to use files to list, import and export
dashboards. There are new metho...

f4ea7efaead6a03f26e01d9ad5fb7cb9cb458d84 authored about 7 years ago
[enrich][meetup] Fix to support empty events during comments extraction

d8e8491b822a881284ba0e08325e664cab11524f authored about 7 years ago
[enrich][jira] Check that labels are defined in issue['fields'] before using it

32094e9cd2b38edac2dd0fd35d809ca5e8555c4d authored about 7 years ago
Update version number to 0.30.17

ee9ccfc76d8bfaa63fc2c59cca8b976f221e10f2 authored about 7 years ago
[enrich][meetup] Fix to support empty events during ersvp extraction

ed4789524b047c1d14747b6464133303dba64bc9 authored about 7 years ago
[utils] Support enrich all items for all groups in a raw meetup index

If the group is specified as '' all groups will be enriched in an enrich
process. For example:

...

680a3731298aac5ee37c539aabc60c3f3e9d3953 authored about 7 years ago
[autorefresh] Group the number of identities to be refreshed

If the number of identities is higher than elastic.max_items_clause (1000)
then the identities a...

fdbe9502fb0a01fbfe0c4437910b6c8c80456524 authored about 7 years ago
[mappings] If a mapping can not be created just log the issue

With old indexes (twitter for example) the old mapping are not
compatible with the current ones,...

50fdb40dc5a714dfc91519008e5968e0849e49c2 authored about 7 years ago
Update version number to 0.30.16

285fb9e0b624b1f1e561377a8e94bd52cb0344fb authored about 7 years ago
[enrich][git] Add the date used to get the affiliation to the raw item

because arthur does not include it in the raw item.

1158af4da16277344c4a2c30f27acce1803d1cf3 authored about 7 years ago
[gelk] Remove ocean-unique-id unique identifier and use always

the uuid from perceval.

dd9bca5153f3ff41a1646541815c2ff915b31cf3 authored about 7 years ago
[tests] Add to twitter the uuid which is used by default in arthur

298c2931eeda9458c988be8feae0d040b2af62fc authored about 7 years ago
[ocean] Filter always the raw items using the backend_name field to support

that in a raw index there are items from different data sources (arthur).

b77792464a951bd75e4405c0ec6476bd7a41f70c authored about 7 years ago
[arthur] Remove filtering using the backend name

The common arthur ES index with all raw items is not used anymore.
GrimoireELK will read all ite...

4ae75733224303276d3aacf0f11c8ed2319a7326 authored about 7 years ago
[ocean] Simplify feed logic when getting the items from perceval cache or arthur redis

4ac3cb4ee6ceef1c6758aed803fdc0300483c94e authored about 7 years ago
[arthur] Remove the raw items from redis queue once they are processed

750b4bb8b12ed28f59666015f093b6a7b2e880ad authored about 7 years ago
[ocean][jira] Add arthur param processing

f99687bd19e34c847d9fbbba152857d356038e78 authored about 7 years ago
[ocean][jira] Remove ocean-unique-id not used anymore with arthur

3b487537b18eea5f3880ef6a2d01f3a3a8f82450 authored about 7 years ago
[ocean] Read the items from arthur and not from perceval. First version.

c43ea2c2e3f4e5971ae4152904d4dd93af00c74e authored about 7 years ago
[arthur] Fix PEP-8 issues

be98efaf23aa369b3bc1df9de5292734ccc0ce7e authored about 7 years ago
[travis] Add kingarthur and redis dependency for arthur

d07a1a3e83f02378b1b4d06aefe47913431cda4d authored about 7 years ago
Merge branch 'acs-domains-T4893' of 'https://github.com/acs/GrimoireELK'

Merges #147 Closes #147

4345d5ee7a17aeab4aa45139e5ee81ea9d3f99a2 authored about 7 years ago
[enrich][sortinghat] Add identity domain using the profile information

There was a case in which the domain was not added to the identities
field during enrichment. Th...

c04167b5cc28c79dbc99385054001246ba4bde00 authored about 7 years ago
[enrich][phabricator] Check in p is defined before using it

d86820118b2fb656cfca0f169ce31c26eae39647 authored about 7 years ago
Merge pull request #135 from acs/meetup-t4606

[enrich][meetup] Don't create comments and rsvps events for empty meetup items

2327d83f1f380427a6c1acf4e4ec8972dbef7385 authored about 7 years ago
[enrich][meetup] Don't create comments and rsvps events for empty meetup items

If a meetup event does not include the date field, it is not processed.
In this case, the commen...

78f595a3289d5bebb462b60be0e99f880e81b7dc authored about 7 years ago
[kidash] Export the index patterns in searches

79de29020cd4a511da250c741986b6425e34454d authored about 7 years ago
[enrich][bugzillarest] Add comments field with the number of comments

f614d5c4c0fd52b763aec2b472fcb9f82ec751db authored about 7 years ago
Update version number to 0.30.15

5223e2344786566d841f00da1b1b4e3212d6697c authored about 7 years ago
[elastic] Check that there are items before doing the call to the bulk API

ad4d582439f4ac79653e5819c4b64db95132d254 authored about 7 years ago
Update version number to 0.30.14

f60cb7f91e75c94443817de251e9111edcf7e3e2 authored about 7 years ago
[travis] Use pip pandas==0.18.1 to avoid bdist_wheel for pandas

In the 0.21 install process, bdist_wheel for pandas needs 8 minutes.
In 0.18.1 this step is not ...

6f55b9d29a003715fdace616446adff2fd9a3df6 authored about 7 years ago
[travis] Add Travis build status to README.md

4a57383e62e4b362827bc66f1765a3e3327c624b authored about 7 years ago
[travis] Install last version of pandas for testing

76912fd6f751b8f93327e07c26e5342553a0a252 authored about 7 years ago
[travis] Add db projects creation and filling

0b2a9af6e2f15807053c5e2a3c3716f9b45e8198 authored about 7 years ago