github.com/chaoss/grimoirelab-elk commits | Ecosyste.ms: OpenCollective

[enrich][jenkins] Add "main" as built_on when built_on field is empty

eb256ace71e1d6e580d8537115927c563b23ae15 authored almost 8 years ago

[enrich][slack] Add channel info fields

c2205f771cfc154216caf68fa0271d5bd7e5f4ed authored almost 8 years ago

Merge branch 'master' into slack

96e9333ce8518caa1f4dd49905a3fd973fddd92e authored almost 8 years ago

[enrich][mediawiki] Check 'revisions' field is included in item['data']

b362adedff59b075d50b3b4b4b63ef77185e0ec4 authored almost 8 years ago

[enrich][nntp] Fix howto get the project repository from the origin in NNTP

b41473060f1432bc10ad7b62b8cb8644952c7778 authored almost 8 years ago

[enrich][hyperkitty] Create HyperKittyEnrich class as subclass of MBoxEnrich to complete the project support

fdd6bad39a40d8d6d6a7a82e4bdb37c6c062d36b authored almost 8 years ago

[enrich][git] Add pair programming metrics in all cases. Include files in them. T1840

c41610eb06fa07c6ca97c29496eefbccc1e38aae authored almost 8 years ago

[enrich][slack] Implement the enrichment specification

ae318c10e174e066caa65f8121b048a5e34a7f06 authored almost 8 years ago

Merge branch 'master' into slack

ccf6984e8d3f0bfb4a360e9c12ca09498a46bc4b authored almost 8 years ago

[enrich][phabricator] Undo eitem['status'] change to use the upercase value for status Open and the rest.

In the original specification for the enrichment of maniphest the status
value used was phab_ite...

e709c2c59e18a4c67fe9402dc0e9748a8edcb169 authored almost 8 years ago

[ocean][twitter] Order raw items using @timestamp during enrichment (T2367)

c32304f7f064f00c040dc060a22468fe7915fab3 authored almost 8 years ago

[enrich][phabricator] Add missing fields assigned_to and timeopen_days (T2305)

22b175e08ef627f90d5fad220907693b4d74999f authored almost 8 years ago

[enrich][git] Add effort pair programming metrics

pair_programming_commit with value 1 or 0.5, even other values could be allowed if there are mor...

577f1079382aff6954b455d217e138315c779079 authored almost 8 years ago

[enrich][jenkins] Remove wrong log with the lines in the rename file

7d71c313e979b34e6b0741e43fa875f0f120f945 authored almost 8 years ago

[grimoire_elk] Update version for pip packages to 0.26.2

162347dbed646e71eafa60d6ce577a0868e4f474 authored almost 8 years ago

[enrich][slack] First working version for the slack enrichment

861328a080f89376c237bda68cbf809f5a087464 authored almost 8 years ago

[enrich][jenkins] Improve logging when using a node rename file

6007375efd354eb153c3aec5ae80a0834bfef1a8 authored almost 8 years ago

[slack] Add Ocean support. Pending to complete a first version of enrichment.

c9b7b95a1811c4168e1ca8b65f5f9c62b581adbb authored almost 8 years ago

[enrich] Move logger definition so it is available when MySQL and SortingHat lib detection is done

125cea09029470e0551de42ff8d8c821d50727a5 authored almost 8 years ago

[enrich][jenkins] Log as DEBUG level when the jenkins job name does not follow the OPNFV schema

7506c0ced1cbd247fb9240f82071aad802bf1dda authored almost 8 years ago

[ocean][supybot] Remove mapping for raw index because it is not needed

5a5154b881449c066cb915eaade7105d86ad13e2 authored almost 8 years ago

[ocean] Declare rjson var as None to avoid UnboundLocalError if an exception appears

ab5ec66fe40ba47701202a558cf189e57aa90a27 authored almost 8 years ago

[ocean] Fix mappings for gerrit and supybot to avoid immense term issue

In Ocean all strings are by default not analyzed, so they are one term.
The limit for a term in ...

254ac41501e29d653e2ebacfa740017a9f65ec59 authored almost 8 years ago

[track_items] Add the support to track and enrich git commits from git hashes

ed46907eda29622eddf9e9ee0530e9ebd4d8e081 authored almost 8 years ago

[track_items] Remove not needed steps for adding metadata to the raw item

ab2031d704c25436843f24b5832550b6ac02ab3d authored almost 8 years ago

[enrich] Propagate the uuid field from raw item to enriched item

d307e6f7e498dc8ad4915b713350fcd770e60928 authored almost 8 years ago

[track_items] Enrich gerrit reviews from track list completed

aeb39a4b69b6517334d0a1e31e7357c208f3ed2c authored almost 8 years ago

[track_items] Use multiterm search to get all the review using one query

c4fbc5017f704a1aa08192e0eed3a79060e9d447 authored almost 8 years ago

[track_items] First refactoring.

Use search API instead of mget because uuids can not be generated easily.

021271030c205e762a1bbbcdba8e15b2b7d91b11 authored almost 8 years ago

[track_items] First version of th script

5fdbccbcbf7230dae99dddf62f80bb76bffa1890 authored almost 8 years ago

[enrich] Show log info when the number of items enriched is 0

6629f28f5ee3b1eef4a76835c8d7554989841d53 authored almost 8 years ago

[mbox] Return specific mapping for mbox. Fixes T2261

fe414de95641df6f0a9382deeb5289b89fe25877 authored almost 8 years ago

[jira] Use tag filtering for incremental updates

d861b24967e711d0890d9861b8410bcbdb44e5a8 authored almost 8 years ago

Improved logging in all GrimoireELK modules.

Define logger = logging.getLogger(__name__) and the use it always
to log messages. With this app...

148fbc164130d77c8d53f78db2111f2dd9478a13 authored almost 8 years ago

[ocean][jenkins] Add support for jenkins-rename-file param in mordred

ad8a687b42ab53d3309c0447e665b9db9374df72 authored almost 8 years ago

[enrich][jenkins] Add --jenkins-rename-file command line option to provide the CSV file

with the mapping for node renaming.

56422dbb11475982b1d5e5c8a91d2e4217d72f52 authored almost 8 years ago

Increase pip version to 0.26.1

e3432b82af55c961834520f56ec9d8b1472b0fe6 authored almost 8 years ago

[enrich][confluence] Add is_blogpost field always with 0 as defualt value.

24c80dfdc4e2739046f75c3555d88ced904ada27 authored almost 8 years ago

[ocean][jenkins] Don't create mappings for runs and actions fields in jenkins raw items.

jenkins raw items are pretty complex and there are issues trying to create a mapping for all ite...

87c91ac22c8269a7a2cf801d61cf2286d9086e87 authored almost 8 years ago

[enrich][jira] Check that timeZone fields exist in dates before using them.

Thanks to Robin Muilwijk for detecting it.

372d849769aa1fb18ff12f356cddae62be92d2d8 authored almost 8 years ago

[enrich][github] Improve how repository URL and name are detected.

origin is not anymore a safe vale to get the reference to the repository from
which the GitHub r...

e3f7627e0abea605539fcb23622959304a944acc authored almost 8 years ago

[enrich][remo] Add is_attendee and is_organizer fields

0c8f28ed703cd1daf94d28daa7d916a31dfe502d authored almost 8 years ago

[enrich][phabricator] Fix more data fields issues during wikimedia phab enrichment. Full enrichment is now working.

a3ca7a35396cfa586a4f454e867549938e0358e1 authored almost 8 years ago

[enrich][phabricator] Fix data fields issues during wikimedia phab enrichment

9681b98c33ff9af79f655af541d5bed7268553fb authored almost 8 years ago

[enrich][phabricator] Check that the item with an identity is not None before using it (T2143)

7909fb968da54cff10dc5776c9c4e8799208131d authored almost 8 years ago

[enrich][stackexchange] Remove wrong check for owner field

6eab8b49729ea862702790552f96543f17e752e0 authored almost 8 years ago

[enrich][stackexchange] Support that a question has no owner (T2141)

41f6c156482094cc613d153404d877dd4f4795f0 authored almost 8 years ago

[panels] Include searches directly visualized in a dasboard when exporting a dashboard

0626d8606a3b3bc5ed6d9158985b0fb5d2802d9f authored almost 8 years ago

[ocean][mbox] Avoid mapping data.body because the data.body.html field can not be indexed in some cases.

The ElasticSearch problem is:

elasticsearch_1 | java.lang.IllegalArgumentException: Document c...

0ecb039975b53ba245f897febc2f8f380df37cf3 authored almost 8 years ago

[enrich][phabricator] Check that t['authorData'] exists before using it (T2143)

c96903170fd76c2d1d8868419357207c25442bb6 authored almost 8 years ago

[enrich][meetup] Add group topics as an array to be used directly in kibana

f2a0e52e69941eb2772549c0c37eadc6d4acbdc1 authored almost 8 years ago

[enrich][remo] Add grimoire_creation_date and is_remo_event/activity field

4107c3e961c4c05e56e8b9ec630876bf7dc7cea2 authored almost 8 years ago

[ocean] When working with offset param, don't check if it is defined with "if offset" but with "it offset is not None"

When offset=0 the param should be used but "if offset" was returning False.

This bug only appea...

316e5e24895e5edae345cc7064a32f6a7c24b93d authored almost 8 years ago

[ocean][git] Add support for using filters-raw-prefix as a param that can be used in mordred.

edfc81a220789b7b781f1aded6a437450cc4a2a8 authored almost 8 years ago

[twitter] Add support for --from-date backend param in non perceval backends.

f59bf138337fd1863b7793c02110819f4ee6f131 authored almost 8 years ago

[ocean][twitter] Use ocean_unique_id as unique field. uuid is not available.

85b9d267f4377245a1e091fcfd6c8c067a0a0426 authored almost 8 years ago

[tests] Add data tests for NNTP and HyperKitty backends

f66578f214c389b8485ec4a4dfcfde6be949a4d7 authored almost 8 years ago

[hyperkitty] Add support for hyperkitty just using MBoxOcean and MBoxEnrich

43441928dbcc4da4f38548a69275c3de2bffab44 authored almost 8 years ago

Merge branch 'master' into nntp

3e218bdd56be2cbe26f48e5f3de0d7ed4055757c authored almost 8 years ago

[ocean] Update raw index incrementally using repository filtering

b4a38f50b9ea1650fb07473ce56a75b51a6f933b authored almost 8 years ago

[ocean] Update raw index incrementally using repository filtering

b868d58932813b90d7d32e13fec436dae33cca56 authored almost 8 years ago

[offset] Control offset None case when converting it to int

fc4909d0100777615432b017466947e16d4b0b4b authored almost 8 years ago

[offset] Control offset None case when converting it to int

81aeecf5f12a4c81bd61f7ea329a143362a765e0 authored almost 8 years ago

[enrich][offset] Fix incremental updates using offset

e50fd95cef18ec08882a46379e2098a8c49483da authored almost 8 years ago

[nntp] Add first version of the NNTP support in gelk

3a7c266fd217ead075c9253986527d404f28ce11 authored almost 8 years ago

[ocean][enrich] Use uuid as unique identifier in Ocean

fac55b418f01b4b6909e57e05b88259d59409990 authored almost 8 years ago

[enrich] Use tag for incremental enrichment for NNTP backend

d878cbb886e3d3a173c3603ef852ebc55baa8746 authored almost 8 years ago

[enrich][offset] Fix incremental updates using offset

4bd17df0252f4b36496f93ca2880e26ba862d8f7 authored almost 8 years ago

[ocean] Read 100 items per query when scrolling in raw items

The performance in the enrichment process is 2-3x faster. In the past
we have some issue with hu...

d4ce6da028837f45e96d548e1e92ff76c520067f authored almost 8 years ago

[enrich][remo2] Add as array of list categories and functional areas to the enriched indexes.

Kibana manages perfectly array of lists so we don't need to convert them to a string with commas...

67b6fce38bc37279076993899a66f958b43d67c0 authored almost 8 years ago

[tests] Add Mozilla Club tests

1e01cbdfd65e670f7566ce06ecfe04f55d5a3d97 authored almost 8 years ago

[mozillaclub] Change library grimoire to grimoire_elk

1991d8089a1eef7302cb5c9567c1a156df669742 authored almost 8 years ago

[mozillaclub] Move ocean and enrich backend files to the new location grimoire_elk

ba6c5bc2099d7e71dd8eb52f5347c97ea453221b authored almost 8 years ago

Merge branch 'master' into mozillaclub

b3e3f84799a06020966da641c7987cb396733526 authored almost 8 years ago

[ocean] If filter_raw_prefix is None don't try to use it

9e675f0ed0406d2b711df5b6c50b06fbe36c5d50 authored almost 8 years ago

[p2o] Add new param --filters-raw-prefix to filter raw items using a prefix queries over a fields.

For example: --filters-raw-prefix data.files.file:docker data.files.file:bin will filter raw com...

4ddad8399aa1a454aadc2b8bfde5c22881ca1596 authored almost 8 years ago

[ocean] Support filtering raw items using a should filter with one or more queries.

Remove filtering for getting the last date for raw items: the raw index has always
all the raw i...

ab486948cfafda3673dd0d9293db45fd073a794b authored almost 8 years ago

[enrich] Add support for a should filter (with one or more queries) for raw items.

Remove raw filtering when getting the last enrich date of last raw index date.
The raw index alw...

6aec8202e376f325a536b63609c88b3fa2b0d0d9 authored almost 8 years ago

[enrich][refresh identities] Fix bug in refreshing identities when to author_id or author_uuid is specified.

fba57c2d3ea24c5a72be60e546bdfd8740a89864 authored almost 8 years ago

[enrich][git] Add multi-author support in Commit (committer data) field.

a1052ef257222a056a552ad9876656a3d275ec03 authored almost 8 years ago

[enrich][git] Remove duplicate authors in multiauthor and signed-off support.

e6776b347da172c1633dfb91da69e46af640f87e authored almost 8 years ago

Merge branch 'master' into cloudfoundry-p2p

f1c97f9005fc9b9b663aef5146fab8c3a4127473 authored almost 8 years ago

[mozillaclub][enrich] Improve enrichment according to panels team guidelines

e48583d4b07f39843809a28acbd4690fc4790a14 authored almost 8 years ago

[filter] All filters must be always returned as dicts and converted to strings later if needed.

Add pending file for this support.

3ab0777971f609d106ef4b88c4405636cb9362f3 authored almost 8 years ago

[filter] All filters must be always returned as dicts and converted to strings later if needed.

d29cc4a3d22f8c273d41c218967c06e1e20a73c8 authored almost 8 years ago

Merge branch 'master' into cloudfoundry-p2p

84812da85687ff247f0bb5dbe35ea97bc2053037 authored almost 8 years ago

[raw][enrich] Add meetup to the data sources that use "tag" for repository filtering

57f1e0a032a94c0b097ea65d71ba91e5c22abc65 authored almost 8 years ago

[enrich][git] Add multi-author support in Author field and also using Signed-off.

Author multi-author is supported in all cases by defautl.
Signed-off multi-author is only active ...

79c63974968de98599fdf7fe55304606c80ade0a authored almost 8 years ago

[enrich][git] Add multi-author support in Author field and also using Signed-off.

Author multi-author is supported in all cases by defautl.
Signed-off multi-author is only active ...

bb8b3db4b95d9137e236824289fa32533ab215e8 authored almost 8 years ago

[enrich] Support for getting all items from a multiorigin index:

enriching a full git index in one step using as origin ''

4af8c3c5f47332c25c87e04b9f456d33b6ba3eb7 authored almost 8 years ago

[get_git_repos.py] Script to get the list of github repositories from an owner

81017bb9d45b27727fc4484e46e73c0f62757ece authored almost 8 years ago

[filtering] Use origin per repository filtering except for stackexchange where tag is used

Until all data sources have tag info in raw and enrich indexes the filtering using
the tag field...

bb158bd93673de054c62df740af5c61c1ad82db5 authored almost 8 years ago

[enrich][jenkins] Add node rename support in jenkins.

If a file called "jenkins_nodes.csv" exists in the script run directory
it is loaded and nodes a...

666060372b665f5c8ec4438195a061526f183fa3 authored almost 8 years ago

[enrich][twitter] Add metadata__timestamp to twitter enrich item

When the field metadata__timestamp is present in the raw index it is copied
to the enriched index.

f688b14417838b95f59ccc64e73da1e0078d3b38 authored almost 8 years ago

[enrich] Add tag to all enriched items so we can filter items using it

4a23edd98bae034b40f647801fb5df86a0cdfeb3 authored almost 8 years ago

[enrich] Incremental enrich can not be done using tag

because the tag field is not in enriched items yet.

db17e8241d70e6717b47cc877462dcc84619231f authored almost 8 years ago

[enrich][git] Manage the connection error when getting a github login

60bbecb1f79d02074392e499f8c529c8950c973d authored almost 8 years ago

Merge pull request #75 from jgbarah/pip-kidash

Add support for grimoire-kidash pip package. LGTM.

8ee4c2043d0c2549bbf639b3d3c04f91502bab57 authored almost 8 years ago

Add support for grimoire-kidash pip package.

Changes to allow kidash.py to be pckaged as a separate package.
This allows for easy installatio...

1b516ff718ddad5f57fcbcfd696a4db9499775d9 authored almost 8 years ago

Merge pull request #74 from jgbarah/pip

Add dependency on perceval-mozilla

8c325ea01a4c2bce3009ab891495c25185aa0a4e authored almost 8 years ago