github.com/chaoss/grimoirelab-elk commits | Ecosyste.ms: OpenCollective

Change TZ so that it comes from author_date

In general, we're using author_date for most info.
Maybe in a later release we should include bo...

2c419b5935408b94875c91db7e077635ea3952d1 authored over 7 years ago

[Functest] Add ocean support for it. Pending enrichment.

d6cf8d6b823f3f5fc448c3c58d63af1ce64b9066 authored over 7 years ago

[enrich][sortinghat] Suppport the autorefresh of identities

using a list of ids or uuids in an enriched index.

b717221c60f1ac6d77f0e885a31f0bba188f1135 authored over 7 years ago

[enrich][sortinghat] FIx log showing that a rol information for sortinghat has the identity field as None.

89178df84f13fdc18b4f9627258ccc40b9452df9 authored over 7 years ago

[enrich] Use always metadata__timestamp for detecting thew new items that must

be enriched in incremental mode. Also do it for demography study.

It is safer to use this field ...

3fe1c8df9d0352271e1c8842e6c3a163969ecbea authored over 7 years ago

[panels] Add new method exists_dashboard to check if a dashboard already exists.

Used to not create dashboards if they already exist and avoid loosing
manual changes during mordr...

4faa69cc40361ad63fb5d97d306dc6a9881c6183 authored over 7 years ago

[enrich] Support in safe_index to receive None as the name of the index

86854ce9457b7d2149976faae2c5f0f2cec5b08c authored over 7 years ago

[enrich][meetup] Use time_date as the grimoire_creation_date. It stores

the date in which the meetup will take place.

1b7f4ae15b2085293329080b67ca27e1e980457a authored over 7 years ago

[enrich] Include always all Sortinghat fields for all roles in all items no matter

that we don't have information for this rol. Needed to avoid not having roles
information like as...

0c06a750b9660fe086d03657179bf271d7b44adb authored over 7 years ago

[dockerhub] First version of dockerhub support: raw and enrich indexes.

fix

89dc2050770ea8c872e6e271e94671e70b4aac84 authored over 7 years ago

[track_items] Fix the ES query changing the wrong limit param to size.

1a5d12416df6279846bb43bf7ea2f63b6078494f authored over 7 years ago

[release] Update _version.py file to 0.30.2 for pip packages

475736b9d968f922ea68246280c35bf482033584 authored over 7 years ago

[enrich][mbox][kip study] Add final status field to all KIP messages

7efd2fd57db636f8fc70bc845c87f044aeaed117 authored over 7 years ago

Merge branch 'master' into kafka-kip

f3672c1f6627cef23e4504ac5f7c23c1700e4d80 authored over 7 years ago

[enrich][git][demography] Fill author_min_date also if its value is None no matter it exists

d54706e83856f5f48073733c5498b223ccf98c8d authored over 7 years ago

[enrich][github] Use grimoire_creation_date for getting the affiliation of authors

10a46b2d5fbf509968e3e328bdb60aa5bfa64c72 authored over 7 years ago

[enrich][github] Use grimoire_creation_date for getting the affiliation of authors

7bcf4958fbf64a579657780358f784ef4082bcb7 authored over 7 years ago

[enrich][mbox][study][kafka-pip] Improve vote extraction and compute the inactive times.

40246d59af926551aeaecae3db98cd66b941601c authored over 7 years ago

[enrich][mbox][study][kafka-pip] Dump implementation of -1 vote extraction

bfac28b4b39b1810830367d2ead9b3083a6603eb authored over 7 years ago

[enrich][mbox][study][kafka-pip] Improve discuss subject detection with more cases

fc10c30516c5757ed577ba774886947c9f53df49 authored over 7 years ago

[enrich][mbox][study][kafka-pip] Move the kafka-pip to its own file.

Improve the score detection during votes.

5d7e74dbc6b3461d16821cf9fca628bad8dfaea4 authored over 7 years ago

[enrich][mbox][study][kafka-pip] Fix error detecting votes first and last messages

aa534741f741babb96791ed6d6ac766bbe0553a3 authored over 7 years ago

[enrich][mbox][study][kafka-pip] Use 1/0 for all bool values to count them later in kibana

73e484ef4e5e2733272131952bfafe6f4a60dfe8 authored over 7 years ago

[enrich][mbox][study][kafka-pip] Implement lazy decission compute

0a1258b0c5819de2ed79e5aad5c87985cc794e39 authored over 7 years ago

[enrich][mbox][study][kafka-pip] Remove debug code for the sencond enrichment phase

c1289afe4fbfcc8a31ffac0a4688eb7786072699 authored over 7 years ago

[enrich][mbox][study][kafka-pip] Implement second enrich phase adding "kip_status",

"kip_discuss_time_days", "kip_voting_time_days", "kip_is_first_discuss", "kip_is_first_vote",
"ki...

15a5a5fd96eade0c3932f7deef369d86cd1fccf0 authored over 7 years ago

[enrich][mbox][studies] Add support for extracting the votes from KIP voting messages

af94b4af31cfb1503adc5e6010c73422e42819d4 authored over 7 years ago

[enrich][mbox][studies] Complete KIP number extraction for all subjects included in

http://mail-archives.apache.org/mod_mbox/kafka-dev/ mailing list.

c6e295bd500756085eac3af892885bed754bdb32 authored over 7 years ago

[enrich][mbox] Implement kafka_kip study to get the Kafka Improvement Proposals

process data to generate metrics about it.

Pending: improve KIP number extraction, vote and bind...

5740b726420d896e52bcad7cdd6413bcb5157725 authored over 7 years ago

[enrich][discourse] Add method __show_categories_tree to print the categories tree

from a discourse site.

a4ef011d8c555cad4b519f3f43b008e54c11fd65 authored over 7 years ago

[release] Update _version.py file to 0.30.1 for pip packages

07b9a5c755c4c165982a9a58711ccc12af0e3452 authored over 7 years ago

[enrich][discourse] Add categories support to the enriched posts

d541c70269bc44f1ffeef0ed23d8e1ef4bfd142f authored over 7 years ago

[release] Update _version.py file to 0.30 for pip packages

298130374f4957c2c9f67af7fd1bd6bc52e0c62d authored over 7 years ago

[network] Do 12 retries by default when there are networks errors (800s aprox).

9c7bc05df45b1a68a526820addaca89951fe3bcb authored over 7 years ago

[network] All requests connections are now created from a shared method grimoire_con()

from all GrimoireELK code, so the retry settings and insecure settings can be
modified in all Gri...

63583232eba594d145cdce5c867cf4d690d73c0d authored over 7 years ago

[errors][network] First version using requests.packages.urllib3.util.retry.Retry to

retry HTTP queries in connections and read errors during 1 minute.

2967038e580f49ff784abfd9dc784eecc912dd83 authored over 7 years ago

[enrich][slack] Don't try to find the email in the user profile when it is not available.

For example, in slackbot.

9696e6e8d9afe9eed141d08ca6799e9d07ca900c authored over 7 years ago

[enrich][stackexchange] Use arrays for tags in enriched index

68ba41568ba7919240d01bd12efa1439fb081132 authored over 7 years ago

[docker] Add compose and elasticsearch config for kibiter 5.4.0 and ElasticSearch 5.4.0

d21de5aeed6af77fada5554cee23f3de3f04fab2 authored over 7 years ago

[release] Update _version.py file to 0.26.10 for pip packages

f110ba08ed63459a40aa67ca4b77fc93b38e6816 authored over 7 years ago

[p2o][gelk] Add support for changing the number of items in ES bulk operations

and ES scrolling searches.

2e6035f47f3a7437c5f5c79e8138990854dfff4e authored over 7 years ago

[ocean] Avoid showing the commits when analyzing git repositories in debug mode. It is too verbose in large repositories.

2f8339c9a169e44bdb1e2d619a3ff081b6017910 authored over 7 years ago

Add the size of the JSON document to be indexed to the logs so

we can analyze the performace related to it and adjust the number of
items that should be grouped...

9d4887a09358691bb8121162c2bee2ed54501358 authored over 7 years ago

[release] Update _version.py file to 0.26.9 for pip packages

599dd72c0b7e121adc8ac70fc9b1a2994b9041a5 authored over 7 years ago

[enrich][sortinghat] Improve logs when error appears during SH activity in arthur.py.

Add the data source in which the error appears to debug more easily later using
the mordred logs.

da1e0aafea63e1d70a7f4f2bd1d20d37c7392517 authored over 7 years ago

[enrich][meetup] Add a new field time_date with the date in which the event is planned

e7fc554a3129e63e4208ea94e0583419b3c65f1e authored over 7 years ago

[enrich][jira] Add projects support to JIRA.

Use the format:

"client-gui": {
"jira": [
"https://jira.open-o.org/proj...

0578d2637513d4aa55e74a27c87fe2cb27a3c368 authored over 7 years ago

[release] Update _version.py file to 0.26.8 for pip packages

f2c2f53e3ba12e79f28d889092f172d0a727998f authored over 7 years ago

[enrich][meetup] Define venue_geolocation field as a geolocation type value in the mapping.

09a9b9ccd1a83a5bef0663e39b53ad69cdf686b1 authored almost 8 years ago

[enrich][git][p2p] Activate pair programming if origin url includes

https://github.com/cloudfoundry. With this change it is active for
https://github.com/cloudfoundr...

6edea5eab3572cc1c756c1698fd365cff699cf98 authored almost 8 years ago

[enrich][askbot] Fix SortingHat identities find in answers and comments.

Included code to detect issues when resolving identities.

2244fb760159dd75fd4fc7500529c4ee58bff623 authored almost 8 years ago

[enrich][twitter] Fix identities extraction in twitter

5d3d8ff73434faf1e380a12014468b98a2d77303 authored almost 8 years ago

[enrich][logs] Show datasource in loading identities logs to identify logs

when working with several data sources in different threads at the same time.

482204160ae91f4f59bca964f194baa4019dae0e authored almost 8 years ago

[enrich][twitter] Don't try to configure perceval backend in non perceval data sources

57df1aa9bcacf40ad2ba44361ca5943b80d11074 authored almost 8 years ago

[enrich] Show enrich exception call trace in logs

917e8b8e1d7ffa4f584c779d910b89d23bd04546 authored almost 8 years ago

[release] Update _version.py file to 0.26.7 for pip packages

e9a8fe2d1ac3feb090292ff78649e0125e228a06 authored almost 8 years ago

[tests] Update the tests so they work now with the ocean raw item generator API

69d42d8a7842f68050b9d32577d6bfd6ae21d6f0 authored almost 8 years ago

[enrich] Use ocean_backend as the param to be used in enrich_items.

Using that, we can different items generators if needed to access the
raw items more than one time.

8b656666b2f31855ed5fa64095dddfb41cee5e35 authored almost 8 years ago

[enrich][mbox] Avoid creating a list from raw items generator because it can be huge

e3581c946eee8ece983b19a010b8219346d1dccc authored almost 8 years ago

[enrich][bugzillarest] Remove email domain from username field in enriched items.

7a06b6040224eacdf1a116e3415f88a214637b7e authored almost 8 years ago

[release] Update _version.py file to 0.26.6 for pip packages

2b0104a9710ae1a61764a883d90ba68656e6da53 authored almost 8 years ago

[enrich] Store items from ocean generator in a list so we can reuse the items.

askbot, discourse, mbox and meetup need to reuse the item list during enrichment
so we need to g...

eb53f252dd00e7fe82aceb97858818d453bd0100 authored almost 8 years ago

[enrich] Support old API when load identities from raw items (needed by track_items.py library)

d1bf928c550ec1e21df9b45c83318cc0bc6d0061 authored almost 8 years ago

Merge branch 'master' into pair-optional

1b38ccba75aa64d0672d7957512045967b4637e9 authored almost 8 years ago

[git][enrich] Fix pair programming metrics for the original author commit data

e4d60166849d8a09bb3714a5cba7947cef2183a4 authored almost 8 years ago

[enrich][git] Isolate pair programming login to activate only using a config param

a368e1653a6a6dc1e9317ad5ffa308709a18bd1d authored almost 8 years ago

[enrich][git][demography] Improve logs including the name of the author processed and the min and max dates for her commits

256bc01cd5592052581905ec6603f70714df1518 authored almost 8 years ago

[release] Update _version.py file to 0.26.5 for pip packages

0e89fe5828e1578570773fdd578021b982b38470 authored almost 8 years ago

[enrich][mediawiki] Fix extraction of identities from mediawiki reviews

02cb69c3ea2f0a44c0f4b0b22b95e4fab643781e authored almost 8 years ago

[enrich][confluence] Add the new field content_url to the enrich index.

With this field the confluence page is known and it can be use for agg and filtering.

a506d0175b2670c54915966c3157026ce0e7f34d authored almost 8 years ago

[enrich][askbot] Add filter-raw support for askbot

61e7f86a2d7031ba9ba5a21603f3a01d17a37544 authored almost 8 years ago

Merge branch 'master' into enrich_scroll

c0bcd367c9ba3c28eb04caaa1bbc65d5f0a697cc authored almost 8 years ago

[tests] Fix test to extract items from ocean using the generator instead the iterator

b9d3548a55955b075cc9d1e521202e352fbb8258 authored almost 8 years ago

[enrich][git] Signed-off metrics must be only computed in CloudFoundry.

273eb922fc9f5454e09194c9aeb8cfddc1eabc62 authored almost 8 years ago

[enrich][git] Signed-off metrics must be only computed in CloudFoundry.

f632906341f85985d977d3254e94fc5e80ac82f0 authored almost 8 years ago

[ocean] Use a generator to access the items in ocean.

General refactoring to reuse the fetch method in items searching.

5a1aa142ab899dd4f4a36e4f17b08512f824cf9f authored almost 8 years ago

[enrich] Get enriched items using the same logic than getting items from ocean

777562eb0d6ee97c88abedcf24cdae80efebc480 authored almost 8 years ago

[ocean] Move item extraction code to its own class ElasticItems

87046af7cfd523f707bc306fa7092db511779bc2 authored almost 8 years ago

[enrich][git] Fix demography study so it works with pair programming

b80deea23cd1a9eeff69940b69409c074e85b55b authored almost 8 years ago

[ocean][meetup] Add the group meetup as tag so the raw index can store several groups in the same index

d62f609f3461ea9c88e17246ffacc466bd22b416 authored almost 8 years ago

[enrich][slack] Add missing field text_analyzed

c6c6291cc9061ed04f02d1c12b03462559364bff authored almost 8 years ago

[enrich][git] Compute always authors list for a raw commit before starting the enrichment

be60c49cfd573a41019a6c5d7fee2f33028b9b06 authored almost 8 years ago

[enrich][git] Fix issue counting the total number of authors when the Author is also in Signed-off list

d16fb772ebe705815f9ffb191ca1fd4df81c16d8 authored almost 8 years ago

[enrich][git] Add two decimals to the metrics in pair programing

273d17718d9f7bd98141b2660ccce5616ca15a6d authored almost 8 years ago

[log] Fix log about the number of new identities found in the items to be enriched

d9482027ce16e051c06d92654b05aa66c278e9a1 authored almost 8 years ago

[track_items] Receive the sortinghat config as a param

20a883cb26ba5ecbec9616732797e7559ae5a42c authored almost 8 years ago

[tests][slack] Add support for slack: sample data and update the number of backends

b6d0ed44881c95c8faec7985c2fbeed84db83901 authored almost 8 years ago

[pip] Update version to 0.26.4 for pip packages

bd5b04fc38f458e2a7a777ff2d83d958131ad99b authored almost 8 years ago

[enrich][slack] Fix tz to be in -12 to 12 and boolean fields to be o or 1

26fa82e9c267f0f24be990b548e751acfc365aec authored almost 8 years ago

Merge branch 'master' into slack

226270d4aca06319a3e299b1c9ecbff7d97faf5f authored almost 8 years ago

[enrich][mediawiki] Support in get_identities that the item provided has no data field

ba4f2e3ddc05351fdf23cf22911d1288e0307581 authored almost 8 years ago

[enrich] Add support for configuring the org name for identities with no affiliation

69daf3d1da6404ddee3cf3a553075f5a37796f76 authored almost 8 years ago

[track_items] Remove debug log about patchSets commits not found upstream.

It is normal that patchSets commits, in branches, do not appear in master branch
once the review...

579fd1df483e88f4d985961313df77d3f7abf205 authored almost 8 years ago

Merge branch 'master' into track-items

6691c6ee4a005211757ec1f59d7b279a5f5216e3 authored almost 8 years ago

[track_items] Break public API and private API from track_items library

d06fd0b8c7a31e0852e4a6024e0464b971c1d330 authored almost 8 years ago

[track_items] Break script into a library and a simple script that uses it

983ed326103d3bc1427b97d1fc7b030e43fc14f9 authored almost 8 years ago

[enrich][demography] Fix author_min_date when executing in incremental mode

Only update the author_min_date field if it does not exists already

7eda2b6ffd2f04ccbad6ea96e4891775c7b48bef authored almost 8 years ago

[version] Increase version number to 0.26.3 for pip package

f34c9782de54dd6e3aa451bffd0c953f15547ee4 authored almost 8 years ago

Merge branch 'master' into track-items

0e47e2699cc01e3cc4658947f20b9a36d7c0b8d0 authored almost 8 years ago

[track_items] Upload first complete version with gerrit contributions support

09c7251959fabc28772c860b17427d6063ca66cc authored almost 8 years ago