github.com/chaoss/grimoirelab-elk commits | Ecosyste.ms: OpenCollective

[gelk docker] Use local volumen for ES so indexes are not lost when recreating the ES container.

eaa3c1994a721b3cfa1906958b0969e1cae1067c authored about 9 years ago by Alvaro del Castillo <[email protected]>

[bugzilla elk] Added SortingHat enrichment.

1a3f4eb51a9631bc88fc0435628a727bda46b40b authored about 9 years ago by Alvaro del Castillo <[email protected]>

[gelk] Fix issues with new APIs. Working again.

b668b85d4303cace546583bb7b9ba4b6f285a4a1 authored about 9 years ago by Alvaro del Castillo <[email protected]>

[o2s] Added merging identities logic.

50ff0dc7a4ad1a5ea95d659a54c88f8ab40f4d07 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Fixed bugzilla backend por testing.

e67ad9ecbb2a264edde27d18a1e3e38f3e009768 authored about 9 years ago by Alvaro del Castillo <[email protected]>

[bugzilla ocean] Implemented get_identities.

77241a29b7c323593495758568dbbe1b7323f8d2 authored about 9 years ago by Alvaro del Castillo <[email protected]>

[gerrit] Implemented get_identities.

5cc433f0cb1fb630f79d2e79e700ca3669baa520 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Support working wo companies info.

fd10a8dc24a1b2e5c05de9e51ab2f1841a53d507 authored about 9 years ago by Alvaro del Castillo <[email protected]>

[gerrit deprecated] Minor fixes to make it works. Real gerrit backend in perceval repository.

232e4f85bfe6464e3c18c5fe5c4f9f7c8996e9a2 authored about 9 years ago by Alvaro del Castillo <[email protected]>

[arthur] Fixed exception reporting.

9563de3defd999de3ee2d435c43337a83990fbe3 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added perceval dev env to gelk also.

9dded4e1d33da62b29f5f78db369424a511ae26f authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added nginx rev proxy to authenticate access to rq dashboard.

a01cf18c23ad33cbe4f8249762d61eb12968e409 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Implemented the complete user addition, with enrollments, to SH.

3fd84d476e5f2ffe97cdd0ea83ea1c7df5348286 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Implemented the user data retrieval from GitHub user API.

1adbbab90e97258f876eb7726010a14e532b434f authored about 9 years ago by Alvaro del Castillo <[email protected]>

Improved GitHubClient to get users and her orgs.

db48ee4dc946d60af73fb2b544061f46f5a0c741 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Removed not needed logic in Ocean Backends.

baefc43f90d97cf0d27a80ac7ce8ed8afb169cf0 authored about 9 years ago by Alvaro del Castillo <[email protected]>

ocean to sortinghat now uses the SH API for storing identities.

e7c9a08b2035cd7ddf4abd00c241fca982417905 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Create initial SH database: ocean_sh

0b65c9a320e7060dc7a378515e27f85f8e07253b authored about 9 years ago by Alvaro del Castillo <[email protected]>

Run mariadb without root password. It is not accessible from host and it is a dev environment.

57ad0673a4de20a270f042b57276c574cfef8ed5 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added mariadb for sortinghat.

fe500965f2ed64249fa91ff266ee39cc88318ccf authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added SH python3 version to docker image.

32deef04f06e791d0e7f265cd75bcdfdc8c1cd81 authored about 9 years ago by Alvaro del Castillo <[email protected]>

[o2s] First version pre-alpha of ocean to sortinghat tool implemented for GitHub.

15989093c173dce26b1c2e7d0feed5a29c179e9f authored about 9 years ago by Alvaro del Castillo <[email protected]>

Support getting the parser for args, not just args.

Use get_connector internally to get the list of connectors directly.

eda43ae559553ba2ae5d40c4cf5d6f13d5ff4642 authored about 9 years ago by Alvaro del Castillo <[email protected]>

[Github Ocean] Implement get_identities API.

3fbf38e46aeb0540bdfbd1bd6dbccdf6d0cc7dd5 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Add get_identities to the OceanBackend API. Support using OceanBackend without a PercevalBackend.

7c2af3fff2b370dd7f1fbb34c9c1b2679989f82c authored about 9 years ago by Alvaro del Castillo <[email protected]>

Removed get_connectors. Not needed anymore.

eb21bc75301b690b9f02f2b24fc8a8f380e522f0 authored about 9 years ago by Alvaro del Castillo <[email protected]>

If there aren no results in conf index, return an empty array.

2dd500c521798cfbf6d6f92862b21d9133aa226b authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added curl to docker image for gelk. Useful for development.

bd01617e5ed8bd11ba23682df404b6c0f6400087 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Removed get_connectors. Now connectors are managed internally in grimoire.utils module.

7e68474eba83df3871f1296ecbdcce89a39ab9c4 authored about 9 years ago by Alvaro del Castillo <[email protected]>

redis is not anymore in gelk image.

cdc1574a1e2926d53f98187290276ee2349525e4 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added an additional worker for creating new repositories.

0cc8bc84799daf3a6d780a448a29738e896a5d81 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Create two RQ queues: create and update.

23a2321fa897ae9326b78e4cb777e5d19c58aeb6 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Start RQ workers withb the container.

81458d582fbfcf29c4392559d6da517bf6269fb2 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Create rqworker-arthur with our config defaults for redis and ttl (10 days).

1483fad412bfd2dde726a788b29dc4c9bd11ecb0 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added alias alias rqworker='rqworker -u http://redis' to docker gelk image.

9d355ef5f089bb8203f91b2d51c9ac57be5067e6 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added support for redis in a different server.

fb70788d5bd95a4cf907084c1eb49f4ddb8ad102 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added redis param to specify where the redis server is running.

0dbcd0edfbd8b2e7895871dead1006125347d9d7 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added compose for gelk, the default config for working in full Grimoire platform.

72fa87caecd982baf12ddd50ad9941fa936fbcfb authored about 9 years ago by Alvaro del Castillo <[email protected]>

Use the official redis docker image.

0493b76bb5b61193135bbbed1a412cc64e96b421 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added Grimoire Dashboards processes diagram.

352adb1b543df33bc6d6add440d48f40384e3239 authored about 9 years ago by Alvaro del Castillo <[email protected]>

First version of p2o using python-rq.

987441445a88585f28e63dbf716886837eceebea authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added rq-dashboard to the docker image.

1b1550685a4f94a5c68a8fe448c87b7db92ebb25 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added UTF8 locale for bitergia user, and python-rq install.

93f73823197d6d88ef802108be44968d461f652e authored about 9 years ago by Alvaro del Castillo <[email protected]>

[p2o] Fixed wrong params. Fixed when there are no repositories yet added to Ocean.

36ab25278ac508ab013e9c7bb7de29fc090cd145 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added redis server to gelk image.

c274b64ba7ab0bc0a609dd64a1b5fdeea65b58f3 authored about 9 years ago by Alvaro del Castillo <[email protected]>

New version of SH archtecture.

6d2c4a160e3e6748d3f460f24c21389ddc5b6abe authored about 9 years ago by Alvaro del Castillo <[email protected]>

First version for SortingHat integration arch.

a1eb410bda3d200cce04bcc4833f16c6335a32b4 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added Treasure Chest (perceval cache).

4867c82a3a0edd05755009eaec68f22b22ecb495 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Changed default self.max_items_bulk to 100 so it works in remote elastic cases.

8009528ac4022e582ca0a0321b336c52a2dd991a authored about 9 years ago by Alvaro del Castillo <[email protected]>

Get the vis from the dashboard template definition.

bff54e88781b9b64936a11278cc47c99f357c2c5 authored about 9 years ago by Alvaro del Castillo <[email protected]>

First version of p2k creating a real kibana dashboard from a perceval datasource.

Refactoring of p2o to share code with p2k.

bd6863658719e88be3eed87222649c0fca1d4a44 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added first version of the perceval to Kibana tool.

It gets the data from Perceval and create the index pattern for Kibana.

0e06c115882ff0382e600339dfcbb3eb49b1c42b authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added ElasticWriteException and check we can write in Elastic when creating indexes.

e008bba10a6a563faac4a22ba7882a3519bd3423 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Use an URL to define Elastic connection (not host and port).

78678a112c0f491f7d245b09a259b0c3bf866d41 authored about 9 years ago by Alvaro del Castillo <[email protected]>

bugzilla fixed case where there are no new items.

21475ad67ce3fff596e3ba97ce99c1ed728367f5 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Fixed bugzilla iterator so it iterates also in bugs ids csv list.

4d099afb2df4ebfb2378c792a0404e9c9c2e4eae authored about 9 years ago by Alvaro del Castillo <[email protected]>

Fixed API call.

12f02a785745caf0036d4c458a6302b9dd35fcc7 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Refactord GitHubClient so item iteration is done in GitHub backend.

Fixed incremenatal support for GitHub.

4f13eec10ef6e105b80333f42a842b5dc19562f4 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Converted for using generator.

Added GerritClient class to work with Gerrit SSH API.

aab110817778b2aa50e2369d71210d97cedf416c authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added GitHubClient class which implements all comms with GitHub API.

88ab5280ba9ac72323e0148b5d1a584eecd40470 authored about 9 years ago by Alvaro del Castillo <[email protected]>

New version including the events channel.

fa64a3a88a1911e1e77f452c421da5290b37b378 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Converted to use generators (yield).

227c323c9136489d917d1a4d2edf20e398f537f7 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Use the last stable version for ES and Kibana.

02b4fca8c4d8608611ee13cfc7926f02c89001c7 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added Items API.

25a91333f5d465f1a30ad39b99aafa8b5d9aafd3 authored about 9 years ago by Alvaro del Castillo <[email protected]>

New version after talking with Dani about the enrichment process.

be2bb498fceae625f124ba271c8b816c3996bc30 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added loop feature to p2o.

64f14942831d3375d1b7be5daed1e23d199671f2 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Improved logging.

520fdef66bc0e796de48385d14d5eea8bb4519fb authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added new method to get the elastic ids for the repositories in Ocean Conf.

93c06e7a32b81f19e1bc32e64aa012f4473a7a8a authored about 9 years ago by Alvaro del Castillo <[email protected]>

First version of the ocean management tool.

Implemented listing and removing of repositories.

b440f0a49869490a7533a7bbd55e57dbd6501b45 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Implemented the process for updating all repositories in Ocean.

372a87994078cabf6dabfa550d284611ad73a81b authored about 9 years ago by Alvaro del Castillo <[email protected]>

Adding get_repos method to get all repos from Ocean.

3096a655a94642a4f7d4c5fac55c0a9d3d6f4a96 authored about 9 years ago by Alvaro del Castillo <[email protected]>

First version of the ConfOcean management class.

repos are added to ocean conf once analyzed.

0b065725139ce07aec1dc4d9c364ea3407d94cfd authored about 9 years ago by Alvaro del Castillo <[email protected]>

Refactoring of p2o before adding new features.

3390f7d90419cce62b2b1f12b0c0adb993e4b239 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Change use_cache to cache so command line args map to init params.

5acab2ed07299bc3e07ce84ef8145319479206f5 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Moved to **args approach to use command line args when available.

e9327c5706a3493a8091f59c09c961fb7214f69b authored about 9 years ago by Alvaro del Castillo <[email protected]>

Merge branch 'args'

3690f10fa50e7808dfa378c6a203b8a0904a4561 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Convert to perceval module organization.

05ab190ce105a78c9598f477661ae9c88abde426 authored about 9 years ago by Alvaro del Castillo <[email protected]>

New version after Dani comments.

6c833739d80945d90b076a028d3ab51b19ee37b4 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Use **args to pass args to init methods.

4a45bbed4c904f1ffffcfa9e5efd7dd04a80007d authored about 9 years ago by Alvaro del Castillo <[email protected]>

Simplified docker-compose file.

57d2d22698c8972ed8a3a9751edecf179d740fc9 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Sample for ELK authenticated using nginx and reverse proxy.

97bc25931698faa6ba51ee14adf60aaca9af65b1 authored about 9 years ago by Alvaro del Castillo <[email protected]>

First version of p2o. Just a command line tool for feeding Ocean from perceval.

36006a8a2d34a19035f5e6b8282b343e80de1d84 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Support using command line args as params for OceanBackend init.

49e49b1ac1bf3dcf964ab561fc3d57cd3da448ed authored about 9 years ago by Alvaro del Castillo <[email protected]>

Created grimoire/elk/enrich.py class as Elastic Enrich basic API.

Use the new Enrich API for supported backends.
Accept command line args in backends init methods....

831d248d29fe454dd15deac027d3e296ddbe52c8 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Removed not used code (old use of pullrequests API).

7396dc17937c24c7f7dc236cc0ba13c90ff7b432 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Refactored all code to have just Items Perceval backends.

Move the rest of the code to specific classes.

59949c7f331ff66e3e6460d4a797033bd4f72ed3 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added python mysqldb lib

4f7f617c70ae954cc53070347c0eb6ff94456100 authored about 9 years ago by Alvaro del Castillo <[email protected]>

New version of OceanArch after the meeting.

2aeb1b8499abcc57aa00919c2dc8f5474df2edac authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added ocean manager tool.

55e334cf95dc3c225f3c112a314e3293033f1cb8 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Backend get_name is now public.

7a7fb72cdc238c9bd386d82626e7a4972c69a32b authored about 9 years ago by Alvaro del Castillo <[email protected]>

Unified in gelk all data sources scripts.

bff28336b63444530cf02c4bc72f1cc3f8cd379a authored about 9 years ago by Alvaro del Castillo <[email protected]>

Basic draws with Ocean arch.

dcb7aec153a11b39fa6e01621d011e1854160f64 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Control logging at urllib3 level.

9bd3dfc3fed9721b273bd21d3a4d4f76efc4596f authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added packages needed for running Gelk.

0399b80b04281032a1f4fc9a3ba70005be8e938c authored about 9 years ago by Alvaro del Castillo <[email protected]>

Use bash and sudo power to bitergia default user.

fc4aafd86d549036b1020ce4b1b523a4fb88bf6e authored about 9 years ago by Alvaro del Castillo <[email protected]>

Added link from gelk to elastic docker container.

b0b94799f6428d1680223f983a4d2169384c7a05 authored about 9 years ago by Alvaro del Castillo <[email protected]>

First version of Gelk Docker image added.

49f5c1cb69bb24ecaa8a4fcda2d1323d84e63d9c authored about 9 years ago by Alvaro del Castillo <[email protected]>

New compose with ES 2 and Kibana 4.2 working.

b87d84ee80822efdb6eb96248df830bce888a1e2 authored about 9 years ago by Alvaro del Castillo <[email protected]>

Converted CacheItems to an iterator.

Improved how the cache is loaded and sent to Ocean.

85bcf41a150ee56dc3d3bf0899dc710fb0082d2f authored about 9 years ago by Alvaro del Castillo <[email protected]>

Support not having projects db from grimoirelib.

Improved howto get all reviews (not working for wikimedia).

f31b1f54d7fd651e7d99255eddb0395f90edf4d3 authored about 9 years ago by Alvaro del Castillo <[email protected]>