Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ooni/backend

Everything related to OONI backend infrastructure: ooni/api, ooni/pipeline, ooni/sysadmin, collector, bouncers and test-helpers
https://github.com/ooni/backend

It's called nimbus y0

5d27553dc0e3e59f3681dae0a66b7893cbf69e08 authored over 9 years ago by Arturo Filastò <[email protected]>
Ack tuples

072ef3014ab59bdef6bf36e0204f15348268391f authored over 9 years ago by Arturo Filastò <[email protected]>
Extra argument was missing..

a0745d0acdb0f6d841b01e24a2971c4625e7ffea authored over 9 years ago by Arturo Filastò <[email protected]>
Move flush print into function

77d28cfd068ae593953c0a49f27288bc16877cc8 authored over 9 years ago by Arturo Filastò <[email protected]>
Update storm version

075ad0c7082c94cc0be3feca7908d1bb8767dfc1 authored over 9 years ago by Arturo Filastò <[email protected]>
Also check for timeouts inside of the consume loop

56783f7e0c3093defec2f35ffaef268605afba5f authored over 9 years ago by Arturo Filastò <[email protected]>
Clean dead code

7719cd1c04a852d0758d31a0391ba130ffdb1f82 authored over 9 years ago by Arturo Filastò <[email protected]>
Properly call consume_messages()

8648abb4854c4df32c67f2cd65959bc368a54d2b authored over 9 years ago by Arturo Filastò <[email protected]>
Set the timeout for the kafka consumer and after the timeout is reached check for timed out buckets

26233ce2b1778a64366564b774d07dd327eb47e2 authored over 9 years ago by Arturo Filastò <[email protected]>
Implement TimedOutStringIO and refactor logging

12f6489831ef60d40de75cda9646b7a2f99c0026 authored over 9 years ago by Arturo Filastò <[email protected]>
Remove too much verbosity

534ff67a453a74f6b3828a62514774d2576d3bcd authored over 9 years ago by Arturo Filastò <[email protected]>
Add some debug lines to kafka-consume

01424e83a1c608b1ba7d19c51276a0ee8baf3547 authored over 9 years ago by Arturo Filastò <[email protected]>
Cast everything to string

06e50b7bfda265aa7fb3c3ddd2b690f0d3fa786d authored over 9 years ago by Arturo Filastò <[email protected]>
Update config and requirements

9db851c92e66b9d82ecec48bca16c6b9b881d5ab authored over 9 years ago by Arturo Filastò <[email protected]>
Actually the bolt probably wants more parallelism for serialization

4f7a980a48a1660a550a32acbb203bfc263cb37b authored over 9 years ago by Arturo Filastò <[email protected]>
Specify the parallelism of them bolts and sprouts

f1ecd4efe97dbea6a6b63d6ac77ff2f8f70f0b4c authored over 9 years ago by Arturo Filastò <[email protected]>
"" is not ''

e004757188ce8a344511e28bc531c3d6f10bfeeb authored over 9 years ago by Arturo Filastò <[email protected]>
Last try

64b2184cfdd0ae33dcaf5c4ed1f9bb396e887d3b authored over 9 years ago by Arturo Filastò <[email protected]>
Cast to binary type

7787fd24af134e5110d212bcd8155bc62b69fa3c authored over 9 years ago by Arturo Filastò <[email protected]>
No encoding, no fun.

5a03b72256544b16a83287efe6923b4694395bb0 authored over 9 years ago by Arturo Filastò <[email protected]>
Fix naming of record types

4b6cfdae7a4db5131e9fceb18bad9c9e0db37d57 authored over 9 years ago by Arturo Filastò <[email protected]>
Configure production

98780b96171d420a39779a753659cd5b27aa3da1 authored over 9 years ago by Arturo Filastò <[email protected]>
Add report topology requirements.txt

7482351b179e62080e402d1bd73fc624662800ec authored over 9 years ago by Arturo Filastò <[email protected]>
They call them tuples, but they actually mean lists...

5d824eff0632f24b5adfbb9c3d4a30b2aaf9dfd0 authored over 9 years ago by Arturo Filastò <[email protected]>
Emit a 3 tuple

210f2a19a1060f2befabfeda720adf497b0af5e0 authored over 9 years ago by Arturo Filastò <[email protected]>
Implement a basic unittest

797838b1cf53ecd32272fd30002a73de7910d691 authored over 9 years ago by Arturo Filastò <[email protected]>
Need tell

8c4600b52bf73e77b62a1c374bc2c13e27f546d7 authored over 9 years ago by Arturo Filastò <[email protected]>
Actually it's gzip..

cf6067db55781f063cd70afee3c31356eae902d4 authored over 9 years ago by Arturo Filastò <[email protected]>
boto works differently..

c2209e3cdf880e429818e5bbeb818846b0bff510 authored over 9 years ago by Arturo Filastò <[email protected]>
Move open into init

03c8e6f9476149ab39950536e4b3872dafcb2038 authored over 9 years ago by Arturo Filastò <[email protected]>
boto reports don't support the with construct

f1815b01dda59c034441b34c3f3de4f2e2420424 authored over 9 years ago by Arturo Filastò <[email protected]>
Fix calling of parse

85427656b8f7b26b26984d2a44fdb734470c7294 authored over 9 years ago by Arturo Filastò <[email protected]>
Use a python file for configuration instead of conifg.json

9e0ff18915336e6cd2a345474c412dfa4a393640 authored over 9 years ago by Arturo Filastò <[email protected]>
Almost mistake singular and plural

00982a335061f98eba56987a20307e8f256c6856 authored over 9 years ago by Arturo Filastò <[email protected]>
It's actually a KafkaBolt

7621a6cf6b4b0c5d5e76bcae581ec91fc027ab7a authored over 9 years ago by Arturo Filastò <[email protected]>
Rename report to reports

dd4d594809f3b54bb82a9e16ffdc2f78a09c6e0f authored over 9 years ago by Arturo Filastò <[email protected]>
Refactor pipeline to use streamparse

338749b87155feef631dc0f1597a6833a720c38e authored over 9 years ago by Arturo Filastò <[email protected]>
Implement finished method.

Keep track of queue of messages that have been processed and flush them when finished

447d5ba291cb8b52fe5973c3efa759f7199ce5a1 authored over 9 years ago by Arturo Filastò <[email protected]>
Add some debugging info

e9afcd725f08952278741718d14e5c4fb4bac04c authored over 9 years ago by Arturo Filastò <[email protected]>
Fix path

54a1342b0894aa11e9f9152ed1ff286ba8761af3 authored over 9 years ago by Arturo Filastò <[email protected]>
Len is on the date bucket StringIO

9c928ae7d40e92f99251b95fb86f0255a8bff2a2 authored over 9 years ago by Arturo Filastò <[email protected]>
Prepend a character to identify the type of message

f263a069ded872cfaad7086baf718d094c2ba68e authored over 9 years ago by Arturo Filastò <[email protected]>
Use the bucket manager

8221c409f773fe81d5c4ff8301864f5d083b7da4 authored over 9 years ago by Arturo Filastò <[email protected]>
Implement bucket based kafka consumer

a142cb7935b00a1b7d2906e4474da1a26e137c56 authored over 9 years ago by Arturo Filastò <[email protected]>
Add the bridge_address key when it's missing

8dd3c8b05a714c334ff81c4ef0702acebcf081d7 authored over 9 years ago by Arturo Filastò <[email protected]>
Fix missing imports

a3c15a0f5284e575879fe8f84890dadb471ca64a authored over 9 years ago by Arturo Filastò <[email protected]>
Disable output and serialise to error message

6c16e1d1269c5c55b8aec4cf2c892fb40d9a9c92 authored over 9 years ago by Arturo Filastò <[email protected]>
Fix calling of close

1def874b863da023d87a106a1fa26020e59fa2d4 authored over 9 years ago by Arturo Filastò <[email protected]>
For the moment kafka-python seems like the most stable library

a1df40e1a8bb15e6a7aa66a47b765b5db758a1d6 authored over 9 years ago by Arturo Filastò <[email protected]>
Fix bug in sanitisers

ab6f17b463b411b46310a7f0cf7b18c662464d49 authored over 9 years ago by Arturo Filastò <[email protected]>
Fix references

dbc8af2cbf89f2db8070b55493d0f7f6c97fde65 authored over 9 years ago by Arturo Filastò <[email protected]>
Switch back to pykafka

e9f75a31f0520c5bbac6fa0bfbc6ebbd8f5714c6 authored over 9 years ago by Arturo Filastò <[email protected]>
Use older API for kafka-python

4770a00ec187d6ca9964b613d6435259b3f7b113 authored over 9 years ago by Arturo Filastò <[email protected]>
Implement consumer using kafka-python

29f2226f6c7636a47c2979c3eb45030f071f8731 authored over 9 years ago by Arturo Filastò <[email protected]>
Add simple Kafka consumer and producer

35a587e1715445fbef76062a6932b4e3d2d89715 authored over 9 years ago by Arturo Filastò <[email protected]>
Add support for publishing topics to kafka

356d8a1cc91537f49458c218afdca1b9c9662925 authored over 9 years ago by Arturo Filastò <[email protected]>
parse quickstart (http://streamparse.readthedocs.org/en/latest/quickstart.html)

a30baa5033557bd72ee26be5c1e57b9fb30582c2 authored over 9 years ago by Arturo Filastò <[email protected]>
Refactor util and workflow

9b3d3040ba2bd20ed39b1af775979547d9eaa824 authored over 9 years ago by Arturo Filastò <[email protected]>
First commit

c2b28ca272d6a265052b2df0ed9f1de38812a73a authored over 9 years ago by Arturo Filastò <[email protected]>
Don't override errors set via class attributes

93cf891c7d77795e59c0763b499d234d3d54992f authored almost 10 years ago by Arturo Filastò <[email protected]>
Fix error handling in report update

8f3b5fd74bbe89602312e917d3a616b78ed544b5 authored almost 10 years ago by Arturo Filastò <[email protected]>
Fix 500 error with bouncer

f32e07783d3d4490433ba7ee3672c35c62b62749 authored almost 10 years ago by Arturo Filastò <[email protected]>
Raise errors when report is not found

c08a825dd1fa47b8af21a524301e6014fa46819f authored about 10 years ago by Arturo Filastò <[email protected]>
update oonibackend to 1.1.4

c22b9ac4ea45a99f503b792e24d90630a16e7aae authored over 10 years ago by Arturo Filastò <[email protected]>
Fix bug that lead test helpers to not be started.

Various pep8 related fixes.

7e95433b66cb96b5c524a76c04da7251ae5d3a68 authored over 10 years ago by Arturo Filastò <[email protected]>
Fix typo in changelog entry date.

5366a07d2892f7a0f63cdcc4ba45f2bb1945ac97 authored over 10 years ago by Arturo Filastò <[email protected]>
update oonibackend to 1.1.3

a20bf774592c318d1aa5f842eb79b5ea959f7a82 authored over 10 years ago by Arturo Filastò <[email protected]>
Merge pull request #57 from TheTorProject/feature/13232

Add support for specifying the format of report filenames and directorie...

632e9aa72a78a511a6f4e8d8a618135c880f93dd authored over 10 years ago by Arturo Filastò <[email protected]>
Set default report file path to include country code.

Fix calling of report_file_name

74494091a09bc392d767ded9ff3af26b4e69a7e9 authored over 10 years ago by Arturo Filastò <[email protected]>
Minor cleanup of bouncer handlers.

764993d66fe8e091c86300eb3d6308aa3f070758 authored over 10 years ago by Arturo Filastò <[email protected]>
Add support for specifying the format of report filenames and directories in the archive.

This implements: https://trac.torproject.org/projects/tor/ticket/13232#comment:1

33b953312a5244afd6295788304faab822cdbaf6 authored over 10 years ago by Arturo Filastò <[email protected]>
Write to a tor logfile

93edf6df743f263c79567ce15a76c5baf9d2d7f2 authored over 10 years ago by Arturo Filastò <[email protected]>
bump to 1.1.2

c96b3f05a944c2f6f3184093faa499c3fbcdd2c8 authored over 10 years ago by Arturo Filastò <[email protected]>
Fix indentation problem with http_return_request helper.

0127f112e7f54fa3fdc39eff979d4f66d71c5398 authored over 10 years ago by Arturo Filastò <[email protected]>
update oonibackend to 1.1.1

f0cd5b430519158a257768b695856ae51617475c authored over 10 years ago by Arturo Filastò <[email protected]>
Merge branch 'fix/application_api_rebase'

* fix/application_api_rebase:
Print the configured hidden service details to stdout
Remove r...

3e3d4be07f92ec28b82ab34fd7a40b1b3aa7ffd5 authored over 10 years ago by Arturo Filastò <[email protected]>
Use shutil.move instead of os.rename.

This is needed because otherwise it will not be possible to have the reports
dir on a different ...

d507cec9856a46ab1a18586d5559861662a77491 authored over 10 years ago by Arturo Filastò <[email protected]>
Fix typo in README and in setup.py

188f2eb2aa19fbed9624851d75aea333072e672c authored over 10 years ago by Arturo Filastò <[email protected]>
Refactor oonib's usage of twisted application API

4d76c781a67b77d0c4115b011ee6257cf933c4ce authored over 10 years ago by aagbsn <[email protected]>
Remove runner.py

08c48f179a886bb1ca8fcc063612461b46f20400 authored over 10 years ago by aagbsn <[email protected]>
Apply Arturo's fix for 12747

2972cb2234fba8d24c009e113541716326793629 authored over 10 years ago by aagbsn <[email protected]>
Print the configured hidden service details to stdout

0b37b3db782cb83f6a60211184b281f292dd4aca authored over 10 years ago by aagbsn <[email protected]>
update oonibackend to 1.1.0

306bab7bf3e12b8ec5940070a2b876617957643d authored over 10 years ago by Arturo Filastò <[email protected]>
Make oonibackend ready for being uploaded to pypi

dd8c48922c294b74ba6ec6a371e6ffbe7c0f14a1 authored over 10 years ago by Arturo Filastò <[email protected]>
Improved RESTfulness of the bouncer API.

fce1c169401ed3ec110c82eaeeade14f4aab8151 authored over 10 years ago by kudrom <[email protected]>
Add synonym for http_requests_test

b0fa6d681a9a858432109ed12ee47da3483e78c8 authored over 10 years ago by Arturo Filastò <[email protected]>
Implement unittests for HTTP test helpers.

Fix some bugs found in unittesting.

5ee55d4d69a1ac846ebb5f57bbc0a938b113b202 authored over 10 years ago by Arturo Filastò <[email protected]>
Add coveragerc

fdd73bfab661e366df6f0fdc29a9a3aa6261d88d authored over 10 years ago by Arturo Filastò <[email protected]>
Pep8 fixes.

567a57870a897e5f3657bb5f60f0eaec0984eba3 authored over 10 years ago by Arturo Filastò <[email protected]>
Also test creating a report with the content key.

ddc1b004be553972422d1e52a756225c0550a5c9 authored over 10 years ago by Arturo Filastò <[email protected]>
Merge pull request #54 from kudrom/feature/updated_oonib_policy_aware

Feature/updated oonib policy aware

05eab00e10f42f9b7a593537e1eaa584e3228aad authored over 10 years ago by Arturo Filastò <[email protected]>
Fix compatibility with txtorcon >= 0.10.0

4c7ed13fffea854f2f62d0bba61c50fd833bde9b authored over 10 years ago by Arturo Filastò <[email protected]>
Implement policy aware bouncing support in the backend

cd5992e9bc2877b1105a1584a168136de83148b3 authored over 10 years ago by kudrom <[email protected]>
Bug in test_bouncer fixed

d25cc99abdd7ed667f436a9f82c9420dcedc5282 authored over 10 years ago by kudrom <[email protected]>
Review of policy aware changes

77474ff012275df70cd63eb68c0e54bb3ab559a6 authored over 10 years ago by kudrom <[email protected]>
Tell coveralls of the coveragerc

73ca1687dae90253315405373e1b5f05fef64dc5 authored over 10 years ago by Arturo Filastò <[email protected]>
Bug in test_bouncer fixed

989df4a0816672d8fea7f9a1c1a816a03432525d authored over 10 years ago by kudrom <[email protected]>
Fix code coverage badge

93ced706b5641c0c7a2effd54bc563b90524ecfb authored over 10 years ago by Arturo Filastò <[email protected]>
Add coveralls descriptor to repo

6e8333d39a924e94f35487a888e52b5e55f03602 authored over 10 years ago by Arturo Filastò <[email protected]>
Fix markup

59871b62e01d5f579d0936cea30f7f6e8bf56fce authored over 10 years ago by Arturo Filastò <[email protected]>