Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ooni/backend

Everything related to OONI backend infrastructure: ooni/api, ooni/pipeline, ooni/sysadmin, collector, bouncers and test-helpers
https://github.com/ooni/backend

fix(requirements.txt): pin precise dependencies (#533)

See https://github.com/ooni/probe/issues/1707

6ec4fda5b182d5eaa769e3398c537fe8c0d01786 authored over 3 years ago by Simone Basso <[email protected]>
0.45 check-in and priority improvements (#265)

* Add test
* Order prioritization list
* Cleanup
* Add UTC timestamp

d0c15f73c61a6d92f474cdb5815ed91fbf87403c authored over 3 years ago by Federico Ceratto <[email protected]>
0.44 Fix prioritization (#264)

Bugfix
Add mocked DB prioritization test
Add tests with mocked I/O
Handle CC match, add tests...

c5f16231ac0e09f5ef3e35aa573a8b3a691453e8 authored over 3 years ago by Federico Ceratto <[email protected]>
Add torsf test (#262)

* Add torsf test name

* Code cleanup

32347f989e9038f858e932d4f70db2cc5b12a32e authored over 3 years ago by Federico Ceratto <[email protected]>
Add PL DNS fingerprints (#361)

fa9203e0f11c83303d0b022012f270a3b5e6fbd4 authored over 3 years ago by Michel Le Bihan <[email protected]>
Add missing deps from fastpath package (#351)

ed8401e0cbc681536580419aa04c4f495addbde5 authored over 3 years ago by Arturo Filastò <[email protected]>
Change header in PL fingerprint (#341)

9752bb9a99095876e823a87b290a8434dd3056ef authored over 3 years ago by Michel Le Bihan <[email protected]>
Publish coverage (#352)

984c4d380e500af5f7da194a2f421a9ab2dae0a0 authored over 3 years ago by Federico Ceratto <[email protected]>
0.24 Support SSL certs in test helper rotation (#359)

732c44d0fcb2a4da7b5a9d01b9c147c5dafaf513 authored over 3 years ago by Federico Ceratto <[email protected]>
Add torsf test (pluggable transport) (#360)

314fa5bc173cb112da49edda93a8ca70bd32ed7a authored over 3 years ago by Federico Ceratto <[email protected]>
Set SameSite=None cookie (#261)

4d31316b2dd5a577fcfc3597a0a9b563b61c0a0e authored over 3 years ago by Federico Ceratto <[email protected]>
Implement end-to-end CI (#258)

16dfcc091f05563b6b7f9c7d663fb8a6a1e48dac authored over 3 years ago by Federico Ceratto <[email protected]>
Switch URL submission to account_id (#260)

Switch URL submission to account_id, handle cc = "global", publish PR URL in /state

e7b0a0c787a60ffc96e44c9c7be2d660d854bb57 authored over 3 years ago by Federico Ceratto <[email protected]>
Improve rate limiting tests (#256)

be7f0d5ee9cbefdd4738d67dec2a82f3be2536ac authored over 3 years ago by Federico Ceratto <[email protected]>
Delete cans in local cache (#358)

8774c15be05590e8202fbc04e807fe1e4748bf90 authored over 3 years ago by Federico Ceratto <[email protected]>
Add test.ooni.[org|io] domains to CORS (#259)

68c8c92398cfad0f43b0e5b7e062f396167eddd7 authored over 3 years ago by Federico Ceratto <[email protected]>
Unify runner setup (#257)

ef894b0f3e095ad7d2b55c34d8751f0e4529b76f authored over 3 years ago by Federico Ceratto <[email protected]>
0.38 Add more CORS decorators (#255)

6066dfd9d2f7bcd41364c0463de1da16b007ce19 authored over 3 years ago by Federico Ceratto <[email protected]>
Add test helper rotation tool (#357)

0.23 Add test helper rotation tool

58c6f3c11b447f1568032b67911d6b71fe2ec553 authored over 3 years ago by Federico Ceratto <[email protected]>
Handle normalization errors

fc114a2615e2374f740f03cdeeb3e1e66de8e8f2 authored over 3 years ago by Federico Ceratto <[email protected]>
0.40 Add reprocessing tool

424714fedb19f94bba297d3a63764ff20a876532 authored over 3 years ago by Federico Ceratto <[email protected]>
Bugfix and cleanup

85f2b57d5d8f1305d7348b9d7b36f793612af7ca authored over 3 years ago by Federico Ceratto <[email protected]>
Cleanup

583bdca47c0fa48dbb6311a8f203a4e54cd1bd7c authored over 3 years ago by Federico Ceratto <[email protected]>
Add reprocessing tool

71ccfb5c170efd97df2b41eec63463ef2633fd42 authored over 3 years ago by Federico Ceratto <[email protected]>
Bugfix and cleanup

0016376c19d827710acbc1bc399d8a892d96a5af authored over 3 years ago by Federico Ceratto <[email protected]>
Update S3 path, cleanup

7e53ec728f3286a42eff7afb98d843c823836f94 authored over 3 years ago by Federico Ceratto <[email protected]>
Enable fastpath, cleanup

88700e4dc96c06b9d561c16fd61327eadbfb9178 authored over 3 years ago by Federico Ceratto <[email protected]>
Add index

9500ac8c5aa0ba451118c2063144c52ea447df18 authored over 3 years ago by Federico Ceratto <[email protected]>
0.37 jsonl lookup bugfix (#254)

* 0.37 jsonl lookup bugfix

* Add integ test

cd7f00378bc42491ea85815255a3faf05feb6cde authored over 3 years ago by Federico Ceratto <[email protected]>
Explicit the ORDER BY in the prioritization queries (#241)

19b46bd0c6f99415e870179b16327c7bd0972a1d authored over 3 years ago by Arturo Filastò <[email protected]>
Configure CORS (#253)

0.36 Use CORS decorators
Drop check_config

d2032b1e5a618298c0c6606bec54d752b6d001ff authored over 3 years ago by Federico Ceratto <[email protected]>
Citizenlab tweaks (#252)

0.35 Citizenlab: handle deletion, change format
Set category desc from code
Atomic CSV write, ...

c693acf1e943bf4870bb6c851fd3bf2aa0169b9c authored over 3 years ago by Federico Ceratto <[email protected]>
Add DNS signatures from citizenlab

504af1cb1f1843a841cc4a0958ed6e48f2455052 authored over 3 years ago by Arturo Filastò <[email protected]>
Match also different types of DNS responses

c858178d256cd9793739ed505453318910c0f3b3 authored over 3 years ago by Arturo Filastò <[email protected]>
Add support for DNS based blockpage fingeprints

3ca9a5272b3c98393088bfb28125aea066fb6c2b authored over 3 years ago by Arturo Filastò <[email protected]>
Handle reprocessed msmts in jsonl table (#250)

* 0.34 Support reprocessed msmts from jsonl table

* Handle reprocessed entries in jsonl table...

75830103c19f5207eabb51209db5907a827a14ab authored over 3 years ago by Federico Ceratto <[email protected]>
Fix broken citizenlab tests (#251)

aa6bdb181541d4abd829eea011421cc506526677 authored over 3 years ago by Arturo Filastò <[email protected]>
Return descriptive error (#249)

5b7e44d6982091a1241d5a1792514b3f7416a1ed authored over 3 years ago by Federico Ceratto <[email protected]>
0.39 Cleanup

1f4fadd9e5dc1610a9702e88c083b268629dccf6 authored over 3 years ago by Federico Ceratto <[email protected]>
Remove comment

0b68c5284bc1796969e9eda187e166b32d35b1c8 authored over 3 years ago by Federico Ceratto <[email protected]>
Bugfix

09cd2fc381defef5ffb0eb4931b7d66a9b635cc5 authored over 3 years ago by Federico Ceratto <[email protected]>
Minor fix

10600b75b89c817d2f331b25c489156c436f27fc authored over 3 years ago by Federico Ceratto <[email protected]>
Add init_scores

e5ac999fee367930137c5fd51b64b3818d680440 authored over 3 years ago by Federico Ceratto <[email protected]>
Refactor comparisons, remove imports

cc06f567678cbb245286863506dfeafdfe6935c2 authored over 3 years ago by Federico Ceratto <[email protected]>
Remove multiprocessing for manual CLI run

cd8e7d1162b5b4c33313634c300c83b9219ef128 authored over 3 years ago by Federico Ceratto <[email protected]>
Add blockpages up to ID

f3ec027aa31996f27eb4a80c9f9f2f2b0ad30532 authored over 3 years ago by Arturo Filastò <[email protected]>
Fix typo in utils

c8d6b8c8f6fed8c6eadfbe494b898f54020b2097 authored over 3 years ago by Arturo Filastò <[email protected]>
Add all blockpages from citizenlab repo

2cd49756a22194a38ba2a2d537d1e4c4c3a6fd80 authored over 3 years ago by Arturo Filastò <[email protected]>
0.32 Citizenlab fixes (#248)

* Deletion workaround
* Return array of dicts

456b9812f57a4814b333ee8ed22ec01352a4f1cb authored over 3 years ago by Federico Ceratto <[email protected]>
0.31 Fix CORS (#247)

fac00350e1520fbe81b9ab05b59ed7492cb3a196 authored over 3 years ago by Federico Ceratto <[email protected]>
Merge pull request #244 from ooni/docker-compose-tests

Docker compose tests

692816a816d71f273a00da58612740049b58bec5 authored over 3 years ago by Arturo Filastò <[email protected]>
Fix some more integration tests

b9d1cb2094e9de189917c2ddf31c691f48685bbb authored over 3 years ago by Arturo Filastò <[email protected]>
Add tmate debugging support

14ce99f1943eea7506c54fb45ac342baf2af23cc authored over 3 years ago by Arturo Filastò <[email protected]>
Update docs with new instructions on how to run tests with docker

dd82508469d8ea8a1952ad67aa98c835acbf8efd authored over 3 years ago by Arturo Filastò <[email protected]>
Disable end_to_end tests

f2019267bb50e5c063c9319c4e00411b9c4e3771 authored over 3 years ago by Arturo Filastò <[email protected]>
Set the LOGIN_BASE_URL to CHANGEME variable

9a3ab4ab66792c5750b095439eeefd68a99ebb3b authored over 3 years ago by Arturo Filastò <[email protected]>
Fix the tests which use the token

3580f4232e06a935b574c95c36852205cbef36fa authored over 3 years ago by Arturo Filastò <[email protected]>
0.22 Add counters_test_list table

a78c59adf41ffa3069706d22963227338f233009 authored over 3 years ago by Federico Ceratto <[email protected]>
Wget debops-ci

15501b9c05611cbc76461b5d57c03756d12b402e authored over 3 years ago by Federico Ceratto <[email protected]>
Fix the user-login test

ed091aaa4c7768b3960814f99e5bc488f8a71d33 authored over 3 years ago by Arturo Filastò <[email protected]>
0.30 Switch to counters_test_list (#246)

0cd7fdf4c190fb8818e80dcbb5459114e7a8422a authored over 3 years ago by Federico Ceratto <[email protected]>
Additional permissions to amsapi and readonly

25451a26b543586b5e865a9c55eceb4b5e714157 authored over 3 years ago by Arturo Filastò <[email protected]>
Update the metadb schema

f70c77d862e075fcabce0f92d1d0b51f7ae635f8 authored over 3 years ago by Arturo Filastò <[email protected]>
Run only the passing tests

d1edde393352807372df4880ee18359fd242c44f authored over 3 years ago by Arturo Filastò <[email protected]>
Comment out broken test

The error is the following:
```
r = client.get("/api/_/url-priorities/WIP")
asse...

3070b292b2e58d1a9cc2582d88564434e05234dc authored over 3 years ago by Arturo Filastò <[email protected]>
Add DB fixtures

* set SSL settings to false to make tests pass

9592a98b4a6f5da7d28e61e748bdfa3879b9840b authored over 3 years ago by Arturo Filastò <[email protected]>
Vendor some sample tables for use with the DB

ea26b35d20d9b6534b8d4eeb338dfbcb97a7ff2b authored over 3 years ago by Arturo Filastò <[email protected]>
Download debops-ci from ooni/sysadmin

e468b8aff16d0cd10ad0c8abb848d7fd8f740db4 authored over 3 years ago by Arturo Filastò <[email protected]>
Port workflow for building and testing package over to gh actions

* Drop circle ci build

bb3136a706e1d759140dda6f04fdac82d9a1b95b authored over 3 years ago by Arturo Filastò <[email protected]>
Comment out test_new_api test

0ed721db1613400bc87430ef621a1a0e1b643347 authored over 3 years ago by Arturo Filastò <[email protected]>
Update debops-ci script

e7cc1bd05151f16e7380a4101f8efdfb3a75c821 authored over 3 years ago by Arturo Filastò <[email protected]>
Fixes related to testing

* Delete tests nested directory, otherwise this leads to inconsistencies
in the __pycache__ file...

34edb7b1ce14f6206015fc4ccb3443c9627d8ef6 authored over 3 years ago by Arturo Filastò <[email protected]>
Enable docker-compose based tests

c28d548962fde23623e1a5110ce938358456f914 authored over 3 years ago by Arturo Filastò <[email protected]>
Move build_docker into Dockerfile to make use of Dockerfile caching

fa6e7fee7344c78fa9d6043377b722e823b579d1 authored over 3 years ago by Arturo Filastò <[email protected]>
Implement docker-compose based build

3b5ac8585452ab237653854925069ee347fb0afa authored over 3 years ago by Arturo Filastò <[email protected]>
Update init_db script

d57a54842b12f76ef8d1da30367e94801dbfcafb authored over 3 years ago by Arturo Filastò <[email protected]>
Install git

92489e6fa3bf30de4baec99a1b60dbfddf68fa53 authored over 3 years ago by Arturo Filastò <[email protected]>
Fix debian repo URL

* Install the OONI gpg key
* Install gnupg

696fb27e2bb44f134c0d95f2e411d06b9f28a7b7 authored over 3 years ago by Arturo Filastò <[email protected]>
0.29 Get logged user metadata (#245)

Implement account_metadata
Implement explicit no-cache responses
Support credentials in CORS
...

5aa69a1cdb30b7ed0a9eba748fd25d84bba7dd99 authored over 3 years ago by Federico Ceratto <[email protected]>
Cleanup (#242)

350f64f355ce847e5330727dcbafbeab2eb1f2d7 authored over 3 years ago by Federico Ceratto <[email protected]>
0.28 serve Tor and Psiphon configs (#236)

5a6d15c7b0e0db04215593de9742ffb5c6214229 authored over 3 years ago by Federico Ceratto <[email protected]>
Fix mypy tests (#243)

d942277cc3262c4633d57d89dc803c7213f59b7e authored over 3 years ago by Federico Ceratto <[email protected]>
Minor fixes

08a7a33a24c03a44a4adf7dfc2f18200a286a6f7 authored over 3 years ago by Federico Ceratto <[email protected]>
0.21 Add URL priority generation.

Depends on the new url_priorities table

06b4cf5340092c03b79b3db8783af70a81883266 authored over 3 years ago by Federico Ceratto <[email protected]>
Fix import, add assert

eee9ff602c6c9d29479e7dc580d0df22bf355269 authored over 3 years ago by Federico Ceratto <[email protected]>
Update example

4779b3364b6beceef72cb56fcf590b8f0249df23 authored over 3 years ago by Federico Ceratto <[email protected]>
Add authentication and citizenlab API (#232)

Auth API, citizenlab URL submission system, URL prioritization

b2f17ea1d6c721c5832ed91c7286c919896d6102 authored over 3 years ago by Federico Ceratto <[email protected]>
Handle missing user-agent (#237)

https://github.com/ooni/backend/issues/505

15ad0bc86f865366a38d0f12d906272e1a2a67d4 authored over 3 years ago by Federico Ceratto <[email protected]>
0.26 Improve test-list generation debugging (#231)

655db209adca76af853271cf28d768c3b85bcbe7 authored over 3 years ago by Federico Ceratto <[email protected]>
Cleanup (#239)

16330f3c3545e398734c06c60ab8e77bead3a7e7 authored over 3 years ago by Federico Ceratto <[email protected]>
Cleanup

df03f94bfbbffd9747636e9b801efb370988b90e authored over 3 years ago by Federico Ceratto <[email protected]>
Use debian_support

7ad749b49ae779167b85e0b11ecd96134b80940a authored over 3 years ago by Federico Ceratto <[email protected]>
Use packaging instead of apt_pkg for version compare

f957e5f570f29c2489b6ad1c21112d725702db9e authored over 3 years ago by Arturo Filastò <[email protected]>
Add example

504e2abfce1568a209e7b795797240802a12f5f5 authored over 3 years ago by Federico Ceratto <[email protected]>
Deployer - initial version

e84c9f2218480201cb9394e0dc3650258ba9eb79 authored over 3 years ago by Federico Ceratto <[email protected]>
0.19 Stop using TRUNCATE

242c614878f3bba1c8af731cf454b9a9cb0b2df9 authored over 3 years ago by Federico Ceratto <[email protected]>
Improve workflow

1390b212fa7299538f3e42291414622399618320 authored over 3 years ago by Federico Ceratto <[email protected]>
Add github deb CD

277a8db3cef4aac933ef45e1fc9d836e60e502a3 authored over 3 years ago by Federico Ceratto <[email protected]>
Add debugging

47a0779e48817bb7e2d51c55d87e5124283f6d91 authored over 3 years ago by Federico Ceratto <[email protected]>
Change bucket name

c259d032365c3c253bd0ace5e962623293497355 authored over 3 years ago by Federico Ceratto <[email protected]>