github.com/ooni/backend commits | Ecosyste.ms: OpenCollective

shovel:0.0.18 - update `awscli`

705e8b0d68894aa6a13e2ea74a1833ccd4d2ce9a authored about 7 years ago

shovel:0.0.17 - re-implement part of `aws s3 sync` to speedup uncompressed file upload

eb028d8ba753ec99cd01d9cfe77bb9b5c74d2736 authored about 7 years ago

shovel:0.0.16 - avoid scanning WHOLE S3 bucket for every mini-batch

fd86c9cf45918aef69b8bd49ca436260a09b1827 authored over 7 years ago

shovel:0.0.15 - `tar -I lz4 | aws sync`

ecd5ab315510dc7c23a9721faf029b90baddee17 authored over 7 years ago

aws_s3_lz4cat_sync.py to upload decompressed jsonl.tar.lz4 to AWS S3

d446edae9462aea6031c109c19475504f55c1254 authored over 7 years ago

Add aws_s3_cp.py command

9ede0925d3b4cfb02b88d75b18fa5625def328bb authored over 7 years ago

Merge pull request #97 from TheTorProject/docs/3.0.0

bc938e62be3132d60362fc21d20e884d64130c53 authored over 7 years ago

Update .gitignores

3d1fd7fc379b34e07b7b1d2f330b8be7ef327806 authored over 7 years ago

Add link to more docs

d74f4ccca7b5c405061b8580606a0f630de46fe2 authored over 7 years ago

Update Readme.md with new pipeline information

33f976735e833d9aeb79fb698869d6b5dd2d6017 authored over 7 years ago

Rename old readme to readme-2.0.0

8907ac8ff37e05a55feebb2ff705fab3f882f4cb authored over 7 years ago

Bump version add changelog

3f8508ebdbb605859290427d5dae3bbc2eb107f1 authored over 7 years ago

Remove in process Flask-Cache

ebdc7e3758aead49a81ecb5f838c3e116472eb33 authored over 7 years ago

README: reference pipeline-16.10 (aka pipeline-v3)

e3e22ddc40a33ef49e992cd92a242d4012ba5e86 authored over 7 years ago

Merge pull request #62 from TheTorProject/pipeline-16.10

Declaring pipeline-16.10 stable. Just a day before 17.10 :-)

eed2c1a0d93f43677b6ae5b8cab0fb91c99eca57 authored over 7 years ago

Bump to 1.0.0 stable :rocket: :tada:

27c577aaa689fdbc3ad91bd9f78a94279e5f87dc authored over 7 years ago

Add stylesheet for apidocs

e9ae3c4f542014147575273175cbec76a5fa2555 authored over 7 years ago

Add simple curl example for API usage

Minor style improvements to API docs

7eb54685d2c54c285766bb5c7111fcbf40c2deab authored over 7 years ago

List the /measurements endpoints before the /files endpoints

067298abf1c1a173664e0dee3521b8c6d9f6ab7c authored over 7 years ago

Fix typo in docs

ddf160392ea3480cfa6604e04ca3b2728138ff21 authored over 7 years ago

Bump version, update changelog

676f2019c291d02881a7fc73ba9129982961108d authored over 7 years ago

Fix handling of input

bc0f1791a6f9355eea07c3271d38be4aa50fcfb3 authored over 7 years ago

Add loading text in API docs

f1b35943073f9e3b1785f7b492ccee0637deac0c authored over 7 years ago

Remove debug line, be more loose in accepting failure,confirmed,anomaly

a25d1576f243d1594ff4dd6f064d375897ed7c0b authored over 7 years ago

Start writing stable changelog entry

f19b15ce58ae14bc1a37c5c8def8dfc66c1df966 authored over 7 years ago

Add changelog entry, bump version

091f2f2c3afcefb2c7b9d83b54d50f62a3d38a13 authored over 7 years ago

Import copy from https://github.com/TheTorProject/ooni-measurements/issues/40

af767f9654b77bd2abe0f202a72e95c2e2ac1dcc authored over 7 years ago

Update API docs

7f952b3af53608ddb5ccfd735e7034e9eac89238 authored over 7 years ago

Stylistic improvements based on input from @elioqoshi

4401bf891ce32b30154f44c3cefa087ae7950475 authored over 7 years ago

Use false() sqlalchemy expression instead of python False

It claims better DB support

12d8ef7c64a10e7f1f502839264c8ecd064cc883 authored over 7 years ago

Reverse sorting in by_date view and hide measurements from time travelers

d98bbebb1065abf99ffd4c96c1ff653bf96fd30b authored over 7 years ago

Bump version

72280d38f88f02ccd190b35fb9f9a92cff1012db authored over 7 years ago

Push to the correct app name

c62b7930463c936b670cb42ebe0e94be2205be49 authored over 7 years ago

Fix parsing of anomaly,failure,confirmed

5f34e61a96c9dcafeb27df30e5e751e7761c2bb9 authored over 7 years ago

Bump to rc.1

02ccf57b7d4290c6e47d95af3d9bcee8feade9ab authored over 7 years ago

Merge pull request #38 from TheTorProject/ui/oonification

Oonify the OONI API page

dd121822365bd01d5af7b61d25db53a8c96c3ebf authored over 7 years ago

Remove box-shadow and align to the center

7bd63e34695135a7c595a231c80e18609bc04fe6 authored over 7 years ago

Add fira sans typeface to package.json

20d3b91111792d872e020c0d7f6233af1ed7c472 authored over 7 years ago

Import assets

54b0fecc05b849a7458264ec4bb1988b963c22e7 authored over 7 years ago

Oonify the style of OONI API

8f65c191a85d35b9d975efc0b540e18e9ed6d910 authored over 7 years ago

Merge pull request #37 from TheTorProject/refactor/no-compose

Rip out docker-compose stuff

f90e09b9ae49e90af498d76304d63869146ad170 authored over 7 years ago

Replace mentions to OONI Measurement with OONI API

923c245124388cdee96fd6ac2c697ddf2ddc29b9 authored over 7 years ago

Add .coverage to gitignore

3d8eb3047b98ecd94cbaffa3347198d32de699d9 authored over 7 years ago

Add psycopg2 dependency

bd1ca91cae6c37cdf501c89942037a0eeaa78d73 authored over 7 years ago

Add support for passing DB name from Makefile

c6a4617846acb9e74bedcb302a267da6b0528951 authored over 7 years ago

No need to start serving measurements app in travis

49a3a4ded8d17a99e7e946a74ca1e2b2b03ff797 authored over 7 years ago

Set a sane default database config.

Create ooni_measurements db in travis

228734fc0a953a8428a12c5a24d4d36e7ddaf565 authored over 7 years ago

Adjust travis CI

0a4226bd1abbc006609ef45570619a91db521099 authored over 7 years ago

Merge pull request #31 from TheTorProject/feature/anomalies

Feature/anomalies

468890b793de38fcf7ede8813ac1a7848f17de97 authored over 7 years ago

Rip out docker-compose stuff

faec3c451391f464c5b2127f74f879cb461fe5b4 authored over 7 years ago

Fix off-by-one error

a09daff4d12d46cebdeb352f28a9bd6cb1b04cd3 authored over 7 years ago

Bump version, update changelog (#112)

0f1889cbc0e5e5b3adc22b9721a608c735d1e109 authored over 7 years ago

README.rst: also apt-get install libdumbnet-dev (#108)

Reported by @meejah in https://github.com/TheTorProject/ooni-backend/issues/107#issuecomment-297...

9b168c6e52c5a379ffa293db13a03bfe8b9514c7 authored over 7 years ago

fix(report/handlers): accept more semver versions (#111)

* fix(report/handlers): accept more semver versions

The current problem we have, specifically...

8ccede151d53cf52938eec9f57f8c9f495800829 authored over 7 years ago

Handle the case in which no measurement_id is found

06639c26f57e467c0d18f9cdca90664ff8b749c6 authored over 7 years ago

Add missing whitespace

0c060cc8f6e7bbea81b628013d61735e4f033085 authored over 7 years ago

Rename measurements.ooni.io to api.ooni.io

e122174d9fc4ce8d29f4cc6296021ab031ce3510 authored over 7 years ago

Add support for measurement_id workaround

fe6e1735b71d21bd9ed452d724c7cf59cd6d01bb authored over 7 years ago

Do not consider the default to look for anomalies

* Fix bug in setting input

4b24aa37913e441cc3cabf38783023ae1c65e9f4 authored over 7 years ago

metadb: set names for anomaly columns (without indexes at the moment)

421f1471c4c20a4c96f0b4f2e1c4c58387629add authored over 7 years ago

shovel:0.0.14 - canned/index.json.gz was not WRITTEN as a gzip file

cace129189216d66510f7fa921d6d8d80196ffc2 authored over 7 years ago

Add missing import

f2ad19117e65981c4e4c18bfe22dfcbead64f0ca authored over 7 years ago

Joining on Label table should be an outerjoin

a69107e1e7e4da54a7a3a2f1b16a7680209cf228 authored over 7 years ago

Add label_no

bc626eeb63690e41e24df2d476205bb4be6e7e42 authored over 7 years ago

Implement anomaly API endpoints

7400252b3a1a454c674d28910a8d70330e24ad8a authored over 7 years ago

Implement the Label and Anomaly schema

Proposed by @darrk in https://github.com/TheTorProject/ooni-pipeline/issues/76

1b021ceda9da5267f92b4dafa3b27a059c8f469b authored over 7 years ago

Start sketching out anomaly-level

419f333a0fea860e4296fca62519341db3f47071 authored over 7 years ago

Add anomaly_type (ex. anomaly_level) field to measurement spec

* Refactor the measurements swagger spec to minimise duplication

ecb843f56ff7930149b738eb583d306869f0d4a0 authored over 7 years ago

shovel:0.0.13 - canning/index is gzipped now, duplicate reports are tracked in metadb

dcfc6c109c1f686454abdc655d04e108aa3368d1 authored over 7 years ago

Merge pull request #33 from TheTorProject/next-frame-newline

Add more tests for decompress_autoclaved, use smaller file for full-file test-case

6b3579c01e60332f0d934fa569cff38ddf8f13d0 authored over 7 years ago

shovel:0.0.12 - skip LZ4 frames while skipping duplicates

4b6762871cc2e4aa2126cf9987b31ecd10b448e5 authored over 7 years ago

shovel:0.0.11 - skip cross-bucket duplicates

830ab169dd20f8b0725893b069bad96c21cc2477 authored over 7 years ago

shovel:0.0.10 - capture one more postgres exception during COPY

6e8462fdeb1543c958b5e245f4d99b3d61a25e1a authored over 7 years ago

Fix off-by-one error in Range header, fix unicode compat for Python3

80ff69f73194d63e5e5729f360282806cd2f5307 authored over 7 years ago

Make decompress_autoclaved more robust

- against python -O stripping `assert` lines
- against trailing `\n` in separate LZ4 frame of un...

9a8c3b64a2ee2843f848430a99dc75d3c1d7c349 authored over 7 years ago

test_autoclaved: mention report with 1M measurements

54a582b3ce69ca379af47d1d1c67092928c9001d authored over 7 years ago

Make test_autoclaved parametrized to make output more readable

ae47317382d928c96f3f0ab306f6a12d352ce83e authored over 7 years ago

Merge remote-tracking branch 'origin/fix/node-requirement' into next-frame-newline

4b1fcb9d357397a2f58e314b1d4d8e79b4e26f59 authored over 7 years ago

Add more tests for decompress_autoclaved, use smaller file for full-file report test-case

abb14cb55af4518b3040fbd7a253260e8c56511f authored over 7 years ago

Loosen node requirement

93f367c7c4ddb3e933ba1442e809b4fc3f21f6e9 authored over 7 years ago

Merge pull request #30 from TheTorProject/openapi

Openapi

7792be424551415448b7a2a78c0628f3a55ecbdc authored over 7 years ago

Merge branch 'master' into openapi

3622c01911b7310edaf446d3d6c6454b836381f2 authored over 7 years ago

Perform join on input table only when input is defined

7ac86cf954304370abc3efa311aa9b6a98377bac authored over 7 years ago

Merge branch 'master' into openapi

f1a610fdba1b006dfb7aac4bc92d1662bb0f4222 authored over 7 years ago

Refactor the chunk generating function to make @sbs happy :kissing_cat:

eaa2035ba5c8353855bfb3dfceb7bb16d201461c authored over 7 years ago

Print `repr` instead of `str`

df577973effd8e0ad422922ec17d909beeaf21e2 authored over 7 years ago

Add some extra sanity checks and fix bug

Based on feedback from @darkk

8cc097d5d9cbb2e073a9ffd7f3d79283054986ff authored over 7 years ago

Fix off-by-one error

a532842a5829948eac658dfb26523d3cd9a209dc authored over 7 years ago

Remove unittests on private methods

f08651d91b7f83850e011c4fb91849f62804ebbc authored over 7 years ago

Implement subquery approach recommended by @darkk

0c108284f04c6a8b40cdd31012d20beb41b14138 authored over 7 years ago

Implement download_url based on new ooni-pipeline

13539244d16862589a1e108103407e4823b0f4d4 authored over 7 years ago

Use yarn instead of npm for more reproducible building

2334bf33db02eb281efffef3d27a64bd2d91d81c authored over 7 years ago

Rename test_function to test_smoke

bbb164fa7ffde97edbfe7d30a78df6ad17117899 authored over 7 years ago

Write failing unittests

7439ea9601b893b8734af7a78eb168a28a883767 authored over 7 years ago

Fix the autoclaved download file to pass all the tests

Also thanks to @sbs and @darkk for pointing some of the bugs in this

4db109f1ed3fa884d38cfef66067e49e11e004f5 authored over 7 years ago

Add another test case and enable debug mode in unittesting

29f4fe91f7299600c4a42b3001ed53b8f0347803 authored over 7 years ago

Refactor comment in unittest

972df7374074689ec31f6b49fdd038aa193e22e1 authored over 7 years ago

Remove references to REPORT_DIR

suggested by @sbs

425bc28a9ee3721d76e90397d0fee9d870750e3d authored over 7 years ago

Python 3 strings are weird...

4a592989fadd1d8dce651c3e990e703068773ca4 authored over 7 years ago

Remove unused labels

fd562aa17a6015843d75b33acdfcfdc0e180829c authored over 7 years ago