github.com/ooni/pipeline commits | Ecosyste.ms: OpenCollective

Skip invalid JSON

Example:
20170702T053645Z_AS204074_2ahNzbfWPPVyzqr4yxDuyp2ptVuy7BcHWH15uHPnzgoX175A3X

fd89a11068285f4606bfab0875a2b77f91cd4610 authored over 2 years ago

Cleanup

4b4f5405ccb084fd05b7e5bacc74be2409abd764 authored over 2 years ago

Add typing

a90cad2216df854de158b511fa76a879464e8c2e authored over 2 years ago

Switch to new trivial id

5dc43aa6802edfec90c92982be018a4e4bc51bdc authored over 2 years ago

Implement new trivial ID

de762700857261dcde8900e48d28269c3fc70483 authored over 2 years ago

Handle broken measurements better

40195a1b8d7a794a281bd1bb84639196067ec9f2 authored over 2 years ago

Do not generate UID twice. Improve debugging

9ad6d4112980991346df45bfeb83e1336bae6e11 authored over 2 years ago

Improve dryrun

92dcbedc87db3044461af6c75284b0e2ce918784 authored over 2 years ago

0.57 Improve reprocessor

b58394bb18ccc4a38e826b3cf1f18fac1933c4cf authored over 2 years ago

Handle incorrect padding

3013bcc66e0a37fc0c39322ef0682f9abb00252f authored over 2 years ago

Normalize yaml http_invalid_request_line

c72117fab532672f0863d2183a212e72a67c41b6 authored over 2 years ago

Handle broken Telegram tests

f37f99794b8ebd4554a38df0850e77caa0e07bb0 authored over 2 years ago

Add Telegram test file

a508cbef4bc8883a446cfb12337586e44c57d10f authored over 2 years ago

Remove "Telegam"

fb844e4e937dfe973b3f9b327360facc06eaaeaf authored over 2 years ago

Change header decoding

0dbc7ebaf2b6ccd946baefc92d300a3997706761 authored over 2 years ago

Discard msmts without report_id in reprocessor

b1ad36725d1c7c1a68570e61ac74e1f5f062b69a authored over 2 years ago

Remove None as default to get()

0b41fac92fc99c039c54b219c928f8e267403f77 authored over 2 years ago

Ignore malformed YAML, improve error reporting

b2731a3bec8a8d50ebde14ca7ae3ce744dcd52a2 authored over 2 years ago

Rename variable

5c0bce0ea5753c23ab726d0363634e7430a67dac authored over 2 years ago

Handle dash test without test_keys

278e16f8e9cb36fb6520c9bfa7d35f391fd3da41 authored over 2 years ago

Handle binary probe_city

024e82eeee7c67418099da9ed538bab49fc4fc34 authored over 2 years ago

Add hashed value to JSONL file names

0d392fad987862a928168fef56215f41cd1e64fb authored over 2 years ago

Handle experimental Tor test

0b7bfbb2c6e60e7a38e866ebfbaf500cd2ffc0ff authored over 2 years ago

Skip invalid legacy JSON msmts

Example:
20160724T181310Z-GF-AS3215-web_connectivity-20160724T181226Z_AS3215_tdijfX9oJrUKsq3grDZ...

aea20b29aaf6db0ba2247546e97674e60eeac7d7 authored over 2 years ago

Drop sshfeeder

22a30351ecc0a4fa5ebd9b9903c147364462cc42 authored over 2 years ago

Bugfix

c7654654ad16dc7c567a479bd0e5bcfda3f2aa61 authored over 2 years ago

Handle Meek

896f1574922f3b970c4ba84c244ec165bd3962c7 authored over 2 years ago

Debug json serialization failure

6d4d5ed6f34c4016e3977258e49dff3aa64784e3 authored over 2 years ago

Minor cleanup

f470ba63f34b98b0698d48b50801ee5a630a23be authored over 2 years ago

Fix http_header_field_manipulation, add tests

Minor changes

19f8f414b7ce07c79e35089b3cf5fbe8bdc877a6 authored over 2 years ago

Normalize bytes bodies in YAML msmts

972a60114dd031868613c07e7d3d0ccb78d4d880 authored over 2 years ago

Cleanup

23f25e996a5177fab75205e8557a0c421132a261 authored over 2 years ago

Cleanup

e8fc783d64bd05a931bc22cbe39c71ae04f0e4e9 authored over 2 years ago

Add S3 update flags

be1a2c5e792de5bf8db9a71998a66ca95d6a906e authored over 2 years ago

Skip broken YAML entries without raising

b0acc1adea38b2610bf2ff711a773842a2680251 authored over 2 years ago

Add domain to fastpath (currently unused on FSN)

224243c8232ad8f6bf8eb835fbc79987bc62507e authored over 2 years ago

Ignoring measurement with invalid measurement_start_time

9dabd8ec03792e33d18573fe805aac77e044df46 authored over 2 years ago

Normalize website_probe tests

fd5b5ec57c0cc9e024c1bf0e609b1f807bbd2ea4 authored over 2 years ago

Improve error handling in fastpath

88a835d85fab605905a1a1e2c501a9461d64adab authored over 2 years ago

Run rotation during working time

c1c9b078a0484c62f1175bf48a4183fe1b7d4cce authored over 2 years ago

Improve logging

efbd5834a1ac37cdd332daaf3a92f44731419c91 authored over 2 years ago

Update scope of local fingerprint

The fingerprint with IP 195.46.39.11 is a local blockpage used to implement filtering in a home ...

f28502324141b6d7be754f08d7e03200ef2453c3 authored over 2 years ago

Cleanup rotation script

Restart Netdata after Nginx

10c4666bfa61526561ff863c7aaa2f9e311f9838 authored over 2 years ago

fix: attempt to give action write permissions

f968ba52f453a149b8cf20c6d70671aad8c49735 authored over 2 years ago

Cleanup, move test list updater to Clickhouse (#387)

Rotation: use dedicated DB role, add metrics, minor fixes

d1a1dedf49d2022fa91b96263a00c366ee5722d2 authored over 2 years ago

Move test helper rotation script to Clickhouse (#386)

8f1210dbc663b5ea5f2191a7993f71dfbc5b1d86 authored over 2 years ago

fix(get_http_header): sync description w/ impl

Spotted by @FedericoCeratto, thanks!

7c1df1f0d9b28dc517df3383503e21c49dc290ac authored almost 3 years ago

RiseUp VPN: bugfix (#379)

0.56 Add test for RiseUp VPN bug
Add Black conf and reflow

13841587bb847341c32b740a0c11f9ac9e17291d authored almost 3 years ago

Merge pull request #376 from ooni/clickhouse-optional

0.54 Make clickhouse dependency optional

d3df4f6bcd2c79a32e543979d55c45ffa1e43578 authored almost 3 years ago

0.54 Make clickhouse dependency optional

22cc21353063a7f7dbf535cec3ef25397a516eb4 authored almost 3 years ago

Stunreachability fix (#378)

Add stunreachability scoring
Co-authored-by: Federico Ceratto <[email protected]>

71953c66a6292c774e79c6281959889669944ad6 authored almost 3 years ago

Merge pull request #369 from ooni/whatsapp2

0.47 Whatsapp: support http URLs

1e7d3f5fd205c4c84a686b9e47325ce599f5fefb authored about 3 years ago

Update af/fastpath/fastpath/core.py

772c573f7e639054ac198d27e6447a9f65897389 authored about 3 years ago

doc(core.py): document get_http_header

As highlighted in the review, explain the function in general and why we have
added support for...

7ef831474ab7125b7c749ba0397b21928f5ba6df authored about 3 years ago

0.52 Support Clickhouse (#371)

Implement --stop-after, ignore empty cans if any

6609ad42d24e6ac83cbd7d7617668a9427ffdb56 authored about 3 years ago

Add support for parsing legacy headers which don't have header_list

Add basic unittest for header retrieval functionality

47e70fe42048e13ea2d608d328d87c6925c546a1 authored about 3 years ago

Add additional consistency checks for whatsapp blocking

3ea2072e77b3d203a93fc120cad23f588d53362b authored about 3 years ago

Merge branch 'master' into whatsapp2

* master:
Remove duplicate fingerprint
Add UZ blockpage fingerprints
0.51 Extract test run...

1a0b205caf074af4003fff8150307986604d9911 authored about 3 years ago

Merge pull request #374 from vivivibo/fp/uz

Add UZ blockpage fingerprints

cf9c6e4331ba59aad24e11957b3afaa3f433466b authored about 3 years ago

Remove duplicate fingerprint

c098062833a0f5e7c17a5e189c775da90afeb754 authored about 3 years ago

Add UZ blockpage fingerprints

0797dcefefe0fd8c00a8bfb7667730dd58d578a0 authored about 3 years ago

0.51 Extract test runtime and bootstrap time

2a24660ca4b53b51bde3daedde80d8489bdeb37c authored about 3 years ago

0.48 Update packaging (#370)

597decdfadcde0c87862b7692d73164e3ed4e958 authored about 3 years ago

0.47 Handle http whatsapp

4bbae9794739ee5b95ee96c24340992edabe0ba0 authored about 3 years ago

0.46 Flag incorrect date (#368)

d2b0edd091c66a41cc7f86e877a0a6548dc28fe2 authored about 3 years ago

0.45 minor fix on empty "requests" key (#367)

* 0.45 minor fix on empty "requests" key

* Switch package build to github actions

8779ad87914c5323688d8aeb500aac450fd1e0da authored about 3 years ago

0.44 Initial scoring for RiseUp VPN (#366)

5163ca2a6d01ff5958e806ebedf1a46ceb60ec37 authored over 3 years ago

0.43 Filter minican names (#364)

Filter minican names
Remove unused file
Support extracting msmt UID from new msmts
Add suppor...

2fbeb6f5d8ee3e86802c6b1e375895ddd28936ff authored over 3 years ago

0.25 Speedup counters update (#363)

db322f3a1e0b6f9e3d19f567afd30f20db1be115 authored over 3 years ago

Add PL DNS fingerprints (#361)

fa9203e0f11c83303d0b022012f270a3b5e6fbd4 authored over 3 years ago

Add missing deps from fastpath package (#351)

ed8401e0cbc681536580419aa04c4f495addbde5 authored over 3 years ago

Change header in PL fingerprint (#341)

9752bb9a99095876e823a87b290a8434dd3056ef authored over 3 years ago

Publish coverage (#352)

984c4d380e500af5f7da194a2f421a9ab2dae0a0 authored over 3 years ago

0.24 Support SSL certs in test helper rotation (#359)

732c44d0fcb2a4da7b5a9d01b9c147c5dafaf513 authored over 3 years ago

Add torsf test (pluggable transport) (#360)

314fa5bc173cb112da49edda93a8ca70bd32ed7a authored over 3 years ago

Delete cans in local cache (#358)

8774c15be05590e8202fbc04e807fe1e4748bf90 authored over 3 years ago

Add test helper rotation tool (#357)

0.23 Add test helper rotation tool

58c6f3c11b447f1568032b67911d6b71fe2ec553 authored over 3 years ago

Add index

9500ac8c5aa0ba451118c2063144c52ea447df18 authored over 3 years ago

Enable fastpath, cleanup

88700e4dc96c06b9d561c16fd61327eadbfb9178 authored over 3 years ago

Cleanup

583bdca47c0fa48dbb6311a8f203a4e54cd1bd7c authored over 3 years ago

Update S3 path, cleanup

7e53ec728f3286a42eff7afb98d843c823836f94 authored over 3 years ago

Handle normalization errors

fc114a2615e2374f740f03cdeeb3e1e66de8e8f2 authored over 3 years ago

Bugfix and cleanup

85f2b57d5d8f1305d7348b9d7b36f793612af7ca authored over 3 years ago

0.40 Add reprocessing tool

424714fedb19f94bba297d3a63764ff20a876532 authored over 3 years ago

Add reprocessing tool

71ccfb5c170efd97df2b41eec63463ef2633fd42 authored over 3 years ago

Bugfix and cleanup

0016376c19d827710acbc1bc399d8a892d96a5af authored over 3 years ago

Add support for DNS based blockpage fingeprints

3ca9a5272b3c98393088bfb28125aea066fb6c2b authored over 3 years ago

Add DNS signatures from citizenlab

504af1cb1f1843a841cc4a0958ed6e48f2455052 authored over 3 years ago

Match also different types of DNS responses

c858178d256cd9793739ed505453318910c0f3b3 authored over 3 years ago

Minor fix

10600b75b89c817d2f331b25c489156c436f27fc authored over 3 years ago

Add init_scores

e5ac999fee367930137c5fd51b64b3818d680440 authored over 3 years ago

Remove multiprocessing for manual CLI run

cd8e7d1162b5b4c33313634c300c83b9219ef128 authored over 3 years ago

Refactor comparisons, remove imports

cc06f567678cbb245286863506dfeafdfe6935c2 authored over 3 years ago

0.39 Cleanup

1f4fadd9e5dc1610a9702e88c083b268629dccf6 authored over 3 years ago

Remove comment

0b68c5284bc1796969e9eda187e166b32d35b1c8 authored over 3 years ago

Bugfix

09cd2fc381defef5ffb0eb4931b7d66a9b635cc5 authored over 3 years ago

Add all blockpages from citizenlab repo

2cd49756a22194a38ba2a2d537d1e4c4c3a6fd80 authored over 3 years ago

Add blockpages up to ID

f3ec027aa31996f27eb4a80c9f9f2f2b0ad30532 authored over 3 years ago

Fix typo in utils

c8d6b8c8f6fed8c6eadfbe494b898f54020b2097 authored over 3 years ago

0.22 Add counters_test_list table

a78c59adf41ffa3069706d22963227338f233009 authored over 3 years ago