github.com/ooni/backend commits | Ecosyste.ms: OpenCollective

Fix parsing of time stamps

5a9e8bbb043e05ee8a5bc91174956bbf00b15b79 authored over 8 years ago

Add more lax regexp for turkish blockpage detection

3506bc474ef7dc77290384c3cf2f618a1cc15fba authored over 8 years ago

Merge pull request #30 from TheTorProject/feature/web-connectivity

Add support for processing web_connectivity measurements

f909e72576226c3471bffc5c104766337f60a38c authored over 8 years ago

Add example of cloudfronted alternate addresses

5850bbb966546f8af5d1d0c2610f3ebfa81ac549 authored over 8 years ago

Add support for processing web_connectivity measurements

this is very ghetto...

505f7cf2f970bb96c20c71bba039ab4c42633030 authored over 8 years ago

Implement fix to serve also intermediate certificates (#95)

* This also changes the configuration to have to more options for tls
endpoints (privkey and f...

f5b96d47d79f928bb88e1536fca72d0716fadd22 authored over 8 years ago

Add support for specifying the collector-alternate field (#92)

Through this it is possible to specify HTTPS and cloudfronted collectors

dc9aac507435574dd86f044f7bfefa6aa569a395 authored over 8 years ago

Add UK block page fingerprint

9eefdc20a7e339328b37d8e3eb073dfa421a8709 authored over 8 years ago

Move state of reports to the filesystem (#91)

* Remove state from in memory to support graceful restart of backend

* Instead of having the ...

6c4d5e94834731273fac65d702e9502517e7654f authored over 8 years ago

Add support for ignoring ASN

3ad2bb4551070fcfceed60d4b8ea06a93ed99d9c authored over 8 years ago

Add note about limitations of the gen-ssl-key-cert

63ea33f56a1d52a75c6dd0c3035f5191b773ad19 authored over 8 years ago

Fix markup

6bd4a245f1dc210d04085664e70a0a66c978bf88 authored over 8 years ago

Update Readme with information on configuring bouncer.yaml

6e9bbb27ce5f69a5c93383684a51d316ae659184 authored over 8 years ago

Update changelog and version for 1.3.0

88e9411a92ed50f4ac92e201e8e32c970278a2df authored over 8 years ago

Map also the connect_error (#85)

2b92f6327fc2bcb4da06e686fbc3b5b4fc4bbbe6 authored over 8 years ago

Fix privilege shedding and daemonisation of oonibackend (#80)

* Fix privilege shedding and daemonisation of oonibackend

* Rewrite to use twistd

* Launch...

5940999a49af50ff49aeabb1103543889c598312 authored over 8 years ago

Vagrant: use box canonical name rather than URL (#84)

This allows us to get updates running `vagrant box update`.

While at it, add `/.vagrant/` to ...

973c9b0c2ae089e3043253890148d25dd550f756 authored over 8 years ago

Feature/web connectivity (#63)

* Add web connectivity test helper

* Forward test helper addresses to the host machine

* A...

5178fc299d361c9ab57002e619e40b05061f5a7d authored over 8 years ago

[hotfix] Only create bouncer endpoints when it's configured

f03f8055d44d3bbb7cbcfb789946ba67a94e1e52 authored over 8 years ago

Document configuration (#78)

* Update README.rst

* remove old configuration option

0396a55a27e9923537a6cd3d743d37009ef4715b authored over 8 years ago

pass tor_binary config to txtorcon (#79)

0b6477c7af96663d2b0d853db66e413cdd599b30 authored over 8 years ago

Handle empty bouncer_endpoints and collector_endpoints

* Set tor_data_dir to null in the default example

9437610ec476c2c20150a905fbeac7e01908c8b7 authored over 8 years ago

keep old config behavior with new endpoint code

575f0aa5a44d1f851fb3d4fbb1bcf1fbf36a4f2d authored over 8 years ago

Add fingerprint for Norway

065ed445847250d3a552d1809846e5391badbefc authored over 8 years ago

Add fingerprints for Italy, Cyprus, Denmark and Portugal

8fa0e0b93298db269c6fb9008d4aa783107d4122 authored over 8 years ago

Merge pull request #23 from TheTorProject/fingerprint/be

Fingerprint/be

fdf659c7f294f2f2e9f60cd9a5bcb25e64fd02b1 authored over 8 years ago

Add new WrapperTask to update the fingeprints for the materialised views

* Force all RunQuery tasks to update every time they are run by setting
task_id to contain a...

85e9ff0bc6fbd7853d67b05b3ccf189a7258d122 authored over 8 years ago

Add fingerprint for Belgium

ee2001ff8e0402c41612efcf97fa58ea9fe22420 authored over 8 years ago

[hotfix] handle new and old formats for test_start_time and measurement_start_time

e16aa7c9ee35d36dbec1ed218ab16b36efdaf7cb authored over 8 years ago

Merge pull request #22 from TheTorProject/fingerprint/qa-kr

Fingerprint/qa kr

cf3f765086016ed8b6f9e92c2e8dab566f226343 authored over 8 years ago

Merge pull request #19 from TheTorProject/feature/df-0.2.0-yaml

Handle also the case where a report is submitted using YAML, but is o…

d5224a645da4ca0450248af05c626f4403a4ecce authored over 8 years ago

Add fingerprint for location redirect in Korea

5093ef32ce2f57c3fae7d7da7f2eda787bfe4549 authored over 8 years ago

Merge branch 'feature/https_endpoint'

* feature/https_endpoint:
Ensure bouncer_endpoints and collector_endpoints are by default empt...

612eb5a1c7a6ea1f2f83d3eb7a9f5ffb1d68c64f authored over 8 years ago

Ensure bouncer_endpoints and collector_endpoints are by default empty lists

90ca955e970ef30c5963acce77c5f736372fc440 authored over 8 years ago

Remove unused imports

0bd12a10549d214fff93c4b11e14b5d62bafc0ea authored over 8 years ago

Fix typo in gen-ssl-key-cert script

d7f9a4c731acd9979376fa73438d4e8afae75446 authored over 8 years ago

Merge branch 'feature/https_endpoint' of github.com:TheTorProject/ooni-backend into feature/https_endpoint

* 'feature/https_endpoint' of github.com:TheTorProject/ooni-backend:
only assume HS endpoint w...

4141c6a1485a32a7c0e43161201c77150b665a3c authored over 8 years ago

only assume HS endpoint when tor_hidden_service: true

35ccea7dbf2b4b3a5d6d72c11f2bde34efd29286 authored over 8 years ago

explain + bail out when inconsistent config

3bcce2080b6e986c992c9cad9dc4b8e25bebaa10 authored over 8 years ago

Move gen-ssl-key-cert to scripts directory

dda3f4d2412ee4f2e2c681f562cf07297dbe9de9 authored over 8 years ago

Download openssl with wget as well to fix SSL errors on MLAB

94d34521e9ec7f6a61b1d486dbc53506cb9034cb authored over 8 years ago

remove another print from debugging

2fa28488fc6dea793da147f9f1bd7a87961ec7a7 authored almost 9 years ago

maintain old behaviour

5fa24c3364c4349995d3bb1ca900dc54e546f5c4 authored almost 9 years ago

remove echo server i used for debugging

8e359977af6f92829a27eb45fe4be0a4cda0435a authored almost 9 years ago

easily swappable {TCP, TLS, onion} endpoints

8ef4dc35b303d0b1e7d3e5ee0cc8a0f3e2eac240 authored almost 9 years ago

Add blockpage fingerprint for QA

26b7368f1bfe69991edc903683e9f36d83edefc0 authored almost 9 years ago

Download some with curl some with wget

For some reason curl on mlab is failing to do a SSL handshake to
dist.torproject.org, while wget...

6f1eb71d1ffb1652fb86da256fbe0897973c228f authored almost 9 years ago

Use wget instead of curl for downloading packages

6633f938312fcfd229a4f3157fb0f8ba6fe2b76b authored almost 9 years ago

Update tor and openssl versions

331b16d3a311c48105f6d1582ad1916a614a2700 authored almost 9 years ago

Set date in ChangeLog

* Clean up requirements.txt

* Clean up Vagrantfile

3af8ff3b8f387edf88d7d4a8e877b7cfbe63418a authored almost 9 years ago

Bump to version 1.2.0

c1f2125e5d72fc376fdf67e7f1fef20bac04eea8 authored almost 9 years ago

Convert msg to debug message to avoid generating too much noise

4c279e83c12d9fc3dd6f82c6479a620f38f0b71b authored almost 9 years ago

Handle also the case where a report is submitted using YAML, but is of the new data format.

2f0f561e578c5a1d1a5c41e592e1b2ee29e6b3f1 authored almost 9 years ago

[hotfix] remove addition of sent and received keys

f9b3360161988c1eb55d71d1e50cd934021a4936 authored almost 9 years ago

Merge pull request #18 from TheTorProject/feature/ignore_cc

Add support for ignoring certain country codes when processing reports

dfad674bfb9e3009b5d7e460e5bf4073baa6778e authored almost 9 years ago

Fix bug in setting test_start_time

a669c538a8407e9a4585a5483a94bbca72e5ac73 authored almost 9 years ago

Add support for ignoring certain country codes when processing reports

4b4316941d4be94c24bb65d83cc4719e6bbea29f authored almost 9 years ago

Cast probe_city to string

a08539cd5a9a53ca398b9a1c99637c9449415de5 authored almost 9 years ago

Fix nesting of measurement_start_time

4674b0ecc946b33600608fd57a13ea501bf1678d authored almost 9 years ago

Add measurement_start_time to represent the old value of test_start_time

4a67c63cc4afbad2b485dca9cbb67683369659d1 authored almost 9 years ago

Failback to using test_start_time

34fdeacf297c17c8111a94d537af4856e360cdac authored almost 9 years ago

Deterministically generate the report_id

28746fe0e09ff11d0e53313457ac43e41e3d371f authored almost 9 years ago

Vagrantfile: make sure it actually works

From the works-for-me-on-vagrant-isnt-this-ironic dept.:

1) stop provision script on error

...

0c89c56fab800675223d14c4729f1c737c44337b authored almost 9 years ago

Set the report file template in the example configuration to the default

738eeefedc323103e22ef0ea079be7d84ae1c41d authored almost 9 years ago

Merge pull request #67 from TheTorProject/feature/json

Change the value of the key that is sent by the client in the 0.2 dat…

ce1aafd78c1f85d1584c0f1d3f3cdd939f125c2d authored almost 9 years ago

Add heuristic for detecting blockpage in sudan

160f65d2acd382be95f2e1a96df0db1c73d127c6 authored almost 9 years ago

Merge pull request #17 from TheTorProject/feature/df-0.2

Skip normalisation when the data format version is 0.2.0

1ec4bb7aa7e4b798910646589a5c34b1c30e90c1 authored almost 9 years ago

Merge pull request #16 from TheTorProject/feature/india-blockpage

Add support for detecting blockpages in India

696f40a3ee76906c3b33c5d17e9b5e6bbdeb2cbb authored almost 9 years ago

Merge pull request #15 from TheTorProject/feature/domain_intelligence

Feature/domain intelligence

b92ff0e4eb622a0f02826dbe8522c2cd585b7318 authored almost 9 years ago

Fix unittests to use test_start_time

370fbfbb5485edb060b159fa3517737133806a87 authored almost 9 years ago

Change the value of the key that is sent by the client in the 0.2 dataformat

e60b33a1077bfddf18e38b8e1eaedf2ccf053fe3 authored almost 9 years ago

Merge pull request #62 from TheTorProject/feature/json

Feature/json

715ab94bdee503513851c1851f9d27c7c701f7ed authored almost 9 years ago

Skip normalisation when the data format version is 0.2.0

4a2d4d00b9342cbb495d3408d797bcd61a5066b3 authored almost 9 years ago

Add support for detecting blockpages in India

f8fa8a9b4fa9c0d463ad8d2f65dc9fe1a333f171 authored almost 9 years ago

Implement test that attempts to write to the backend using JSON

d7f9d5990be9975df46e92164eb1b044c97c89ab authored almost 9 years ago

Fixes highlighted by the review of @bassosimone

* Remove duplicated code

* Be smarter and not use else when unneeded

* Remove dead code

bc2f24ffd1e22c9af92345602a3994c40f22d5fb authored almost 9 years ago

Pass report_id to get correct file path

1617489c7d6175e45153a79ee5b1bcbd227948b8 authored almost 9 years ago

Fixes to unittests of report to changes in backend

* Minor refactoring of unittests
* Fix a backward compatibility bug spotted in unittesting

aa920512752b1b1b844b45af1b58e4f838c6d42a authored almost 9 years ago

Add report_id to filepath

8de4e05f7c2b64e2944d5a97dcdc98dfe017ca16 authored almost 9 years ago

More consistency changes and debugging

426a263ff67ce1fe1fcd6872f4c281efe1495d24 authored almost 9 years ago

Add support for better handling start_time

Invert inlineCallbacks

Convert PUT to POST (PUT is supposed to be indempotent)

* Better except...

1535967e420fd2b1bd61fd9001188d4a71983684 authored almost 9 years ago

Merge pull request #14 from TheTorProject/feature/fix-materialised-view-update

Move update views into separate tasks

ae67141cd50f47043c350b1e2a1ab3de149c0c9e authored almost 9 years ago

Set source_updated to 1970-01-01 when it's not set

19dc1b257f9895c7df1ab6e2b7281d4a78aeaf46 authored almost 9 years ago

Add documentation for domain_intelligence

* Add BeautifulSoup4 as a dependency

ae791da8516b5e36fdd3abc0980345c3c4970bd0 authored almost 9 years ago

Implement tasks for loading ASN Information into DB

* Remove unused tasks
* Use logging for writing log files

b577d08c6270c2e71d7c7ddfbcacaeb25d53c5b1 authored almost 9 years ago

Place the update views in a wrapper task

355ac1780f1f05eefb9ea3bf5b5c0148904e888c authored almost 9 years ago

Move update views into separate tasks

a4adc0dbfbcdb5d7c7a031e9138f97d120e36a6b authored almost 9 years ago

Merge pull request #12 from TheTorProject/fix/test_names

Add mappings for censorship circumvention tool tests

e77103b79d1a3a14b7909d03b0329837867196c8 authored almost 9 years ago

Add mappings for censorship circumvention tool tests

1ea5fd209073c529827b5b5970fe3963474fe5c9 authored almost 9 years ago

Implement tasks to add CitizenLab URLs to the database.

Provide alexa ranking, but disable google results (they block us after
very little time)

c1bc248d9863ac61b261d35989d8b9ee0808a9e9 authored almost 9 years ago

Start outlining task for gathering domain intelligence information

* https://github.com/TheTorProject/ooni-explorer/issues/32

99c2caedacf992147ffd0553deded2609bb657d5 authored almost 9 years ago

WIP on domain intelligence

5f85c4b4cbf43fcfa13827e3c7b476c88e78f5eb authored almost 9 years ago

Merge pull request #11 from TheTorProject/feature/refactor-luigi

Fix terrible bug in body normalisation

c6381160da69b40069e5d319e8fcc5449d3db49b authored almost 9 years ago

Fix terrible bug in body normalisation

ee455668f02de9a292464e2e9b4839905e7c02d7 authored almost 9 years ago

Merge pull request #10 from TheTorProject/feature/refactor-luigi

Feature/refactor luigi

66713bdd9552e9826420e303eb7cd2d664c18176 authored almost 9 years ago

Add metrics_table to where filters

7879c1d51e15ff3c9133848350de8ca20a804714 authored almost 9 years ago

Update_id is not callable

c0c5c5129fdc6987a2c079e9bfec6536e050dc43 authored almost 9 years ago

Define the update_id

6d9fe5d8afc19c7cde59b6ca99914017793925d3 authored almost 9 years ago

Compress should depend on Sanitise not Normalise only

b98e43e158c48bcde2f20e69e3deb7ecac5915a1 authored almost 9 years ago

Merge pull request #9 from TheTorProject/feature/refactor-luigi

Feature/refactor luigi

98ce526b9775473c2e643ea56ae6b005b3eb1b99 authored almost 9 years ago