Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ooni/backend

Everything related to OONI backend infrastructure: ooni/api, ooni/pipeline, ooni/sysadmin, collector, bouncers and test-helpers
https://github.com/ooni/backend

Set report directory to /var/spool/$SLICENAME

4a4d36c1da66d9d792bd2d3c3538ed0d9507b02e authored almost 12 years ago by aagbsn <[email protected]>
Use correct protocol in iptables rules. Caught by Stephen Soltesz

771ccadf4babe76bba2171201b033f553e4cd97d authored almost 12 years ago by aagbsn <[email protected]>
Add basic start/stop functionality to init scripts

7c8d82415eebcb03bba755d5cc3b1de89d690094 authored almost 12 years ago by aagbsn <[email protected]>
Update config template

8c8f72ca18a4de0cb01d1b02939cd7c31aaf06d2 authored almost 12 years ago by aagbsn <[email protected]>
Add options.py

454d46068459d46a819e0fde2225a5513bc69d67 authored almost 12 years ago by aagbsn <[email protected]>
Add an example oonib config

7485e71c96e70f846e33b9a9b54db9e7b9263936 authored almost 12 years ago by aagbsn <[email protected]>
Read options from a config file specified by -c

aa9c526cbeacaa28eb8117e20b67188ff09566f1 authored almost 12 years ago by aagbsn <[email protected]>
Define our own ServerOptions

3b8715610517f7fec7dfcafa4138e00b3ecdcd92 authored almost 12 years ago by aagbsn <[email protected]>
Config should have two // in url

03dfc6dee0087df5a206f3e9c0fc70d85f5dfaf7 authored almost 12 years ago by aagbsn <[email protected]>
Fix import inside db/__init__.py

32766a852acf11006162cb38108f540f0ec1b82c authored almost 12 years ago by aagbsn <[email protected]>
Add promptless certificate generation

0a472a5c8d7a1396150e4a3c1283ecc43a4af8d3 authored almost 12 years ago by aagbsn <[email protected]>
Add init scripts to deploy tgz

09b4b4efd7979ee9ac389b3afd95d568a991bb9b authored almost 12 years ago by aagbsn <[email protected]>
Run tar from relative path

9481e2888819f64494384ebd816eb28dec01fbc0 authored almost 12 years ago by aagbsn <[email protected]>
Add python-devel package

abfbccc4f5832df8216b7017ea2fd46481d57d1d authored almost 12 years ago by aagbsn <[email protected]>
Call correct script name

5337ccebf69adcfc9a7546fc0d4b5bbea6c3503c authored almost 12 years ago by aagbsn <[email protected]>
Build Tor and create a tar.gz

6fac9b099aa95820c3ef7c173669ac1e064eed21 authored almost 12 years ago by aagbsn <[email protected]>
Copy tor to script root

2db4fa7fc7a6252dd40cd6510dc3238d7b4d9100 authored almost 12 years ago by aagbsn <[email protected]>
Remove echo.

abb1bc830c9a78b68545b99e52b2a1c447be3617 authored almost 12 years ago by aagbsn <[email protected]>
Install dependency for building static

087e091ba4e4db936c53029121aa072ad5e955b2 authored almost 12 years ago by aagbsn <[email protected]>
md5sum requires 2 spaces

db6d26ff1d19c83cd50c081aec0a8bff796213f0 authored almost 12 years ago by aagbsn <[email protected]>
Fetch with curl, rather than wget

5344a6312cad0a02e2c829db74eaab7df2bb769e authored almost 12 years ago by aagbsn <[email protected]>
HKP keyservers do not support v3 fingerprints

fdb60533cd0957d3dadbd6170bd9fe589590e7df authored almost 12 years ago by aagbsn <[email protected]>
install openssl-devel

6127a2715102131a2c87344c0eab4d7472712fdc authored almost 12 years ago by aagbsn <[email protected]>
Add scripts used by MLAB for instantiating and operating oonib

43835788a91c85107a3a14774d1af792e9266b55 authored almost 12 years ago by aagbsn <[email protected]>
Add script to build a static Tor with Tor2web mode enabled.

0f48189d487add646c9b1234038e33e719548586 authored almost 12 years ago by aagbsn <[email protected]>
Fix a few issues with setup.py

* Rename ooni-probe to oonib, use find_packages.
* Use find_packages to discover nested packages...

515fc04cc67ddfd989fec1ba53f10b10e6afe8da authored almost 12 years ago by aagbsn <[email protected]>
Steal ooni-probe's setup.py

6723eb6494ee35858522bc02234c5fb96130f7e6 authored almost 12 years ago by aagbsn <[email protected]>
Add gitignore

8af8493feb904100b77bba7ad83dbf449e90ac53 authored almost 12 years ago by aagbsn <[email protected]>
Add data directory

b8c375182083ddbce39f8856d81e94d952e3ca43 authored almost 12 years ago by aagbsn <[email protected]>
Add required imports from ooni into oonib

070c52138f8f7480c5135ea6b28e30dbcccad1c3 authored almost 12 years ago by aagbsn <[email protected]>
Fix imports

55c385e12cbf06f380058b06187a402f72cf2910 authored almost 12 years ago by aagbsn <[email protected]>
Move oonib project files into top level directory

67101e2c5f6314bcd8b7431fa86f502306171405 authored almost 12 years ago by aagbsn <[email protected]>
Use Tor mirror of scapy-02-25-2013-tip.zip

71adc58c4872841f829efb2a5cd7edeb9d5848f5 authored almost 12 years ago by Jacob Appelbaum <[email protected]>
Merge branch 'master' of https://github.com/TheTorProject/ooni-probe

* 'master' of https://github.com/TheTorProject/ooni-probe:
Expand the user (~) fragment when c...

084ed2d168b240b6b96c39d3e93daf95ae61d17b authored almost 12 years ago by Arturo Filastò <[email protected]>
Update archive reports script to reflect report format changes

e262a7a688a38ad6bb49d859ceecbe03e5ec3293 authored almost 12 years ago by Arturo Filastò <[email protected]>
Update archive reports script to reflect report format changes

bd1ea92a713fa07beced7d14db3a50c1bde20558 authored about 12 years ago by Arturo Filastò <[email protected]>
Refactor to raise exceptions instead of checking return code

190d4c1577f52c686404042aefb784d62b585f50 authored about 12 years ago by Arturo Filastò <[email protected]>
Add report archival script

323d0c271ed761f9c6cc8cef2f16d64e0446008c authored about 12 years ago by aagbsn <[email protected]>
Add instructions for supervisord configuration and clean up README.md

(cherry picked from commit f2b58c1af72e61adc8611b43a61cb7eedf9c83b4)

f79b3deeac6359ea9bf6851bc5f46d821f40f3cc authored about 12 years ago by aagbsn <[email protected]>
Update oonib README.md

Add insructions for configuring oonib, additional iptables rules for
redirecting tcp and udp dns...

62876ef9b037f4db38d9f369263887234d283c99 authored about 12 years ago by aagbsn <[email protected]>
Revert back to 9212cba (0.0.9) that was the last known working state

commits between 20cd1df9de76b54a77aac22e44f457272354c0cb and
8c0e47c66ca78d6a94beacd90b0bb07a00c...

ba8b8b61d67a7ac629932946d023a9bd7e9ace71 authored about 12 years ago by Arturo Filastò <[email protected]>
Add instructions for supervisord configuration and clean up README.md

3a8eb8414532d6058ee561466624601260523891 authored about 12 years ago by aagbsn <[email protected]>
Update oonib README.md

Add insructions for configuring oonib, additional iptables rules for
redirecting tcp and udp dns...

51e1370c3be558aba9b762167d05f2d9672d0e78 authored about 12 years ago by aagbsn <[email protected]>
Fix bugs in SSL helper

658828804280b7cf1c0796bc09fddd1d3370ebd6 authored about 12 years ago by Arturo Filastò <[email protected]>
Use the HTTP Return JSON headers helper in the SSL helper

f97009da5b9bca06c26e8f0519d6703162c2e22e authored about 12 years ago by Arturo Filastò <[email protected]>
Set the default ASN to 0

* Should be good as per http://tools.ietf.org/html/draft-ietf-idr-as0-06

e7768d4e1b2d38c39d1d079f80ffbf6a940f1892 authored about 12 years ago by Arturo Filastò <[email protected]>
Tor2webMode takes a boolean 0|1

5e10a2c1f67af56866453750effe3e7ef915f725 authored about 12 years ago by Arturo Filastò <[email protected]>
Add config option for enabling tor2web mode on oonib

c5beee07f1c15102e9ed4bf8d1789bb0dfba17f0 authored about 12 years ago by Arturo Filastò <[email protected]>
Thiss

a182e76cf82a2ce8e4d25d2596a361e6e8f16771 authored about 12 years ago by Arturo Filastò <[email protected]>
Fix bugs in oonib reporter

* Add support for setting the tor binary path in oonib/config.py

1c7f7d210d2b83b84f5d9839f125624d800fe7e9 authored about 12 years ago by Arturo Filastò <[email protected]>
Cleanup all the source tree from dead code and cruft

* Create directory for storing test decks

f9fc1d248a4edb3a1ee768e87b77ffa772ee62e0 authored about 12 years ago by Arturo Filastò <[email protected]>
Use twisted fdesc when writing to files

* Add support for processing the ASN number of the probe
Test reports shall follow the specific...

9cfe812fedcb3fbcee0332b066700ff773bf961d authored about 12 years ago by Arturo Filastò <[email protected]>
Make Beautiful soup a soft depedency

* Remove un-needed dependencies from requirements.txt

5bbce25205019c7fcac0a618bdc19b5b4f3f2544 authored about 12 years ago by Arturo Filastò <[email protected]>
Merge branch 'timestamp'

* timestamp:
Change the timestamp format to use ISO8601. * Write unittests for timestamp gener...

28dff745111f4a83a38b5346e3d26fce2ae45a1a authored about 12 years ago by Arturo Filastò <[email protected]>
Change the timestamp format to use ISO8601.

* Write unittests for timestamp generation functions
* Add documentation on how reports will be s...

98e6b4ac2ee773bc78484688258d2d2ebb336290 authored about 12 years ago by Arturo Filastò <[email protected]>
Update style guide

bf31d1d8b37030e19a9cc18d261eee908f66e946 authored about 12 years ago by aagbsn <[email protected]>
Port the test page to the index of the documentation

* Only include the tests that we plan supporting in the first release

35d0496bcf280cb47503ace00e656fb922865088 authored about 12 years ago by Arturo Filastò <[email protected]>
Log to error log file when we get malformed Headers sent to the backend

* Python's typesafe, but it's still good practice

cc63a1a0a7db47b00bc6d2ea6f3c2668c3e5a992 authored about 12 years ago by Arturo Filastò <[email protected]>
Set default helpers.ssl.port to 57006

45baf39cf0f8769d691e9b37d95e6ea18c07cb14 authored about 12 years ago by aagbsn <[email protected]>
Add instructions to redirect low ports with iptables

4c7b8790ec92f11f6e54a7bd8c2f364d25270eeb authored about 12 years ago by aagbsn <[email protected]>
Improve oonib

* More robust error handling
* Add docstrings on not implemented collector parts
* Refactor ooni ...

5b4cac47852e685ffabc7bbededf9ae08fe535af authored about 12 years ago by Arturo Filastò <[email protected]>
Test and Implement HTTP Header Field Manipulation Test

(rename it to what we had originally called it since it made most sense)
* Extend TrueHeaders to ...

8befdb69f363f9d751c8f8d3c6447a9f8d3bf68e authored about 12 years ago by Arturo Filastò <[email protected]>
Get HTTP Requests test in a working state.

* Performs random capitalization of a set of static HTTP Header fields and
measures on the back...

31b59a92e0e97f6c75571a88d061bf523cde3b32 authored about 12 years ago by Arturo Filastò <[email protected]>
Implement very simple HTTP Request backend that does only the part of HTTP we need for testing

aa95e0a3b088f7cc71c0d797866d90f1226c5ae4 authored about 12 years ago by Arturo Filastò <[email protected]>
Update HACKING file with updated conventions for code and tests

3d869cf5cfe74c1637931f2566ca360b7347a855 authored about 12 years ago by Arturo Filastò <[email protected]>
Add line in oonib to daemonize the script

29ffa33521cde2a3f4a01ebeb1b7425c127c230e authored about 12 years ago by Arturo Filastò <[email protected]>
Loosen up the oonib regexp to support the timestamp report format

989eab344e79064565c866cb56fe75b3e75e2f69 authored about 12 years ago by Arturo Filastò <[email protected]>
Make report IDs include the timestamp of the report

16426a1ab1f881d9392f1b2735569147bbf0e65a authored about 12 years ago by Arturo Filastò <[email protected]>
Parametrize datadir location

720de3186c4244f22e4f67a012865edbdc7f0d15 authored about 12 years ago by Arturo Filastò <[email protected]>
Implement first iteration of Tor Hidden Service support for ooniprobe and oonib

* Also with better error handling for reports

8ae14e30cd837753ee5116d171286a8364eca46a authored about 12 years ago by Arturo Filastò <[email protected]>
Make the reporting directory of the collector configurable

c00235222a80f87966bc68be4332848d6d829234 authored about 12 years ago by Arturo Filastò <[email protected]>
Use print instead of log in oonib bootstrapping process

* This is required because the logger is not running yet

8297f0275d53a85d44be6046974f95eb0df2b5c7 authored about 12 years ago by Arturo Filastò <[email protected]>
Merge remote-tracking branch 'flavioamiero/fix-requirements' into requirements

* flavioamiero/fix-requirements:
Use the latest txtorcon in pypi
Tells pip to install scapy ...

8f85290aafcf860755e500c999f0a9eb6fd55958 authored about 12 years ago by Arturo Filastò <[email protected]>
Merge branch 'master' into master-copy

Apply fixes to a couple bugs in ooni.utils.net.

d8066a67de19715e5e92b49f293de4f14d039ca7 authored about 12 years ago by Isis Lovecruft <[email protected]>
* Updated oonib requirements.

463a82e4e84b4e73ea5b7c2b217c29fb72ff1b15 authored about 12 years ago by Isis Lovecruft <[email protected]>
* Updated oonib requirements.

8949cfa77dfce733ad5c235ade27ae00c942d91e authored about 12 years ago by Isis Lovecruft <[email protected]>
Use the latest txtorcon in pypi

Currently, txtorcon in pypi is 0.6, oonib/requirements.txt required 0.7.

334845ec18a164450e85035c6f5a1dfc98a6c278 authored about 12 years ago by Flavio Amieiro <[email protected]>
Tells pip to install scapy from the website

40959a4adeefea36b3f128891637d91ea83a8d5d authored about 12 years ago by Flavio Amieiro <[email protected]>
Merge branch 'daphn3port'

* daphn3port:
Add unittest for daphn3 mutator.
Finish reafactoring and porting daphn3. * XXX...

e9f1ab87b55bbe6a399864e0c3eb872e19f029ef authored about 12 years ago by Arturo Filastò <[email protected]>
Finish reafactoring and porting daphn3.

* XXX not fully tested

604313fa25a1fe8381cf7144da11d89822bfa421 authored about 12 years ago by Arturo Filastò <[email protected]>
Progress towards making daphn3 a test helper backend

f8121c746568517dd526f736ccd40fee44809227 authored about 12 years ago by Arturo Filastò <[email protected]>
Remove cyclone, numpy and bs4 from the dependencies of ooniprobe.

* These should only be depedencies of oonib and of "advanced" users of ooniprobe

a96aa08923f2ccf2a23b3f720cb51ef5659bc664 authored about 12 years ago by Arturo Filastò <[email protected]>
Start working on porting of daphn3

4ce99293638e5c398dba588bb18d07575f2284a7 authored about 12 years ago by Arturo Filastò <[email protected]>
Implement basic collector for ooniprobe reports

* Reports can be submitted over the network via http to a remote collector
* Implement the backen...

375134fd38b089eee6ccf0ea3c6836584837832d authored about 12 years ago by Arturo Filastò <[email protected]>
Do some major refactoring of the ooniprobe backend

* Implement TCP Echo test helper
* Refactor testhelpers into proper namespace
* Remove unused imp...

41616e544da0cc4ef718cb82f52fbad3bdac5f25 authored about 12 years ago by Arturo Filastò <[email protected]>
Implement basic reporting to flat files containing the report ID.

* XXX the location of such files is not configurable, they will leave tons of
crap in your cwd.

b541e7d3e00464104447bd06ffa06aaa333b0f79 authored about 12 years ago by Arturo Filastò <[email protected]>
Merge branch 'master' into multiprotocoltraceroute

* master:
Implement basic HTTP request test that does capitalization variations on the HTTP me...

dea023461b9a9f042444b9853b311b3d88138ebe authored about 12 years ago by Arturo Filastò <[email protected]>
Implement basic HTTP request test that does capitalization variations on the HTTP method

* Due to a quirk in twisted.client.Agent that sets HTTP request headers to canonical form we are
...

8f0e20799c3a29bb2d6ed27270614a760a578c86 authored about 12 years ago by Arturo Filastò <[email protected]>
Merge branch 'master' into multiprotocoltraceroute

* master:
Clean up unused code * Fix imports in oonib
Add database support to oonib * We hav...

b58eaa93e9fac8f9df2eeb17837a209d8ebe829e authored about 12 years ago by Arturo Filastò <[email protected]>
Clean up unused code

* Fix imports in oonib

333b56cdfe709652f2fc758656777fb1f25c1283 authored about 12 years ago by Arturo Filastò <[email protected]>
Fix some docstrings

8c10a2b206db344f20179f4b4eaa1ca67369a65a authored about 12 years ago by Arturo Filastò <[email protected]>
Merge branch 'oonib'

* oonib:
Fully switch to using only cyclone for HTTP related test helpers * Implement HTTP Req...

155156b6c9ffbabccaac867656553eebe8fa35b1 authored about 12 years ago by Arturo Filastò <[email protected]>
Add database support to oonib

* We have function to automatically create tables based on the Storm db definition
(borrowed fr...

c46fcef951c81053f3b208d489a32e8a917d3cb0 authored about 12 years ago by Arturo Filastò <[email protected]>
Add basic configuration support to oonib

7ec6173af7f4234ac34fe0dedd79e9c302a1247d authored about 12 years ago by Arturo Filastò <[email protected]>
Fully switch to using only cyclone for HTTP related test helpers

* Implement HTTP Request handler backend
* Fix the startup script of OONIB
* Disable daphn3 test ...

50c32bc3f277b54eda5c0b73460fe06789f8c08d authored about 12 years ago by Arturo Filastò <[email protected]>
Continue work on OONIB

93ff6a182a79b1b3b3f60f8cc376a8232c136f18 authored about 12 years ago by Arturo Filastò <[email protected]>
Start defining the models of OONIB

* Create runner for OONIB

48a4bf0716554a480b7bbf3d32328574a43370f9 authored about 12 years ago by Arturo Filastò <[email protected]>
Fully switch to using only cyclone for HTTP related test helpers

* Implement HTTP Request handler backend
* Fix the startup script of OONIB
* Disable daphn3 test ...

d2866d2b89f5e643314964bf9207bed69fd75f81 authored about 12 years ago by Arturo Filastò <[email protected]>
Merge branch 'master' into oonib

* master: (43 commits)
Update example for writing scapy tests. * Make changes to test template...

d9b1a92127c3144384d7da76219e52364eabf13f authored about 12 years ago by Arturo Filastò <[email protected]>
Merge branch 'cleanup'

* cleanup:
Do a very big cleanup and refactor of all the code in the repo.

Conflicts:
to-be-...

3779d390382ba85c053f17d02aff22ead48e1869 authored about 12 years ago by Arturo Filastò <[email protected]>