Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ooni/probe-engine

Semi-automatic export of https://github.com/ooni/probe-cli internals
https://github.com/ooni/probe-engine

oodatamodel: make sure HTTPBody is OONI-spec compliant (#170)

Apparently, the custom JSON serialisation only works with a type and
its alias, and does not wo...

0ba17a8027700cf8be4a4402c65a29f1f07118cd authored about 5 years ago by Simone Basso <[email protected]>
fix(orchestra): network_type is not mandatory (#165)

Forgot to commit yesterday. Part of #148.

008e2453cdad95148fd4b15dd51355e21f964eda authored about 5 years ago by Simone Basso <[email protected]>
orchestra: implement client with authenticated APIs (#163)

This is part of #148.

c01acefc4b39f997fe84fa373ca02c883fbd7a4e authored about 5 years ago by Simone Basso <[email protected]>
orchestra: introduce the statefile (#162)

For now we only use an in memory statefile, but it's clear that
later we'll need to persist it ...

e21b695fd8ea39286760fef3ed08b00eed72277d authored about 5 years ago by Simone Basso <[email protected]>
orchestra: implement metadata validation (#161)

Follows closely the algorithm implemented by MK:

https://github.com/measurement-kit/measureme...

f8670d057ab1056f1fb0d365d6254fd99e415289 authored about 5 years ago by Simone Basso <[email protected]>
orchestra/testlists/urls consistent w/ other orchestra (#160)

Make sure the code style and structure is consistent among all the
orchestra building blocks by...

a64860a46443709cb5ba6f74b87ac140bd3f4157 authored about 5 years ago by Simone Basso <[email protected]>
orchestra: implement the authenticated update API (#159)

We're getting closer to #148 because now we're able to call
an authenticated API successfully.
...

e4abbea2080a4ae450023733252403f6d32748e7 authored about 5 years ago by Simone Basso <[email protected]>
orchestra: implement logging in a probe (#158)

078c4199d1dd0b5fc72a9c71376e165cc0ba0a5a authored about 5 years ago by Simone Basso <[email protected]>
orchestra: implement registering a probe (#157)

fb130d76289ce679931af1f363c84ad358511f0a authored about 5 years ago by Simone Basso <[email protected]>
[API CHANGE] Refactor code for fetching test lists (#156)

1. using a "client" for a test lists query is overkill, instead just
have a single function wit...

f13e4e16e190396d41f1a6a30cb5586ca2a4ff06 authored about 5 years ago by Simone Basso <[email protected]>
Merge pull request #154 from ooni/feature/psiphon-adventures

psiphon: use the staging-client branch

f7f4a43a8d2277c6a4eb76195fa2d5519655be0a authored about 5 years ago by Simone Basso <[email protected]>
Document how to update dependencies

a33d6b809056ef43aba43a144d3ad96432d7c4df authored about 5 years ago by Simone Basso <[email protected]>
psiphon: use the `staging-client` branch

This has been suggested to me by Psiphon developers.

4cc8732a37e4b5280c55a59b228e5bd0fa03617a authored about 5 years ago by Simone Basso <[email protected]>
Merge pull request #152 from ooni/issue/141

go.mod go.sum: update all dependencies (and specifically psiphon's)

c6e8e380a168b833181fe1da329bf4c06f911388 authored about 5 years ago by Simone Basso <[email protected]>
go.mod go.sum: use latest dependencies for psiphon

I have obtained the dependencies used by psiphon v2.0.9 (the latest
stable release as of this wr...

d5568bac3ff9f23a9e04045c167c6d64b12d5b8a authored about 5 years ago by Simone Basso <[email protected]>
go.mod go.sum: update all direct dependencies

This excludes, in particular, the indirect dependencies used by
psiphon, which are the true goal...

1215113e3ccae6b6cb2fd02f04699423ba7e545a authored about 5 years ago by Simone Basso <[email protected]>
go.mod: require go 1.13+

3c460b08a6ce34ae5157c98793cee4edb5cfcfa4 authored about 5 years ago by Simone Basso <[email protected]>
Merge pull request #151 from ooni/issue/110

oodatamodel: handle binary header values

9fd5d38802e89270ed8d91446542a1cf638e3994 authored about 5 years ago by Simone Basso <[email protected]>
psiphon: set max runtime to 60 s

It seems sometimes 30 s are not enough to complete the
psiphon bootstrap, see e.g. this travis b...

f35c6f2b449e7c30a00fb782a49708255e4e70ae authored about 5 years ago by Simone Basso <[email protected]>
telegram_otherwise_test.go: add logging for #142

This is the first step towards understanding why #142 happens.

d395f4c551df1cfbcedc0f581e37d5693cd71e86 authored about 5 years ago by Simone Basso <[email protected]>
oodatamodel: handle binary header values

Unsure whether this could happen, but robustness is usually good.

Closes #110

ac02ebf32b15f2353419bd979d057c26aa122596 authored about 5 years ago by Simone Basso <[email protected]>
http: also send Accept{,-Language} (#149)

Closes #113

9d27bd8f4caba9594c27bc4ed02b4213f18a7c5b authored about 5 years ago by Simone Basso <[email protected]>
psiphon: refine the output data model (#144)

After looking into the data model of the previous version, I have
determined it's not the case ...

b3b955d7af02a43128141ee2c8fc4b83d627cb71 authored about 5 years ago by Simone Basso <[email protected]>
Merge pull request #143 from ooni/develop

Significantly improve psiphon and telegram

707afc24fec32394d0c777ff3c7232b02662749f authored about 5 years ago by Simone Basso <[email protected]>
psiphon: repair broken build

See https://travis-ci.org/ooni/probe-engine/builds/620071781

21271c302d2f2eb14a205f0b4e6958015091af30 authored about 5 years ago by Simone Basso <[email protected]>
psiphon: count bytes sent and received

816ab9152c136e4b52e2ded3ad356b29fa500e25 authored about 5 years ago by Simone Basso <[email protected]>
psiphon telegram: use better netx/x/porcelain API

This removes a situation where the code behaviour was clearly non
idiomatic and hence quite a bi...

556a420b62dc85c04c2cfe9877794aeb27fefa93 authored about 5 years ago by Simone Basso <[email protected]>
Write more functional tests for psiphon

Similar to what I did for Telegram and DASH, except that here there is still
some integration te...

8a2b399ea1a6cb67e5e6ef8716e9bc17ff29b581 authored about 5 years ago by Simone Basso <[email protected]>
telegram: repair broken build

The commit that broke the build is 272e83f5d9. The failed travis build
is https://travis-ci.org/...

167e6c7c87315e6caf8b0b22622cd62611fdcd5a authored about 5 years ago by Simone Basso <[email protected]>
telegram: use netx curl-like logger

This is yak shaving after the previous diff. After we've migrated
telegram to use netx curl-like...

272e83f5d914a7d99b403e0fc66efef1227660f0 authored about 5 years ago by Simone Basso <[email protected]>
psiphon: use netx for fetching the webpage

Part of #129

bd11bb10c9b4c14450061d5793104f6b8edb197c authored about 5 years ago by Simone Basso <[email protected]>
go.{mod,sum}: update to the latest netx

9856001446696ec9ed056b16cc9ede076b79d15b authored about 5 years ago by Simone Basso <[email protected]>
psiphon.go: improve the docstrings

cca9688cda8b10be27c6f7a5b851e5518ac3b0d6 authored about 5 years ago by Simone Basso <[email protected]>
dash: refactor and write more tests (#140)

Closes #93

e309d5d8b58c88905f7784c7f3bfa986849d782f authored about 5 years ago by Simone Basso <[email protected]>
Use data format version v0.3.0 (#139)

See https://github.com/ooni/spec/pull/166 for context.

Closes #111

70388eb7845df9bf4d77ada36df34e20702f20b1 authored about 5 years ago by Simone Basso <[email protected]>
Use ooni/probe-engine@20191129161951 (#131)

2515058bde4cc4d68dd900ee67a53eb317a29211 authored about 5 years ago by Simone Basso <[email protected]>
Merge pull request #126 from ooni/develop

telegram: fix known defects before QA

d39a38e7f96ddf15cf60f46f9953612cbaece23c authored about 5 years ago by Simone Basso <[email protected]>
telegram: emit progress using callbacks

Closes #119

cfc57ef7d05e111baebd3561f5315188ca080a5a authored about 5 years ago by Simone Basso <[email protected]>
telegram: report KiBs used by the experiment

Closes #118

d72cacfb5ac088477f415fe7be449a2981b90639 authored about 5 years ago by Simone Basso <[email protected]>
Update well know OONI hosts we use (#117)

dbfa248b6f413d49559341b956906062d0e1dbad authored about 5 years ago by Simone Basso <[email protected]>
Telegram rewrite using netx (#103)

ecb93b48ec58a466b216c97bef3df2cf41e362ce authored about 5 years ago by Simone Basso <[email protected]>
Merge pull request #106 from ooni/feature/updateassets

Use github.com/ooni/probe-assets@20191114173737

831e879ea56afcec0a844b4eaf70817e035d85a0 authored about 5 years ago by Arturo Filastò <[email protected]>
Use github.com/ooni/probe-assets@20191114173737

44c3bd4dd9b8379d1fd59f4f4090b322d19ebfc4 authored about 5 years ago by Simone Basso <[email protected]>
collector: unconditionally write the ReportID (#104)

* collector: unconditionally write the ReportID

Issue reported by @FedericoCeratto

* Updat...

f6fa6da45c8c51fbff2fb9c90048934cad84a451 authored about 5 years ago by Simone Basso <[email protected]>
orchestra: use canonical path (#102)

Prodded by @hellais

66e81e9d5e3917def86dec51cd504f7ab527e791 authored about 5 years ago by Simone Basso <[email protected]>
collector: don't use hkgcollectora (#101)

* collector: don't use hkgcollectora

Prodded by @hellais

* tweak previous

fca4afd49076ffe8f43954a27165c3d931fe4df3 authored about 5 years ago by Simone Basso <[email protected]>
engine: implement loading measurement from []byte (#100)

Required to implement resubmission.

5dd8f2c4eed93724fceef3db9fd44f08789dd6d0 authored about 5 years ago by Simone Basso <[email protected]>
Write more abstract and powerful API (#99)

c87abaaf94e766d0e84661eb14879c431fc086f0 authored about 5 years ago by Simone Basso <[email protected]>
Update to stable m-lab/[email protected] (#95)

2c2c87fe99ea1302a9c9a49ff9b9129605852c04 authored about 5 years ago by Simone Basso <[email protected]>
experiment.go: fix measurement runtime (#98)

Hunk approved by @hellais in #96. Going to hotfix this.

49b348253a525383a24e5530b0c4022c2238df86 authored about 5 years ago by Simone Basso <[email protected]>
go.mod go.sum: commit possibly missing changes

4f2b0d21f86fdf7fd36fdc585ccc523e22bc823a authored about 5 years ago by Simone Basso <[email protected]>
dash: refactor for testability

1. separate measurement and interpretation (see #13)

2. this will allow us to write separate un...

67c8e6f181ea38295285e126a529daa00a2bf06c authored about 5 years ago by Simone Basso <[email protected]>
Allow running tests w/o psiphon

Otherwise the life of a contributor that doesn't have access to
the Psiphon secret would be mise...

8f03c36808972473f8cb6f7929e9f8d90b206230 authored about 5 years ago by Simone Basso <[email protected]>
Add CONTRIBUTING.md to the repository

9cbe63f35466afa9414746306073ee662ab1511f authored about 5 years ago by Simone Basso <[email protected]>
dash: rewrite using neubot/dash and separate Go and C code (#61)

f2a0c1fe7d30a754d147a2bd0b2f8dccd9c4cd17 authored over 5 years ago by Chelchela <[email protected]>
session: expose the ProbeASN as an integer (#74)

20fcd34f2e75cc9c58bd6bb25e15102e78d17f4c authored over 5 years ago by Simone Basso <[email protected]>
Merge pull request #62 from ooni/release/v0.1.0

Release v0.1.0

ddc9bae82e1a18c07da0a2784bf21082660530cd authored over 5 years ago by Simone Basso <[email protected]>
mkrunner.go: fix name used in comment

ac9d97a86f828f4cc45ad02233c2dcae9cc017dc authored over 5 years ago by Simone Basso <[email protected]>
mkevent.go: clarify why there's commented out code

9dd77ad7c5d050a4d139055a11aa0d8fc9bb6180 authored over 5 years ago by Simone Basso <[email protected]>
README.md: remove mention to retracted design document

00383205df55805da64b54360db2d781a91f665c authored over 5 years ago by Simone Basso <[email protected]>
Merge branch 'master' into release/v0.1.0

a0f4e35f1957e7fc2d877d1c9d4cc91158216fbc authored over 5 years ago by Simone Basso <[email protected]>
Remove DESIGN.md: it is too early for it

We need first to understand a toplevel API that can be used
both by Go code and by mobile and is...

a6d82498c18096c42957327bef9bf599df30f1ed authored over 5 years ago by Simone Basso <[email protected]>
gofmt -s -w the whole repo

c7a249f68a82f52e1007216310106eb8ceb44762 authored over 5 years ago by Simone Basso <[email protected]>
collector_test.go: add e2e test where we verify the submission

5717271458b97628a5bea36f29497ec957de3c1c authored over 5 years ago by Simone Basso <[email protected]>
collector.go: add workaround for collector bug

The spec says it MUST return a JSON. The legacy collector is
however legacy by definition, so be...

b40b6a4882078ae4b7b4803b8a238148de8e68fc authored over 5 years ago by Simone Basso <[email protected]>
experiment.go: increase tests coverage

Apply the necessary changes to this end:

1. we actually don't need an hard-to-test sess.Locatio...

d7a38ce21f342d4b227925d7934cded51fe7e18e authored over 5 years ago by Simone Basso <[email protected]>
experiment: continue adding tests

e61499852e69b769eb7a87b98cf051ee44ca0c7e authored over 5 years ago by Simone Basso <[email protected]>
Increase coverage of MK based experiments

While there, add a basic runtime check that gives us more confidence
that we did actually correc...

2207facfa0128780f3cab68d7f2327dc01f4bc3c authored over 5 years ago by Simone Basso <[email protected]>
miniooni: avoid golint warning

3cb76f3d37d6f956ac531912342bbff22f5f2692 authored over 5 years ago by Simone Basso <[email protected]>
Write tests for session.go

As part of that, spot and fix bugs, as well as places where the
code was unnecessarily exposing ...

3747c4128952461b3378761114dd298f24f46cbc authored over 5 years ago by Simone Basso <[email protected]>
resources: write more unit tests

94f9935bcf589d14924fa710f3db23fe82f6dfea authored over 5 years ago by Simone Basso <[email protected]>
Write more tests and fix newly discovered bugs

Fixed bugs:

- geoiplookup/iplookup/akamai/akamai.go was not honouring context

- geoiplookup/mm...

9f72ea0606743d63cdfe2ccafebb13a484a8179a authored over 5 years ago by Simone Basso <[email protected]>
go.mod go.sum: go get -u=patch -v ./...

closes #58

4f416e0b4aad4cf4b584fcbbd417f1e10226e26b authored over 5 years ago by Simone Basso <[email protected]>
measurementkit: repair macOS build

See https://github.com/measurement-kit/homebrew-measurement-kit/commit/70482004c4edea781b963b0a8...

df9747eca8f659b93770616c89e6a5913a1e0c81 authored over 5 years ago by Simone Basso <[email protected]>
resources: update to measurement-kit/generic-assets@20190822135402

ac589c242c24548fcc33a18cfcc40001096920a3 authored over 5 years ago by Simone Basso <[email protected]>
README.md: document release procedure

f89b15f868b6858aef94dba04df997958e7196bf authored over 5 years ago by Simone Basso <[email protected]>
model: add ResolverIP to top-level keys

Closes #38

fd84859b8df4e14c754535b27768965e78047bb8 authored over 5 years ago by Simone Basso <[email protected]>
miniooni: tweak logging at info level

- mention when we're submitting the report

- mention when we're saving the report to disk

- om...

2e683f241111bc1de4f1d477a26962cc526e40af authored over 5 years ago by Simone Basso <[email protected]>
Add adapted DESIGN.md from measurement-kit/engine

Closes #8

a9a67c06f04d2f0abc5c6b595e5a5be75e770359 authored over 5 years ago by Simone Basso <[email protected]>
Add missing LICENSE file

4d3f88b0a88b617a1d88a3dfb4eb70a88a929c83 authored over 5 years ago by Simone Basso <[email protected]>
fix(collector): specify format and data-format-version (#59)

Spotted by @FedericoCeratto (thanks!)

"This could have been avoided with end-to-end testing" 🤦

54d7e736ef5462af319e3731912dd5592e8cab35 authored over 5 years ago by Simone Basso <[email protected]>
ndt7: add debug log (#57)

6505c076d7012fcc6bad4a22bfd1d54221b37735 authored over 5 years ago by xhdix <[email protected]>
Add example experiment (#50)

close #36

b24f1e333c2ec3d2aa36ed8f19110ec9ddec41b1 authored over 5 years ago by xhdix <[email protected]>
Update to github.com/oschwald/[email protected] (#43)

9e908f8e3a3a77c0daa41b28f5057a94aad86031 authored over 5 years ago by Simone Basso <[email protected]>
Make minooni logging simpler and more actionable (#35)

b4e1111d5312867181497c0ce0a57baeb592af4c authored over 5 years ago by xhdix <[email protected]>
Add support for passing the limit and category code to the testlists pkg (#39)

49134e559261949d5e80722f8d87315781cc2c4f authored over 5 years ago by Arturo Filastò <[email protected]>
Merge pull request #37 from ooni/feature/probe-cli-46

Set of changes to unblock ooni/probe-cli#46

473884e8863231bb1fe0e4a33ba05dc2edc5e81e authored over 5 years ago by Simone Basso <[email protected]>
collector: make code more correct and compact

1. make sure we use a separate structure for the open report response
such that the server canno...

861ff039655825b0a16db85e57523e7335b10ef5 authored over 5 years ago by Simone Basso <[email protected]>
collector: implement scrubbing safety net

This diff introduces code to redact IP, ASN, and CC directly
in the engine, rather than delegati...

1d128044384c872bc80a45fc02b567f417a299f1 authored over 5 years ago by Simone Basso <[email protected]>
go.mod: update direct dependencies except psiphon

Psiphon is not using `go.mod`. Updating also psiphon should be
done with extra care precisely be...

caf6b0dd1ad31e526c84c49e20d4a7d2f41ce6be authored over 5 years ago by Simone Basso <[email protected]>
measurementkit.go: disable resolver lookup

This is currently speculative, since MK v0.10.5 has not been
released yet. Nonetheless, this fun...

7826c0352221d1d13781ce304648e3790df211d9 authored over 5 years ago by Simone Basso <[email protected]>
session: rename SetAvailableHTTPS* to AddAvailableHTTPS* (#33)

closes #32

4433059f50663c90260f2190ce0cef35d739cbd0 authored over 5 years ago by Seyyed Hossein Darvari <[email protected]>
Enable travis and measure code coverage (#22)

9072fc94fffa9f24817037af6dc2bef948445e16 authored over 5 years ago by Simone Basso <[email protected]>
fix(measurementkit/task_cgo.go): build again on Alpine (#27)

Since openobservatory/mk-alpine:20190616, we use all the static
libraries that Alpine can provi...

0f4e8b9750179f0d6a5268252e5e203516c5c245 authored over 5 years ago by Simone Basso <[email protected]>
testlists.go: use the correct orchestra URL

5a02948639d159f2e24789134a7543b43b4c914c authored over 5 years ago by Arturo Filastò <[email protected]>
collector/collector.go: make sure we save reportID

It was not saved as part of submitting a report.

9bd31ae52f30a6a370e872ebd0e35108e794001b authored over 5 years ago by Simone Basso <[email protected]>
API CHANGE: never redact probeIP

Experience integrating with probe-cli suggests that the code is
much easier to review and unders...

5a9383784947d13bae45db454e81b3207fdc7317 authored over 5 years ago by Simone Basso <[email protected]>
testlists: allow to create client from session

14e4cbaee93753b4c29d72d47731e62a93694622 authored over 5 years ago by Simone Basso <[email protected]>
measurementkit: allow to select task's verbosity

This diff allows the caller to choose the verbosity of individual
measurementkit tasks rather th...

b0fd3230849a114650f85406bd9c060f5c864135 authored over 5 years ago by Simone Basso <[email protected]>
measurementkit.go: set no_geoip=true for all nettests

Since Measurement Kit v0.10.4 there is this no_geoip boolean field
that allows to completely byp...

4af60fb57b6493e1db9f16ef498b196b6dabd18b authored over 5 years ago by Simone Basso <[email protected]>