* QA/webconnectivity: repair flaky test

It seems using neverssl.com isn't working well as a t...

When working on this, notice that we were not correctly handling this
specific case, handle it ...

Part of https://github.com/ooni/probe-engine/issues/852

Related to https://github.com/ooni/pr...

* QA: run github workflow periodically

Mostly using the same code used for periodic golang ch...

Part of https://github.com/ooni/probe-engine/issues/852

Part of https://github.com/ooni/probe-engine/issues/852

* QA/webconnectivity.py: HTTP measurement ok, control failure

Part of https://github.com/ooni...

Part of https://github.com/ooni/probe-engine/issues/810

Again, likely doing the redirect chain is not necessary. But it makes
things more interesting, ...

Part of https://github.com/ooni/probe-engine/issues/810

Strictly speaking we don't need a red...

Part of https://github.com/ooni/probe-engine/issues/810

Part of https://github.com/ooni/probe-engine/issues/810

Objective is making sure we don't do ...

This impacts on https://github.com/ooni/probe-engine/issues/579.

Part of https://github.com/o...

Make sure we do the same MK would do in this case.

Part of https://github.com/ooni/probe-engi...

We open a listening port on localhost but we don't listen to such
port. We redirect HTTP to suc...

This is a rather common blocking case. Let us make sure we
measure this case with OPE like we d...

The behavior of probe-engine is better than the one of MK. We have
disabled this check for MK a...

We already know that probe-engine does better than MK when there is a control
failure and the w...

Verified locally that we behave like MK.

Part of https://github.com/ooni/probe-engine/issues/...

* fix(webconnectivity): header_match => headers_match

Spotted while comparing with Measuremen...

This will be very helpful for https://github.com/ooni/probe-engine/issues/810.

It will allow ...

This starts adding a single check, to check whether the framework works for Web Connectivity. Mo...

* QA: make sure we can run from Linux

Previous changes made it much more difficult to run on ...

* QA: add tests for hhfm and hirl

Part of https://github.com/ooni/probe-engine/issues/829

...

* QA: improve the system

1. make sure we run as unprivileged user in its home directory

2....

* QA: write script for fbmessenger

* remember to turn on the checks

Part of https://github...

* qa: simplify directory structure

Part of https://github.com/ooni/probe-engine/issues/829

...

* .github/workflows: integrate Jafar QA checks

Part of https://github.com/ooni/probe-engine/i...

This is part of https://github.com/ooni/probe-engine/issues/356.

I have only lightly edited t...

* .github/workflows: add integration testing for jafar

* .github/workflows: create single wor...

* cmd: add jafar to the codebase

This vendors code from https://github.com/ooni/jafar/tree/0f...

Closes https://github.com/ooni/probe-engine/issues/821

This allows us to check weekly whether everything is still WAI.

Closes https://github.com/oon...

Prepare the master branch for 0.15.0 release

We will be branching for release off 27b280f, be...

Closes https://github.com/ooni/probe-engine/issues/777

This implementation panics if we cannot generate a UUID4. I think that
is fine in this case. We ...

Part of https://github.com/ooni/probe-engine/issues/757

A recent build of the stable branch shows that there is no
failure now: https://github.com/ooni/...

Closes https://github.com/ooni/probe-engine/issues/817

Closes https://github.com/ooni/probe-engine/issues/816

1. ask for static linking

2. use netgo

Just tested with Docker using Ubuntu 12.04

Closes http...

Part of https://github.com/ooni/probe-engine/issues/776

Part of https://github.com/ooni/probe-engine/issues/776

Part of https://github.com/ooni/probe-engine/issues/776

1. always make keys lowercase

2. properly implement uncommon intersection

3. handle case w...

While there introduce logging of HTTP analysis

Part of https://github.com/ooni/probe-engine/i...

Fow now aim at the same test keys of the original experiment.

Part of https://github.com/ooni...

Instead use urlgetter.TestKeys and webconnectivity.ControlResult.

This way we don't put too m...

Part of https://github.com/ooni/probe-engine/issues/776

* webconnectivity: connect to all possible endpoints

Part of https://github.com/ooni/probe-en...

Part of https://github.com/ooni/probe-engine/issues/776

Part of https://github.com/ooni/probe-engine/issues/776

I'm trying to split Measure in smalle...

webconnectivity: expand endpoints to test

Part of https://github.com/ooni/probe-engine/issues...

Life is already too complicated that adding a level of randomness here
is possibly only going t...

Ex-post analysis of everything becomes too tricky.

Part of https://github.com/ooni/probe-engi...

Part of https://github.com/ooni/probe-engine/issues/776

Part of https://github.com/ooni/probe-engine/issues/776

I am not very happy about changing a measurement to store the results
of the analysis inside it...

Part of https://github.com/ooni/probe-engine/issues/776

Part of https://github.com/ooni/probe-engine/issues/776

As documented in the code, this implementation might be slightly less
sensitive to false positi...

Part of https://github.com/ooni/probe-engine/issues/776

See https://github.com/measurement-kit/measurement-kit/blob/1166b57b9655a3e43cc41d5a73666651de59...

See https://github.com/measurement-kit/measurement-kit/blob/1166b57b9655a3e43cc41d5a73666651de59...

See https://github.com/measurement-kit/measurement-kit/blob/1166b57b9655a3e43cc41d5a73666651de59...

The algorithm is like https://github.com/measurement-kit/measurement-kit/blob/1166b57b9655a3e43c...

Based on https://github.com/measurement-kit/measurement-kit/blob/1166b57b9655a3e43cc41d5a7366665...

1. make sure we define all the fields we should define

2. fill {HTTP,DNS}ExperimentFailure

...

Part of https://github.com/ooni/probe-engine/issues/776

This diff implements the basic machinery. We perform the measurement
and the control measuremen...

Co-authored-by: Simone Basso <[email protected]>

Part of https://github.com/ooni/probe-engine/issues/763

Makes it much more obvious that something went wrong beyond just
inspecting the exit code and n...

Part of https://github.com/ooni/probe-engine/issues/763

This will allow HHFM to use a Dialer for which self censorship
works, which in turn enables qui...

While there use a more clear name for this variable.

Closes https://github.com/ooni/probe-eng...

* experiment: rewrite HIRL in Go

Part of https://github.com/ooni/probe-engine/issues/761

*...

Closes #759

This is the initial rewrite. Maybe we'll need to do some more
work here to further refine the c...

Closes https://github.com/ooni/probe-engine/issues/754

Part of https://github.com/ooni/probe-engine/issues/743#issuecomment-656145345

While there, m...

1. remove the AllEndpoints option, which was basically increasing the
probability of detecting ...

See failing test https://github.com/ooni/probe-engine/pull/751/checks?check_run_id=853562310

...

See https://github.com/ooni/probe-engine/issues/740

* sniblocking: rewrite using urlgetter

A more substantial rewrite would have been possible. B...

* urlgetter: allow to force a User-Agent

This is for investigating what seems MITM detection ...

* whatsapp: implement remaining checks

As mentioned in the commit, we see a 400 Bad Request e...

In some cases, we want to fail if we see an HTTP status code >= 400.

This is certainly the ca...

* urlgetter/multi: allow setting common beginning of time

This way, measurements run by, e.g....

Release 0.14.0

This reverts commit 5132ab6adfb89f54e16190a9833a75cf9b1dd1cc because it was
actually redundant. ...

Part of https://github.com/ooni/probe-engine/issues/689

Part of https://github.com/ooni/probe-engine/issues/689

Part of https://github.com/ooni/probe-engine/issues/689