Add support for caching netinfodb

New proposal for instant experiment result data model

feat: introduce observation generation for stunreachability, urlgetter, browser_web

feat: introduce observation generation for messaging nettests

= Overview of scope of this PR

Inside of this PR I implement an Experiment Results analysis app...

* Make utcnow() calls timezone aware
* Implement workardound for clickhouse bug https://github.c...

Implements: https://github.com/ooni/data/issues/42

Changes:
* Some refactoring to the web_analy...

* Enable processing of http_header_field_manipulation transformer
* Wrap calls to ClickhouseCon...

Summary of changes:
* Parallelise on file entry instead of bucket_date. This leads to
signific...

* When we fail to write to the database, write each row individually to
identify the problemati...

* Add support for computing difference between SQL table and models

* Add transform for telegram
* Add model for telegram
* Add tests

As part of this PR I have ported the observation generation over to
dask.

It significantly s...

In here I add a react based view for displaying data visualizations that
are useful to interpre...

This adds support for archiving bodies as part of a separate command.

It currently write to a...

* 'main' of github.com:ooni/data:
Ignore legacy can index files
Use the user supplied probe_...

Sync fix

Legacy file entries don't have the probe_cc in the filename. So in these
cases will fill out the...

* Improve DNS analysis (compute the DNS inconsistency only after having
inspecting the full ans...

* Refactor website analysis into more well defined functions

* Refactor ExperimentsResults data model to break down ok, down, blocked into distinct columns
...

As part of this PR I did a major rework of the observation generation
system.

tl;dr
* Obser...

Changes:
* Rename observation generation CLI command to mkobs
* Add support for parsing additi...

Changes:
* Switch to using click for automatically generating help messages and
better ergonom...

Changes:
* Refactors verdicts into the experiment_results and blocking_events model for the web...

* Move all CLI related functionality into a dedicated module
* Add support for caching measurem...

This introduces the concept of a shared data directory for all assets
required for running ooni...

Make use of the new measurement listing and download functions for the
CLI
This also makes sig...

* Switch to using mashumaro and orjson for parsing raw measurements and
validating/generating t...

* fix(dataformat): network_events.transaction_id is Optional[int]

* fix(processing): add miss...

* Fix tests for netinfodb

* Update create tables

* Improvements to the oonidata processing...

feat: generate dnscheck observations

* Improve type checks
* Add comments on why some type checks are ignored

chore: changes during architecture review