Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/mozilla/python_mozetl

ETL jobs for Firefox Telemetry
https://github.com/mozilla/python_mozetl

Create and register `privacy_prefs_shield` command

acmiyaguchi opened this issue over 7 years ago
Provide a method for describing individual columns in a schema

acmiyaguchi opened this issue over 7 years ago
bug 1387236: extract and load study_state too

groovecoder opened this pull request over 7 years ago
Fix shield privacy_prefs `etl_job` function

harterrt opened this pull request over 7 years ago
Address review comments

harterrt opened this pull request over 7 years ago
Refactor testpilot and shield etl_boilerplate functions

harterrt opened this issue over 7 years ago
`python setup.py install` fails on fresh environment

acmiyaguchi opened this issue over 7 years ago
Fix flake8 error

harterrt opened this pull request over 7 years ago
Fix tests for shield privacy prefs

harterrt opened this pull request over 7 years ago
Add searchdb to unified entrypoint

harterrt opened this pull request over 7 years ago
Bug 1388869 - Install and build package separately on submission

acmiyaguchi opened this pull request over 7 years ago
add several dimensions and write more efficiently

SamPenrose opened this pull request over 7 years ago
Add existing ETL jobs to CLI to schedule using `mozetl-submit`

acmiyaguchi opened this issue over 7 years ago
Make privacy prefs filter pings properly

harterrt opened this pull request over 7 years ago
Fix txp_mau_dau job for case where the experiment doesn't have an addon

sunahsuh opened this pull request over 7 years ago
bug 1386446: fix shield doc type

groovecoder opened this pull request over 7 years ago
Add content to wiki

acmiyaguchi opened this issue over 7 years ago
Make HW report use Year-Month-Day format

harterrt opened this pull request over 7 years ago
Add a logging configuration file [logging.conf]

acmiyaguchi opened this issue over 7 years ago
added click_datetime dependency

comloo opened this pull request over 7 years ago
Fix tests for shield privacy ETL

harterrt opened this pull request over 7 years ago
Bug 1385232 - Add unified entry point and submission script

acmiyaguchi opened this pull request over 7 years ago
Implement custom datestring option type for input validation

acmiyaguchi opened this issue over 7 years ago
Add `pyspark` dependency (for spark 2.2.0+)

acmiyaguchi opened this issue over 7 years ago
Log input and output dataset statistics (number of rows, simple aggregates)

acmiyaguchi opened this issue over 7 years ago
Add basic ETL job for search dashboard dataset

harterrt opened this pull request over 7 years ago
mozetl/shield/privacy_prefs.py

groovecoder opened this pull request over 7 years ago
undo accidental checkin

SamPenrose opened this pull request over 7 years ago
I just force-pushed my local master to this repo. :(

groovecoder opened this issue over 7 years ago
DO-NOT-MERGE: start shield ETL job for privacy prefs study

groovecoder opened this pull request over 7 years ago
added hardware report generation as an ETL job

comloo opened this pull request over 7 years ago
Create a dataset providing one flat row per (client_id, subsession_st…

SamPenrose opened this pull request over 7 years ago
Use airflow-provided run date in txp_pulse

sunahsuh opened this issue over 7 years ago
Bug 1381460 - Whitelist activity stream event source

piatra opened this pull request over 7 years ago
apply ACL headers to S3 transfer

SamPenrose opened this pull request over 7 years ago
Engagement Ratio / maudau export must apply special ACL headers

mreid-moz opened this issue over 7 years ago
Bug 1368089 - Filter incontent searches in search aggregation jobs

acmiyaguchi opened this pull request over 7 years ago
Bug 1378989 - remove catching of exceptions in churn job

acmiyaguchi opened this pull request over 7 years ago
Bug 1377730 - disable document_id deduplication in topline_summary

acmiyaguchi opened this pull request over 7 years ago
Bug 1378899 - Rename engagement fields

mreid-moz opened this pull request over 7 years ago
Create mozetl entrypoint using Click groups/multicommands

acmiyaguchi opened this issue over 7 years ago
Upload coverage to codecov from new docker testing container

acmiyaguchi opened this issue over 7 years ago
Add pyup.io bot to this repo

mreid-moz opened this issue over 7 years ago
Set topline_summary mode to "overwrite"

acmiyaguchi opened this pull request over 7 years ago
Fix caching of docker layers in travis

acmiyaguchi opened this issue over 7 years ago
Bug 1376808 - Package python_mozetl test infrastructure in docker

acmiyaguchi opened this pull request over 7 years ago
Bug 1376348: Fix pulse tests

harterrt opened this pull request over 7 years ago
Bug 1375725 - Port ToplineSummaryView to python_mozetl

acmiyaguchi opened this pull request over 7 years ago
Bug 1370522 - Port official engagement ratio heuristic to this repo

SamPenrose opened this pull request over 7 years ago
containers_shield hive table doesn't exist?

groovecoder opened this issue over 7 years ago
Bug 1364530 - Migrate Search ETL

acmiyaguchi opened this pull request over 7 years ago
Refactor tests and add utility function for uploading csv to s3

acmiyaguchi opened this pull request over 7 years ago
Move activity-date transmission lag to a constants file

SamPenrose opened this issue over 7 years ago
Added hardware report generation to ETL jobs

comloo opened this pull request over 7 years ago
Filter followon searches from search daily job

harterrt opened this pull request over 7 years ago
Pass arguments to containers testpilot etl job

harterrt opened this pull request over 7 years ago
Package tests in a docker container

acmiyaguchi opened this issue over 7 years ago
Add {posarg} to tox so we can run one test at a time

harterrt opened this issue over 7 years ago
Use rollup instead of cube for topline dashboard

acmiyaguchi opened this pull request over 7 years ago
start mozetl/shield/containers.py from testpilot

groovecoder opened this pull request over 7 years ago
Update README with test & scheduling instructions

harterrt opened this pull request over 7 years ago
Bump main_summary to v4 in churn

acmiyaguchi opened this pull request over 7 years ago
Increase code coverage for testpilot jobs

harterrt opened this issue over 7 years ago
Upload this package to pypi and add to ATMO bootstrap

harterrt opened this issue over 7 years ago
Standardize CLI entrypoint for airflow jobs

harterrt opened this issue over 7 years ago
Use collect instead of toLocalIterator for write_csv

acmiyaguchi opened this pull request over 7 years ago
Fix issue #34 caused by missing mock dependency

acmiyaguchi opened this pull request over 7 years ago
Bug 1364530 - Add daily search rollups via nbconvert

acmiyaguchi opened this pull request over 7 years ago
Failing Tests

harterrt opened this issue over 7 years ago
Fix flake8 errors and add flake8 tests to tox

harterrt opened this pull request over 7 years ago
Cache and materialize a dataframe before writing to disk

acmiyaguchi opened this pull request over 7 years ago
Failing Tests

harterrt opened this issue over 7 years ago
Bug 1363841 - Add more countries

mreid-moz opened this pull request over 7 years ago
Tab Spinner - Upload files after running ETL

fbertsch opened this pull request over 7 years ago
Bug 1361186: Port TxP Mau Dau job from ipynb

sunahsuh opened this pull request over 7 years ago
Bug 1357875 - Use toLocalIterator instead of writing directly to `file://` via spark

acmiyaguchi opened this pull request over 7 years ago
Add batch and overwrite options to historical backfill

acmiyaguchi opened this pull request over 7 years ago
Use correct tab_spinner function in scheduling script

fbertsch opened this pull request over 7 years ago
Fixes #22 - Add static files to setup.py

acmiyaguchi opened this pull request over 7 years ago
Use SparkSession for tab spinner counts job

fbertsch opened this pull request over 7 years ago
Package static assets with setup.py

acmiyaguchi opened this issue over 7 years ago
Move SparkSession fixture into conftest.py

acmiyaguchi opened this issue over 7 years ago
Add 'pageRequestCount' to containers ETL job

harterrt opened this pull request over 7 years ago
Add travis and codecov status icons to README

acmiyaguchi opened this issue over 7 years ago
Bug 1357875 - Add script for generating topline dashboard data

acmiyaguchi opened this pull request over 7 years ago
Document how to run tests locally

acmiyaguchi opened this issue over 7 years ago
Add p2h/beeline wrapper to reload hive partitions

sunahsuh opened this issue over 7 years ago
Bug 1358661 - Add tab spinner etl job

fbertsch opened this pull request over 7 years ago
Bug 1359193 - Add topline historical backfill job

acmiyaguchi opened this pull request over 7 years ago
Stop SparkContext after finishing pulse job

harterrt opened this pull request over 7 years ago
Some nitpicking to make the library API more Pythonic.

jezdez opened this pull request over 7 years ago
Add simple wrapper to pulse etl job

harterrt opened this pull request over 7 years ago
Add requirements file

sunahsuh opened this issue over 7 years ago
Add testpilot ETL jobs and basic_etl library

harterrt opened this pull request over 7 years ago
Add .tox/ and .coverage to gitignore

harterrt opened this pull request over 7 years ago
Implement integration testing with spark via mocked s3 instance

acmiyaguchi opened this issue over 7 years ago
Add .travis.yml and tox.ini for automated testing

acmiyaguchi opened this pull request over 7 years ago
Bug 1353215 - Port churn notebook to python_etl

acmiyaguchi opened this pull request over 7 years ago
Division of labor with mozilla/telemetry-airflow?

SamPenrose opened this issue almost 8 years ago
testing

SamPenrose opened this issue almost 8 years ago