github.com/openaddresses/machine commits | Ecosyste.ms: OpenCollective

Adjusted expected paths check

741afc5e031255dd28119fc0fa9af1e2b6c57fad authored over 9 years ago by Michal Migurski <[email protected]>

Added batch test with render step

4144f59d12825000a77ff46ff4e21da25434e7a6 authored over 9 years ago by Michal Migurski <[email protected]>

Rendering US output map and throwing it away

5db6b28f33b93ca899263d0bc4402dcb8cdffe59 authored over 9 years ago by Michal Migurski <[email protected]>

Made existing set a dependency of ci.enqueue_sources()

ca16819494d324a5c5a876333296a2d1ecd415d9 authored over 9 years ago by Michal Migurski <[email protected]>

ci.enqueue_sources() now waits until all runs have been completed

89f6ceabdf25a5794fc98eb14d37df5698912712 authored over 9 years ago by Michal Migurski <[email protected]>

Added owner and repository to sets table

9e299ed66ec184060e17184dfef296c492d37eeb authored over 9 years ago by Michal Migurski <[email protected]>

Added dashboard role to database for Nelson's queries

af62f9236e593e8e43f0e57fa5d6bbc4087f4464 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #167 from openaddresses/add-new-views-#162

Add new views

ec125ed8a451d963a286e91dee5bf85dba19803d authored over 9 years ago by migurski <[email protected]>

Only including completed sets in dashboard_stats

b8f815ed30f5eb08b9955f04f09c6b84be71007d authored over 9 years ago by Michal Migurski <[email protected]>

Added dashboard views to CI database

7288c5193feedbc4504e9babc99c3acd6b420f02 authored over 9 years ago by Michal Migurski <[email protected]>

Added tests for /jobs path

88a7a4faf26677dd891868cd48942766b776f566 authored over 9 years ago by Michal Migurski <[email protected]>

Explained weird query in ci.objects.read_jobs() and added jobs.sequence index

942994c04db63c720d8d9e901ba195466956f804 authored over 9 years ago by Michal Migurski <[email protected]>

Generating next jobs link in Python instead of templates

3de9e27d4532aca195368d339fa46f39f1f73678 authored over 9 years ago by Michal Migurski <[email protected]>

Added jobs.sequence column for ordered display

a2c595731940ac987ac4c423cdba79ce10f6214e authored over 9 years ago by Michal Migurski <[email protected]>

Removed Job.length property

23aed46fa49148c9e90e28de23510ba131801724 authored over 9 years ago by Michal Migurski <[email protected]>

Added /sets/{set ID} view

03b72a7524e996e83effba77fb1918ae25bd47d5 authored over 9 years ago by Michal Migurski <[email protected]>

Added /sets view

032f840d6af13335a4e3adf7b5ad30a3f681f051 authored over 9 years ago by Michal Migurski <[email protected]>

Added /jobs view

b3275939f6b521f29d2685b55bc1c40ffceba922 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.17.0 with addition of openaddr-enqueue-sources and CI flask app changes

c9e4a5c03cb5546c7b8b12ed7ac98a6a597041c0 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #164 from openaddresses/move-app-down-#161

Move app down into Flask Blueprint

e6994f734363fb8e5d9db97c98f86d46c573d62d authored over 9 years ago by migurski <[email protected]>

ci.worker no longer needs a github token

bbc0b54593c8a28974c68a293a06777ca1fcc62b authored over 9 years ago by Michal Migurski <[email protected]>

Renamed openaddr-ci-enqueue to openaddr-enqueue-sources

034b04e446accadc13f21ba1cdbc718397043d71 authored over 9 years ago by Michal Migurski <[email protected]>

Added script to run ci.webhooks.app in Flask debug mode

d1e996ab7ca97650784bd65f82e9f6798c3a139a authored over 9 years ago by Michal Migurski <[email protected]>

Increased openaddr.ci.enqueue reporting interval to 60 seconds

35f4f14c10d22592169454bdfb9b00690a839fae authored over 9 years ago by Michal Migurski <[email protected]>

Moved ci.app to ci.webhooks.app in webhooks Procfile

b3f96e07a449902fb586496c18406afebc9c1daf authored over 9 years ago by Michal Migurski <[email protected]>

Moved openaddr.tests.ci webhooks app import to test setup methods

cc5564e8dda2d35d5adae3d4526457c7c03357bf authored over 9 years ago by Michal Migurski <[email protected]>

Moved ci.app down to ci.webhooks and added flask Blueprint

ef1bd6889b8fdeedc5b62998465500bc3cf167c9 authored over 9 years ago by Michal Migurski <[email protected]>

Testing GET on webhook job URLs

0bc4e15f22c70f4f095a3247d44eedb6d38fda92 authored over 9 years ago by Michal Migurski <[email protected]>

Allowing for short sources in conform.ExcerptDataTask

Closes #143.

4a86ed100dbd37702c21b9b3443590f71d1d4afc authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.16.1 with fix to task queue delay timing bug

06c9b7269f5a081bbac1bd496ec3a4493e67ef4f authored over 9 years ago by Michal Migurski <[email protected]>

Fixed timedelta days/seconds bug

2d26d2f395aa5c197767d26293c92cda9bffff79 authored over 9 years ago by Michal Migurski <[email protected]>

Replaced queue acknowledgement message

90239ff42a378a9fcdc29e0dbcd59faa9182877d authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.16.0 with added openaddr-ci-enqueue batch script and sets table

dc98c94db2f4e6c64abdbcdb23b9485006d5c97b authored over 9 years ago by Michal Migurski <[email protected]>

Switched runs ID sequence to ints

3d080b9c07a593d6b419c28b271257d36393b175 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #160 from openaddresses/push-source-tasks-#123

[WIP] Push source tasks

8626badce417daa5291ba74cb6e5f6d575b1be48 authored over 9 years ago by migurski <[email protected]>

Added and documented openaddr-ci-enqueue command

2de2341f472acb08b9ccbef4b939bc14cffce57a authored over 9 years ago by Michal Migurski <[email protected]>

Defined 'ints' sequence for sets.id default value

69fe3cc84fed3bb12f1df472422ee57ae123797f authored over 9 years ago by Michal Migurski <[email protected]>

Added runs.set_id column referencing sets.id

66a5e90073e0508637be9ea7bfa349c10283445e authored over 9 years ago by Michal Migurski <[email protected]>

Defined sets table schema

392ccfc56a4f36992973df5e722fdc7a738620cc authored over 9 years ago by Michal Migurski <[email protected]>

Using new values for job ID and commit SHA in ci.copy_run()

f1e1ba5f5be0d3cbc4d4367f7fe6cf150adf5248 authored over 9 years ago by Michal Migurski <[email protected]>

Tweaked enqueue logging

c543286127a55587170065e1395bb946fa6884aa authored over 9 years ago by Michal Migurski <[email protected]>

Moved repetitive ends of done and due queue handled to ci.update_job_status()

494c27f4411b8b986fba10de25281c37c6dfd6b0 authored over 9 years ago by Michal Migurski <[email protected]>

Added test to verify that ci.enqueue_sources() make it through the queue

e22936bd9a4373a6d5cf866ec4af3eff6091f764 authored over 9 years ago by Michal Migurski <[email protected]>

Re-wrote ci.find_batch_sources() as a generator to centralize and space out HTTP requests

72678b8eeec5ec228347ac26a2af3d69262e6f9b authored over 9 years ago by Michal Migurski <[email protected]>

Separated ci.find_batch_sources() from ci.enqueue_sources()

297854771f9cbab4b8a3e034cdeaa2fbcc06d89d authored over 9 years ago by Michal Migurski <[email protected]>

Converted ci.enqueue_sources() into a generator

06690c2c40f59817c8a1d9755e43c35cdbf9b364 authored over 9 years ago by Michal Migurski <[email protected]>

Moved database connection outside ci.enqueue_sources()

04876f326811a78583f71573fe6aa695abcbe25a authored over 9 years ago by Michal Migurski <[email protected]>

Moved ci.enqueue to ci.enqueue_sources() and added simple test

a796eb529f2e382cf6d253df8edf38a4210e1fa7 authored over 9 years ago by Michal Migurski <[email protected]>

Enqueueing tasks only when there is room for them in the queue

4ee76199ddffdc9718771ec7157945398b4aaa39 authored over 9 years ago by Michal Migurski <[email protected]>

Started crawling OA sources directory

d13888aa3fe0b9e58d59a461a7ffd33babb4fa63 authored over 9 years ago by Michal Migurski <[email protected]>

Collecting just current state of sources for now

16844c1dcac8177bc86660a16fa959f3f3697e38 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.15.1 with correction of worker ID calculation to workers themselves

1ed2a4b0c4ec31db58be70ac3687531434a6a8e6 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.15.0 with removed old timestamp with no timezone column from runs table

b4a0c6a5b773d6026a5a9ee9daa4a28d941c8339 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #157 from openaddresses/add_runs_timezone-#155

Removed vestigial runs.datetime column

795554fc15fcb4634ac0e05d6d61b2628bb8308c authored over 9 years ago by migurski <[email protected]>

Converting datetimes to UTC in code instead of database

db527eacd0f4f1ea923c58c2d00c2b1f11706192 authored over 9 years ago by Michal Migurski <[email protected]>

Removed references to runs.datetime column

5d53cdcf5a56c42d70271bdb7e0cec5ac998a5f2 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.14.0 with new timestamp with timezone column on runs table

cc45e8df19d9432cda770ddf873c60ba1efbf49c authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #156 from openaddresses/add-timezone-column-#155

Added runs.datetime_tz column to store additional datetime

487a3fa53a6dbe2c3280d397e1287e078d2d1dca authored over 9 years ago by migurski <[email protected]>

Added runs.datetime_tz column to store additional datetime

2714d84647aa577b9cf72ae42691aeea2bfa1962 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.13.0 with new runs table columns for worker and data info

121420bc8ad803ce871bff242791ed2c15bf5002 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #154 from openaddresses/expand-runs-table-#144

Expand runs table

78e6518d13bd7054e3dd0aa6d4840b955d175ea0 authored over 9 years ago by migurski <[email protected]>

Started populating runs commit_sha

6a572cfa16d3f5d375903aba89ec3d1c4997e58c authored over 9 years ago by Michal Migurski <[email protected]>

Started populating runs code_version and worker_id

253fd05fb2247bef080d54845fe7a613bb706e00 authored over 9 years ago by Michal Migurski <[email protected]>

Added runs table columns code_version, worker_id, job_id, and commit_sha

a78497691d083579beb89c2dc42faf53dcd52537 authored over 9 years ago by Michal Migurski <[email protected]>

Started populating runs job_id

6560bf7f5ef262c7ffd05a3a6c477b1b2b3b0e7d authored over 9 years ago by Michal Migurski <[email protected]>

Skipping payloads as necessary

4857a0738f4809da11ed687aa03c6e51f204cba1 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.12.0 with support for signed calls to ci.worker webhook

e7e7f8a807d9ece391ed68f850a7d5d30f39ae7f authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #149 from openaddresses/support-signatures-#148

[WIP] Support signatures

be3bb65f1e8465f3c8432f2e76fc604d9fb38d4b authored over 9 years ago by migurski <[email protected]>

Turned off signature check when no secrets configured

8a336b7252db37da2ebabc299431bd998ff211b7 authored over 9 years ago by Michal Migurski <[email protected]>

Rejecting unsigned requests to /hook

2e48ff8140e8de642c9d88bfb654ed44521dcdd2 authored over 9 years ago by Michal Migurski <[email protected]>

Added a new test for invalid webhook signatures

b606bcc4fcf799c635fbc87fc15a15e602ca4f17 authored over 9 years ago by Michal Migurski <[email protected]>

Added valid signatures to existing webhook tests

e6fb9e9a2020d16fc9dc41ac29564abfd82e75fe authored over 9 years ago by Michal Migurski <[email protected]>

Rejecting requests with invalid signatures

7c02daa596a09782d59c764ae605e1d93d2e25a5 authored over 9 years ago by Michal Migurski <[email protected]>

Moved signature keys to environment variables

8483649f31042953c68920a79d1f0675a3ca7bfa authored over 9 years ago by Michal Migurski <[email protected]>

Moved signature logging to new ci.observe_signature decorator

81bcb5981d8c2ccdd7040a6e702471cfcb4d9360 authored over 9 years ago by Michal Migurski <[email protected]>

Started logging signatures with fake key in order to debug behavior

c26af4f4936eabbb5689a745eddb0588a10b1e0f authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.11.0 with formally documented openaddr.ci service and worker features

9ff2300335b4d8ef9e8a91d97926d612276e1d90 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #147 from openaddresses/document-ci-#145

Document CI

9a2adb558715bdf71680d2c7d2ef7ab0c33bba54 authored over 9 years ago by migurski <[email protected]>

Added link to expected blog post on job page

863d185e236fd5c647db7e00cd85b3d75db3fc6b authored over 9 years ago by Michal Migurski <[email protected]>

Added usage instructions for CI mode

766873e30c6cf3c06c3ea996016b825005741c1e authored over 9 years ago by Michal Migurski <[email protected]>

Added short cooldown period in ci.pop_task_from_taskqueue()

2167dda6b5ef63a77ab28ec606f3bd5d7373736c authored over 9 years ago by Michal Migurski <[email protected]>

Added debug output to previous and completed runs for ci.worker

53547d2cac47013a06ef58164c4891bb6e7854e1 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.10.7 with fix to ci.worker bugs

0489c1455d7a0b55b3cc59bda7564ccd00c10d55 authored over 9 years ago by Michal Migurski <[email protected]>

Corrected logic of ci.is_completed_run() for repeat files

5eeb70d7498149a0be4875f1fd3719bbd7ae6167 authored over 9 years ago by Michal Migurski <[email protected]>

Fixed a few Python 2.7 encoding errors in tests

ebcec4b808479b7ae9692962d007580ef9c52cc4 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.10.6 with reverted logic of ci.is_completed_run() for repeat files

This reverts commit f66f58e86cd1ebd934f7b4548fff40b190f97d1b.

860b9a36cb282a1c16e2acd1c0181205c95420a9 authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.10.5 with fixed to ci.worker bugs

c29b2022a37b4326c270cb8caa6baedb387d7a9d authored over 9 years ago by Michal Migurski <[email protected]>

Corrected logic of ci.is_completed_run() for repeat files

f66f58e86cd1ebd934f7b4548fff40b190f97d1b authored over 9 years ago by Michal Migurski <[email protected]>

Delaying ci tasks slightly to better interleave large overlapping jobs

80d5b8ac50d4d56726fe5837ab5b8ac645bf3362 authored over 9 years ago by Michal Migurski <[email protected]>

Made pull request closure a no-op, and added test for complete PR sequence

5436d4137399898af3ca07f7dbbad22f7c2c520b authored over 9 years ago by Michal Migurski <[email protected]>

Bumped to 1.10.4 with fixes to ci.worker run process

57dad57697ce41b7f0d93795a21b7c258b6db7a4 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #142 from openaddresses/mark-run-copies-#141

Mark run copies

e95f64b918df62c5ca3878a3652acaa9dfae0367 authored over 9 years ago by migurski <[email protected]>

Made displayed order of runs explicit on job page

668b5aa0e19625fcdee7f7a28e83892c31349683 authored over 9 years ago by Michal Migurski <[email protected]>

Cleaned up a few deprecated test method names

29402affab49b0b5aab13cc4355f55a1bf65744c authored over 9 years ago by Michal Migurski <[email protected]>

Checking that copies are made of original runs, not copies

3bc345cc2ab276cb589f1df0871942c1c7afa36f authored over 9 years ago by Michal Migurski <[email protected]>

Added runs.copy_of column for copied runs

baff288d313a84bfbee019f428feaeb0fd136589 authored over 9 years ago by Michal Migurski <[email protected]>

Merge pull request #140 from openaddresses/reuse-run-status-#137

Re-use correct run status

2173cdef242828955ea61f70a6c3757c381c7361 authored over 9 years ago by migurski <[email protected]>

Updated ci.pop_task_from_taskqueue() to copy over run status

ba22cc8fa68ce10e2ed1dd3d879e39bdf804d879 authored over 9 years ago by Michal Migurski <[email protected]>

Checking uniqueness of copied runs

44b23b1e371bcd5c17dfe287ded8c8077f94c08b authored over 9 years ago by Michal Migurski <[email protected]>

Copying previously-complete runs instead of reusing them

b09c91d0d673dbe0c918541badf0fd2b9c4d901b authored over 9 years ago by Michal Migurski <[email protected]>