Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
github.com/openaddresses/machine
Scripts for running OpenAddresses on a complete data set and publishing the results.
https://github.com/openaddresses/machine
Added runs.status column
78243a52338d208102e42e1c63ce4a03ee77029c authored over 9 years ago by Michal Migurski <mike@teczno.com>
78243a52338d208102e42e1c63ce4a03ee77029c authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #139 from openaddresses/fix-zip-generation-#136
Fix broken zip generation and source name unicode errors
f5e97590d89d246657b44ec337696ae2b5d2ce6e authored over 9 years ago by migurski <mike-github@teczno.com>
Fixed confusion with package_output() file encoding
1f697ce9b791443c610cc98f70e8bc7ececd5dd8 authored over 9 years ago by Michal Migurski <mike@teczno.com>
1f697ce9b791443c610cc98f70e8bc7ececd5dd8 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Fixed Python 2 unicode bugs in cache and process_one string formats
b2f2dfc3b7712e02f747d7ca8ca798aa25b20e7b authored over 9 years ago by Michal Migurski <mike@teczno.com>
b2f2dfc3b7712e02f747d7ca8ca798aa25b20e7b authored over 9 years ago by Michal Migurski <mike@teczno.com>
Addressed a few unicode source name issues
0cb9fede30889d9c5a667c21666994a3e7360e8a authored over 9 years ago by Michal Migurski <mike@teczno.com>
0cb9fede30889d9c5a667c21666994a3e7360e8a authored over 9 years ago by Michal Migurski <mike@teczno.com>
Fixed bad path generation in package_output()
3a0becc568e8362d82f0619e0f71a1fb06b43ccc authored over 9 years ago by Michal Migurski <mike@teczno.com>
3a0becc568e8362d82f0619e0f71a1fb06b43ccc authored over 9 years ago by Michal Migurski <mike@teczno.com>
Fixed unicode handling in output zip generation
62acd6a6f150ed59ec7cd975c5c0e2b0d5429aa3 authored over 9 years ago by Michal Migurski <mike@teczno.com>
62acd6a6f150ed59ec7cd975c5c0e2b0d5429aa3 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Started testing FR La Réunion source
fbed516c9e4a110c41bf0d9707deea3a104454b3 authored over 9 years ago by Michal Migurski <mike@teczno.com>
fbed516c9e4a110c41bf0d9707deea3a104454b3 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Bumped to 1.10.3 with reused cached openaddr.ci run results
c88c3559d46223d4f5a57f9debb406dcaf275dd0 authored over 9 years ago by Michal Migurski <mike@teczno.com>
c88c3559d46223d4f5a57f9debb406dcaf275dd0 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #135 from openaddresses/reduce-repeated-runs-#133
Reduce repeated runs
19076a4c531d3ef3f7f6f3f590893a10dca3551a authored over 9 years ago by migurski <mike-github@teczno.com>
Added comments to openaddr.tests.ci.TestRuns
040ae73b6bd51d70e5d056fbdf994a77a98ab554 authored over 9 years ago by Michal Migurski <mike@teczno.com>
040ae73b6bd51d70e5d056fbdf994a77a98ab554 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Started looking for reusable runs within a time limit
923512d9484879f374eb52a081d1499362c2a468 authored over 9 years ago by Michal Migurski <mike@teczno.com>
923512d9484879f374eb52a081d1499362c2a468 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Started looking for any old recent run to re-use to make test pass
1431b2f782d12cbb73e354cfafff5c90e0ee4cb7 authored over 9 years ago by Michal Migurski <mike@teczno.com>
1431b2f782d12cbb73e354cfafff5c90e0ee4cb7 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added failing double-work task
39f0735fb49dd995be899a8b8cfe3656b799e4c4 authored over 9 years ago by Michal Migurski <mike@teczno.com>
39f0735fb49dd995be899a8b8cfe3656b799e4c4 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Bumped to 1.10.2 with change to openaddr.ci queue task contents
5c5bdfae8cec4d95947bfb2b9a8fb38c4374499b authored over 9 years ago by Michal Migurski <mike@teczno.com>
5c5bdfae8cec4d95947bfb2b9a8fb38c4374499b authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #134 from openaddresses/store-raw-bytes-#118
Storing base64-encoded sources in queue and runs
259b4e2ce772234e26bec20a63673e35c55a4f8b authored over 9 years ago by migurski <mike-github@teczno.com>
Switched from "id" to "job_id" in task data
e9341a3459f44a101ac4b1bc59a4ba0e5a7a34fb authored over 9 years ago by Michal Migurski <mike@teczno.com>
e9341a3459f44a101ac4b1bc59a4ba0e5a7a34fb authored over 9 years ago by Michal Migurski <mike@teczno.com>
Wrapped memoryview objects in bytes()
a5dae746f4f0adb0e12e5a65895c6b5ac291e13c authored over 9 years ago by Michal Migurski <mike@teczno.com>
a5dae746f4f0adb0e12e5a65895c6b5ac291e13c authored over 9 years ago by Michal Migurski <mike@teczno.com>
Storing base64-encoded sources in queue and runs
ff6dfa9b50d36181770291d8f7374ab4b267c52c authored over 9 years ago by Michal Migurski <mike@teczno.com>
ff6dfa9b50d36181770291d8f7374ab4b267c52c authored over 9 years ago by Michal Migurski <mike@teczno.com>
Bumped to 1.10.1 with continued openaddr.ci work
f1df339da38678e7531eb16c02b33ba6847bccb3 authored over 9 years ago by Michal Migurski <mike@teczno.com>
f1df339da38678e7531eb16c02b33ba6847bccb3 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Made a basic human-readable output for individual job pages
Closes #132.
da54697737961f69f49459b39762c8d16b17bed1 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Removed Apache from worker configuration
22f47691a1310384e0d992aaa3c00c83da38b039 authored over 9 years ago by Michal Migurski <mike@teczno.com>
22f47691a1310384e0d992aaa3c00c83da38b039 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added destination bucket configuration
Closes #131.
f4655b4ce7132ffa745ddbc06a5e3c6326ce188d authored over 9 years ago by Michal Migurski <mike@teczno.com>
Pushing index.json to S3 with everything else
0ba91c154e5439d87cac75a631aa618428d98115 authored over 9 years ago by Michal Migurski <mike@teczno.com>
0ba91c154e5439d87cac75a631aa618428d98115 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Allow for unknown removed files in pushes
Closes #128.
27f4ac3f7fcfd3d6f4198a6853a9b3225d23d48e authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #130 from openaddresses/support-external-pr-#127
Support external pull requests
f7e46a0aed91901c4f8bbf73e79198ab212934ab authored over 9 years ago by migurski <mike-github@teczno.com>
Added tests to verify pull request payload parsing
01649199140a24b5277cf0e0f29af410d9b10d4a authored over 9 years ago by Michal Migurski <mike@teczno.com>
01649199140a24b5277cf0e0f29af410d9b10d4a authored over 9 years ago by Michal Migurski <mike@teczno.com>
Stubbed out payload handling for pull requests
e9e13c0fb7243cf14681ba92126491c69a777776 authored over 9 years ago by Michal Migurski <mike@teczno.com>
e9e13c0fb7243cf14681ba92126491c69a777776 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Populating uploaded zip with better filenames
dfc60c2b4cd9804b1f515f9bf0dc2533d4881d0d authored over 9 years ago by Michal Migurski <mike@teczno.com>
dfc60c2b4cd9804b1f515f9bf0dc2533d4881d0d authored over 9 years ago by Michal Migurski <mike@teczno.com>
Corrected S3 upload contents
8f818feabeb2eefcf2539647c38990986a9d8f30 authored over 9 years ago by Michal Migurski <mike@teczno.com>
8f818feabeb2eefcf2539647c38990986a9d8f30 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #129 from openaddresses/push-worker-results-s3-#126
Push worker results to S3
a00c9fb5ffbd8939cbb060e33b8b4c2e62f9489e authored over 9 years ago by migurski <mike-github@teczno.com>
Removed some debugging print statements
d7543b25a8e819bfbf4dc7443877a323b4347836 authored over 9 years ago by Michal Migurski <mike@teczno.com>
d7543b25a8e819bfbf4dc7443877a323b4347836 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Uploading zipped output instead of raw CSV
342583433939b7e5d6f9e8c33c7c658a7c61732b authored over 9 years ago by Michal Migurski <mike@teczno.com>
342583433939b7e5d6f9e8c33c7c658a7c61732b authored over 9 years ago by Michal Migurski <mike@teczno.com>
Reserving space in the runs table ahead of time for URLs
c0e1a5c062c1f9b289ab7aedd5534af076b6b8ed authored over 9 years ago by Michal Migurski <mike@teczno.com>
c0e1a5c062c1f9b289ab7aedd5534af076b6b8ed authored over 9 years ago by Michal Migurski <mike@teczno.com>
Starting to write to S3 in ci.worker.do_work()
d9fa1afb442d2030a9d957bb8d1af69b3ad8ab26 authored over 9 years ago by Michal Migurski <mike@teczno.com>
d9fa1afb442d2030a9d957bb8d1af69b3ad8ab26 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Inserted unused S3 bucket argument to openaddr.ci worker
d8ea7c74afefa65ca45f5f94bb84b205fed28fd4 authored over 9 years ago by Michal Migurski <mike@teczno.com>
d8ea7c74afefa65ca45f5f94bb84b205fed28fd4 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Moved openaddr.process_all.package_result() to openaddr.package_output()
487222e3c887295642a396e8bbc514d9ee0d9c2d authored over 9 years ago by Michal Migurski <mike@teczno.com>
487222e3c887295642a396e8bbc514d9ee0d9c2d authored over 9 years ago by Michal Migurski <mike@teczno.com>
Corrected unicode type for Github status update descriptions
d0ccbcefbf7192487d9d6bab280881edda45bbac authored over 9 years ago by Michal Migurski <mike@teczno.com>
d0ccbcefbf7192487d9d6bab280881edda45bbac authored over 9 years ago by Michal Migurski <mike@teczno.com>
Corrected UTF8 encoding for URLs in ci.process_payload_files()
f532fc82fae4cf20dc31567ab9e1576d66c9b113 authored over 9 years ago by Michal Migurski <mike@teczno.com>
f532fc82fae4cf20dc31567ab9e1576d66c9b113 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Corrected UTF8 encoding for URLs in ci.process_payload_files()
8abcc9cea0c44c0066ff2a174f2e68ce48b5e3c5 authored over 9 years ago by Michal Migurski <mike@teczno.com>
8abcc9cea0c44c0066ff2a174f2e68ce48b5e3c5 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Accounting for unicode filenames in ci.get_touched_branch_files()
16c7f41a8dddc0a8daa4ede7cccf0c4d54bb6b16 authored over 9 years ago by Michal Migurski <mike@teczno.com>
16c7f41a8dddc0a8daa4ede7cccf0c4d54bb6b16 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Accounting for unicode filenames in ci.get_touched_payload_files()
c2db5c5eae85c6a2d086fd675b0796424586a1c0 authored over 9 years ago by Michal Migurski <mike@teczno.com>
c2db5c5eae85c6a2d086fd675b0796424586a1c0 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added error logging inside ci hook
030165f97aa55870ac05de082ab08f86375f6064 authored over 9 years ago by Michal Migurski <mike@teczno.com>
030165f97aa55870ac05de082ab08f86375f6064 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added error logging inside ci hook
21fb9c1bee5d3c63c37853c68b471803263e605a authored over 9 years ago by Michal Migurski <mike@teczno.com>
21fb9c1bee5d3c63c37853c68b471803263e605a authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added test case for csvsplit excerpt
96c391616f5d88bc0e7eed43a2bd1c0d6f4a64ee authored over 9 years ago by Michal Migurski <mike@teczno.com>
96c391616f5d88bc0e7eed43a2bd1c0d6f4a64ee authored over 9 years ago by Michal Migurski <mike@teczno.com>
Respecting csvsplit parameter in ExcerptDataTask
3f6ed01bc7eb4fa0a69afa1dbdd2af49be8abc0b authored over 9 years ago by Michal Migurski <mike@teczno.com>
3f6ed01bc7eb4fa0a69afa1dbdd2af49be8abc0b authored over 9 years ago by Michal Migurski <mike@teczno.com>
Bumped to 1.10.0 with City, District, and Region columns and AWS features
c9c002b12e354c0200527065c48a8b281c137c46 authored over 9 years ago by Michal Migurski <mike@teczno.com>
c9c002b12e354c0200527065c48a8b281c137c46 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #106 from openaddresses/add_fields_to_output
Add some fields to the output CSV
344ed26a71eb271c451580f8fe0b3af7342696dd authored over 9 years ago by migurski <mike-github@teczno.com>
Added tests using Carson source
073916084df1a863ac0509e231aa313a3c843722 authored over 9 years ago by Michal Migurski <mike@teczno.com>
073916084df1a863ac0509e231aa313a3c843722 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Return the expected tuple
58b746f84326b0178d182f880cf3aa4c3ea1e5ed authored over 9 years ago by Ian Dees <ian.dees@gmail.com>
58b746f84326b0178d182f880cf3aa4c3ea1e5ed authored over 9 years ago by Ian Dees <ian.dees@gmail.com>
Add city, district, and region to output.
6e4d7776182861562e8000245d426d5ef82ae0bb authored over 9 years ago by Ian Dees <ian.dees@gmail.com>
6e4d7776182861562e8000245d426d5ef82ae0bb authored over 9 years ago by Ian Dees <ian.dees@gmail.com>
Fix tests for new fields
f7434c964973505b5687e0a15513bffdfcecaeb1 authored over 9 years ago by Ian Dees <ian.dees@gmail.com>
f7434c964973505b5687e0a15513bffdfcecaeb1 authored over 9 years ago by Ian Dees <ian.dees@gmail.com>
Added handling and test for branch deletion push webhook
1c9dd1421d44d1a19c0e969082d91e40ea22bce1 authored over 9 years ago by Michal Migurski <mike@teczno.com>
1c9dd1421d44d1a19c0e969082d91e40ea22bce1 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Improved transaction isolation in ci.pop_task_from_taskqueue()
e5d2ec53737884aed01d2e8248e93ebb174e70e0 authored over 9 years ago by Michal Migurski <mike@teczno.com>
e5d2ec53737884aed01d2e8248e93ebb174e70e0 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #122 from openaddresses/added-sns-errors-#120
Added SNS errors and Cloudwatch reporting
4c3adae3fcf0369c226cfa646df4d1a5ca5ce90d authored over 9 years ago by migurski <mike-github@teczno.com>
Added AWS configuration to chef
7ef84939c65555a70e836bca6a3aabea64773a58 authored over 9 years ago by Michal Migurski <mike@teczno.com>
7ef84939c65555a70e836bca6a3aabea64773a58 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added SNS error reports with required AWS_SNS_ARN configuration
c3f031c4ace2e307aa432f63d2d9912cdf9aa260 authored over 9 years ago by Michal Migurski <mike@teczno.com>
c3f031c4ace2e307aa432f63d2d9912cdf9aa260 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added Cloudwatch notification for queue state
a9fce9b5459184d48bb8247a894e2d80523d4107 authored over 9 years ago by Michal Migurski <mike@teczno.com>
a9fce9b5459184d48bb8247a894e2d80523d4107 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Made worker web docroot configurable
578da8068b09acff1ea25acd77927e2b20a0ac08 authored over 9 years ago by Michal Migurski <mike@teczno.com>
578da8068b09acff1ea25acd77927e2b20a0ac08 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Fixed openaddr.ci process-one directory permissions
8cd99a378de35f3942c2295b90cdb708d087215b authored over 9 years ago by Michal Migurski <mike@teczno.com>
8cd99a378de35f3942c2295b90cdb708d087215b authored over 9 years ago by Michal Migurski <mike@teczno.com>
Stopped using job ID to determine ci.worker process-one directory name
2173ad9fb84ead51501d2654aa9197ba6fce74bc authored over 9 years ago by Michal Migurski <mike@teczno.com>
2173ad9fb84ead51501d2654aa9197ba6fce74bc authored over 9 years ago by Michal Migurski <mike@teczno.com>
Bumped to 1.9.4 with new openaddr.ci setup and logging configuration
d2925cdc222712d77ee61af1ae3c34fad5a22951 authored over 9 years ago by Michal Migurski <mike@teczno.com>
d2925cdc222712d77ee61af1ae3c34fad5a22951 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Tweaked logging level and config locations
8b349089c5d988117f5d86c795113dd1a0109b75 authored over 9 years ago by Michal Migurski <mike@teczno.com>
8b349089c5d988117f5d86c795113dd1a0109b75 authored over 9 years ago by Michal Migurski <mike@teczno.com>
No longer attempting to POST to Github without status_url
eb5634bb27a4d19945605d54a617c00bb6c71ccf authored over 9 years ago by Michal Migurski <mike@teczno.com>
eb5634bb27a4d19945605d54a617c00bb6c71ccf authored over 9 years ago by Michal Migurski <mike@teczno.com>
Set up error logging for individual flask requests
44d14ea51ea4eceb2319232faa87e4ac237c2ce2 authored over 9 years ago by Michal Migurski <mike@teczno.com>
44d14ea51ea4eceb2319232faa87e4ac237c2ce2 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added error logging for individual flask requests
dda6472412d83316ad3d6a9604cdd7bb68324836 authored over 9 years ago by Michal Migurski <mike@teczno.com>
dda6472412d83316ad3d6a9604cdd7bb68324836 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Replaced Github un-token with GAG_GITHUB_STATUS configuration.
1316067abc1b39e6c7dcb617a494e510e85d7b68 authored over 9 years ago by Michal Migurski <mike@teczno.com>
1316067abc1b39e6c7dcb617a494e510e85d7b68 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added Github un-token to prevent notification
23853aa94b9c8fdf7d6bff4e921fb7b9d9674364 authored over 9 years ago by Michal Migurski <mike@teczno.com>
23853aa94b9c8fdf7d6bff4e921fb7b9d9674364 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Updated to Python 3 octal representation
cd34d6012fd65c9a9b080fdaa6813785e0bc14dc authored over 9 years ago by Michal Migurski <mike@teczno.com>
cd34d6012fd65c9a9b080fdaa6813785e0bc14dc authored over 9 years ago by Michal Migurski <mike@teczno.com>
Creating openaddr.process_one logfile in mode 0644
Closes #105.
faa6555a3ebfb265c81a0207482e1752acfd1f42 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Expanded CI Apache configs
27ba3722ecdda0f945d2c0fe4811327527b58057 authored over 9 years ago by Michal Migurski <mike@teczno.com>
27ba3722ecdda0f945d2c0fe4811327527b58057 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added CI hostname and worker logger configs
fbed1357a099cf0f97bd65930473b1f9145af7dc authored over 9 years ago by Michal Migurski <mike@teczno.com>
fbed1357a099cf0f97bd65930473b1f9145af7dc authored over 9 years ago by Michal Migurski <mike@teczno.com>
Improved openaddr.ci logging output for queue tasks
Closes #119.
c2d64eb6c3f69aceef8c233db674033c4673f631 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added openaddr.ci.DUETASK_DELAY and tweaked some log configs
bcab5cddd658a205645357e35df5cbfd33b32d22 authored over 9 years ago by Michal Migurski <mike@teczno.com>
bcab5cddd658a205645357e35df5cbfd33b32d22 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Bumped to 1.9.3 with new runs table in openaddr.ci.worker for Amazon EC2
4bf4f971c4ec5b49f8dc848f21f7ec119abe9005 authored over 9 years ago by Michal Migurski <mike@teczno.com>
4bf4f971c4ec5b49f8dc848f21f7ec119abe9005 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Merge pull request #117 from openaddresses/add-runs-table-#113
[WIP] Add runs table
d16cac9f94494c58aee464a1a6bdeec6597dde47 authored over 9 years ago by migurski <mike-github@teczno.com>
Made ci.pop_task_from_taskqueue() more resilient to missing task parts
5dbeb44cf8cf286095d3dce0afd9e9110260591f authored over 9 years ago by Michal Migurski <mike@teczno.com>
5dbeb44cf8cf286095d3dce0afd9e9110260591f authored over 9 years ago by Michal Migurski <mike@teczno.com>
Python 3 bytes/string fix
11bda996c0655910a3f5d999ee3c5825cf93c0bb authored over 9 years ago by Michal Migurski <mike@teczno.com>
11bda996c0655910a3f5d999ee3c5825cf93c0bb authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added raw bytes of input content to runs table
0fccddadb4952cb6e2388ddfa9e36ac2516c05d1 authored over 9 years ago by Michal Migurski <mike@teczno.com>
0fccddadb4952cb6e2388ddfa9e36ac2516c05d1 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Testing for bad UTF-8 sources
9bedbe05878b4cf3ab04898bea8a59e40780d24a authored over 9 years ago by Michal Migurski <mike@teczno.com>
9bedbe05878b4cf3ab04898bea8a59e40780d24a authored over 9 years ago by Michal Migurski <mike@teczno.com>
Tracking JSON content in round-trip, with tests for bad JSON sources
c8a6f66959d138ac0ab7cfe4d64c92ab1e021cbe authored over 9 years ago by Michal Migurski <mike@teczno.com>
c8a6f66959d138ac0ab7cfe4d64c92ab1e021cbe authored over 9 years ago by Michal Migurski <mike@teczno.com>
Implemented round-trip to Github status API in tests.ci.TestRuns
e59e4434d8373229161e866cff770713b3db6391 authored over 9 years ago by Michal Migurski <mike@teczno.com>
e59e4434d8373229161e866cff770713b3db6391 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Consolidated parts of ci.pop_task_from_donequeue() and ci.pop_task_from_duequeue()
ab6c93bec2dbd4bd68e1c93b1106dc46c2759f57 authored over 9 years ago by Michal Migurski <mike@teczno.com>
ab6c93bec2dbd4bd68e1c93b1106dc46c2759f57 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Implemented remainder of ci.pop_task_from_duequeue() with tests
c2fc22f844e58492e2bf97e9999679f388163561 authored over 9 years ago by Michal Migurski <mike@teczno.com>
c2fc22f844e58492e2bf97e9999679f388163561 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Sketched out test for an overdue run that completes anyway
6d6dabcf64f9218c4013a825bd9ccf5833176f2e authored over 9 years ago by Michal Migurski <mike@teczno.com>
6d6dabcf64f9218c4013a825bd9ccf5833176f2e authored over 9 years ago by Michal Migurski <mike@teczno.com>
Testing returning ci.worker Due task and fixed a missing file_id
2a29a65e409158cabfc30433f60e49ffd1ab5a2d authored over 9 years ago by Michal Migurski <mike@teczno.com>
2a29a65e409158cabfc30433f60e49ffd1ab5a2d authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added subprocess32 to Python 2 setup requirements
f2e9a5bda7e41a4ad109b2677e4d62ddf50b932c authored over 9 years ago by Michal Migurski <mike@teczno.com>
f2e9a5bda7e41a4ad109b2677e4d62ddf50b932c authored over 9 years ago by Michal Migurski <mike@teczno.com>
Started using subprocess.check_output() timeout argument
Relevant to https://github.com/openaddresses/machine/issues/116
96feb0f80720b09a64f24189b03a933d9c2d5a65 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added stubby handler for the due queue
bffb48c102db8036822397e22f179b330ea0b680 authored over 9 years ago by Michal Migurski <mike@teczno.com>
bffb48c102db8036822397e22f179b330ea0b680 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Patched Python 3 error in pq
See https://github.com/malthe/pq/pull/5
d7aee49f6522c017373227a2e3291b76eb3644e6 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Switched to subprocess32 with timeout argument for Python 2.7
09ffe9b31d0343f81b54eeaec22fe23e1a8fd2fa authored over 9 years ago by Michal Migurski <mike@teczno.com>
09ffe9b31d0343f81b54eeaec22fe23e1a8fd2fa authored over 9 years ago by Michal Migurski <mike@teczno.com>
Started using queue.put() expected_at argument for priority
5802c9552c72c65f8f39d6154c9bbe8745649287 authored over 9 years ago by Michal Migurski <mike@teczno.com>
5802c9552c72c65f8f39d6154c9bbe8745649287 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Moved ci.worker functions to openaddr.ci module
2eb80a78af219072c0707bd79f823b4fd3bca05c authored over 9 years ago by Michal Migurski <mike@teczno.com>
2eb80a78af219072c0707bd79f823b4fd3bca05c authored over 9 years ago by Michal Migurski <mike@teczno.com>
Defined jobs.JOB_TIMEOUT as a datetime.timedelta
5b7db4d1b36135433a847e2b714dbf456865dde1 authored over 9 years ago by Michal Migurski <mike@teczno.com>
5b7db4d1b36135433a847e2b714dbf456865dde1 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Testing for future unused due task after failing task
fd1a1e4d58f02d43229b9bdc7464bfd4c5f02464 authored over 9 years ago by Michal Migurski <mike@teczno.com>
fd1a1e4d58f02d43229b9bdc7464bfd4c5f02464 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Added new "due" queue for worker tasks expected in the future
f4c6100ea7d77cd6f5fe3c6db1e457cd1a519d60 authored over 9 years ago by Michal Migurski <mike@teczno.com>
f4c6100ea7d77cd6f5fe3c6db1e457cd1a519d60 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Made queue name a required argument to ci.db_queue()
a5053b8ea62dc296d069ac08ca313a8324cd6a57 authored over 9 years ago by Michal Migurski <mike@teczno.com>
a5053b8ea62dc296d069ac08ca313a8324cd6a57 authored over 9 years ago by Michal Migurski <mike@teczno.com>
Writing completed runs to runs table
6c875e747de956399cb44a11fc2a79b57ddb783c authored over 9 years ago by Michal Migurski <mike@teczno.com>
6c875e747de956399cb44a11fc2a79b57ddb783c authored over 9 years ago by Michal Migurski <mike@teczno.com>
Made ci.worker.main() look more like ci.run_dequeue.main() for testing
25712b6c65214f7ffaf5cff043ba896102b4082b authored over 9 years ago by Michal Migurski <mike@teczno.com>
25712b6c65214f7ffaf5cff043ba896102b4082b authored over 9 years ago by Michal Migurski <mike@teczno.com>
Defined runs table schema
65cfdd1490b21eb4d7eab7fa4fdcb5f39b442fdf authored over 9 years ago by Michal Migurski <mike@teczno.com>
65cfdd1490b21eb4d7eab7fa4fdcb5f39b442fdf authored over 9 years ago by Michal Migurski <mike@teczno.com>