github.com/openaddresses/batch-machine commits

Configured docker-compose for test running

Adapts changes from @iandees commits:
- https://github.com/openaddresses/machine/commits/6d0f042...

a6a4a04e6a48a8947d914e6a89a647d85de9b8da authored almost 8 years ago

Added Docker hub push for possible image

2ab9f0a6ee40df8dfb4f2d0a7e039eef96ab8f6a authored almost 8 years ago

Added basic Dockerfile

5686388219801e7dc359c0cdc155a6d5b1232965 authored almost 8 years ago

Bumped to 4.10.3 with turned off cronjob verbose logging

9063bf7121285e2eacfeb7b19c9cfb4259e65824 authored almost 8 years ago

Bumped to 4.10.2 with started logging to Cloudwatch

3390bf9862724818a041da03a3f2a40edcf44948 authored almost 8 years ago

Merge pull request #609 from openaddresses/migurski/cleanup-logging

Add Cloudwatch logging

6f506460a4704c56dce177493b77d2e68c5e666d authored almost 8 years ago

Improved Cloudwatch log stream name

1fd7f27508d26616c53bc459beb535ff88422e09 authored almost 8 years ago

Removed key/secret args from SnsHandler

0be9a67d2fb09aa5a9eaa404e2fa808d77493406 authored almost 8 years ago

Changed signature of ci.setup_logger() to include log group name

d2d0dc4aec64d636bcdf5b1e553105041335c830 authored almost 8 years ago

Started logging to test Cloudwatch group

defeceade7d9417dcf0ad15da5d00b2010d48356 authored almost 8 years ago

Bumped to 4.10.1 with fixed render_slippymap() argument order error

186407885bdfa2bc1edf5c2e8a483b734a3fbcda authored almost 8 years ago

Merge pull request #607 from openaddresses/migurski/fix-preview-slippymaps

Fixed argument order to slippymap.generate in render_slippymap()

6a50b8bfaba38e667ef6a5c6a2d4daac8b7ecf77 authored almost 8 years ago

Fixed argument order to slippymap.generate in render_slippymap()

9b74e7ae56503a1c3f7cb85a5b122fc9c9c1a717 authored almost 8 years ago

Bumped to 4.10.0 with added second task queue for Docker

a5ba9e047484121cdbf6ac8d3d429b7ec15c0dac authored almost 8 years ago

Merge pull request #605 from openaddresses/migurski/add-second-task-queue

Writing webhook-sourced jobs to a second tasks queue

8c22f861a4c0e5fa3e7725c173987eddb9748848 authored almost 8 years ago

Writing webhook-sourced jobs to a second tasks queue

8f2e237879532b1d5a8d42d93c4bb894f1e83afe authored almost 8 years ago

Bumped to 4.9.1 with extended openaddr-index-tiles time limit

51ba2ae53cee65b6ae35f331a1f499efe26f071f authored almost 8 years ago

Bumped to 4.9.0 with added Tippecanoe commandline and dotmap properties

37aee6a0958f036f38f5b953b24054cdb022f59c authored almost 8 years ago

Oops, forgot to add properties

3ba34cc1f5f31c9ff52ff29edb3869d67ee4a2df authored almost 8 years ago

Merge pull request #603 from openaddresses/migurski/add-dotmap-properties

Stopped dropping properties in dotmap call to Tippecanoe

b3d1e5fe59262ae7069337fe2e12ea9c03cbbe04 authored almost 8 years ago

Stopped dropping properties in dotmap call to Tippecanoe

7c75a27c1aed0a3c9fe3328f7d46750c9778160b authored almost 8 years ago

Merge pull request #599 from openaddresses/migurski/add-tippecanoe-commandline

Improve Tippecanoe commandline

9d3ba34909114f03336cc34efab00eda5698191a authored almost 8 years ago

Extended slippymap.generate to accept multiple source filenames

ed57f022076728a6780e086c8c6b902391cfdc92 authored almost 8 years ago

Switched argument order to slippymap.generate

89e013d3cc4ec1a5b741b44680b5ba70ecbc8e20 authored almost 8 years ago

Added missing slippymap requirements

eae5c6c18097dde3b97090099265c6c716e43b9f authored almost 8 years ago

Bumped to 4.8.13 with raised S3 max size to 600MB

7cc65f5b499ccc84e11b01b244ac903d974b31d1 authored almost 8 years ago

Bumped to 4.8.12 with fixed dashboard graph and table

ceeff55f883a9f5c1c4991add1e7a61b68aea88c authored almost 8 years ago

Merge pull request #598 from openaddresses/migurski/link-dashboard-sources

Link dashboard sources

c795c0f9359feb35826f0c5225af3c803966b123 authored almost 8 years ago

Added source links in lost table

970982541a8766d40cd5d288a13875f5957ecaa5 authored almost 8 years ago

Adjusted graph scales

059871922b55ea119024ce17c3b6f616167b5496 authored almost 8 years ago

Bumped to 4.8.11 with fixed openaddr-calculate-coverage cron definition

f707f644c2fc65926c19d0b238a7d53ea3aa25ba authored almost 8 years ago

Bumped to 4.8.10 with adjusted resource logging to use child processes

26d3f421695e910993ff5fbf4a4312ccf34ab882 authored almost 8 years ago

Merge pull request #596 from openaddresses/migurski/update-resource-logging

Update resource logging

359060af0dc69a9912c00de89f42c0b55fab0f9c authored almost 8 years ago

Started counting usage from child processes

89278c5e07c320e62c5c0babb5f34fd771abb874 authored almost 8 years ago

Added final resource log and switched from elapsed to period

b375c384d37da888f46710b6bfb0c95ae75fc97e authored almost 8 years ago

Moved resource logging to new function and started testing it

53606512f8e5c44dbb67f66689150bacd200da0f authored almost 8 years ago

Bumped to 4.8.9 with fixed ISO 3166 code for Gifu, Japan

3a290f380e142753fdfed2ae93bd554e1fc58aa0 authored almost 8 years ago

Bumped to 4.8.8 with fixed missing ISO 3166 codes for France

41b6a21fd7837c161ec847bba64221b677417c77 authored almost 8 years ago

Bumped to 4.8.7 with fixed ISO 3166 code for Southwest Finland

f2ab1c4c1255d05c6b4e1987c812975e21ca5b68 authored almost 8 years ago

Bumped to 4.8.6 with started logging process resource usage

b978a90986f681b28ada2652bf827904aec5e8d3 authored almost 8 years ago

Merge pull request #589 from openaddresses/migurski/measure-resource-usage

Measure resource usage in run logs

ddaa271f95072ca246f939a67119435d214861e8 authored almost 8 years ago

Switched to machine-readable YAML for resource log messages

4ee44e902f438b026aa9aa72a74bc91a0fab536d authored almost 8 years ago

Added primitive memory and CPU logging

a4ced26139cff48a2b04decb1430080bd874baf5 authored almost 8 years ago

Added Nelson's suggested comments

7277a169930841177bb878ec8f7b3894a57307b1 authored almost 8 years ago

Added network IO logging

4e19883e4fb4eb47f60d7ff4bf58edf1e1bbddeb authored almost 8 years ago

Reformatted resource logging

a4c40105d99172882fbaa34e2b237563ea0c0234 authored almost 8 years ago

Fixed process_one log handler to record from all threads

a3c73116155aea039533be498b5ec62d611003af authored almost 8 years ago

Added disk IO logging

eee6da209213722d3040c3f63a3dd11967e446da authored almost 8 years ago

Bumped to 4.8.5 with fixed empty source handling with new problem definition

d5348543db9d10a011c724474358ee9fbf7293b3 authored almost 8 years ago

Merge pull request #590 from openaddresses/migurski/error-on-empty-source

Log a problem on an empty source

ffcd20c03d23490c845a8ed7fa52e13d610484ee authored almost 8 years ago

Replaced FAIL_REASONS strings with enum.Enum

b5247b006b8cc8857d7f0fa6c61329623e44e713 authored almost 8 years ago

Added handling for sources with no located addresses

ab2bc531d7dca41218f673927809fe7a6dd97a69 authored almost 8 years ago

Added failing Grand Traverse, MI test

fe5548d31362bd8bc523ec9c64ddf25f37d878cf authored almost 8 years ago

Bumped to 4.8.4 with fixed ISO 3166 code for Santa Catarina, BR

Closes #588.

b7b5925d8b91d64064e4dd90529693a6b490319c authored almost 8 years ago

Bumped to 4.8.3 with fixed nice_integer Jinja bug

a6cbaf451d2cc9e8bbd3f2878adde31b12b50146 authored almost 8 years ago

Merge pull request #586 from openaddresses/migurski/fix-nice-integer

Fixed naming conflict with Jinja nice_integer filter

8f816173e6f9534413c2b793dcfb61121165af10 authored almost 8 years ago

Fixed naming conflict with Jinja nice_integer filter

8ecbddc612397b43c761d663433b4184afd9ba3a authored almost 8 years ago

Copied over italic style for population coverage page

7c19f78217009a7d5f748537e4cd78d355fce270 authored almost 8 years ago

Bumped to 4.8.2 with configured scheduled task to update coverage data

78e7ef46e0f0e1c3ff995c0af463052754cb7b0c authored almost 8 years ago

Merge pull request #584 from openaddresses/migurski/include-population-page

Update population coverage page on a regular cycle

2d7e918600813691bf41c34bae1e995d8eca6566 authored almost 8 years ago

Added openaddr-calculate-coverage crontab job

f7ba1e39513d473efb0088b391aff93b656c5b23 authored almost 8 years ago

Added database URL arg for openaddr-calculate-coverage

82978dafe97efe28113f88b5289db6398c0a90ed authored almost 8 years ago

Fixed a topology error and loggin in calculating coverage

67ff5b990ce0015ba8a8edc4dc26212845d2085b authored almost 8 years ago

Bumped to 4.8.1 with linked and population coverage page

ee861311a0a45f6af379836fa414149cdb229543 authored almost 8 years ago

Merge pull request #583 from openaddresses/migurski/include-population-page

Copied over coverage page from Population repo

1bf5fe29cb8c95d8afea4181837a4d99de0b574c authored almost 8 years ago

Copied over code/templates/index.html from Population repo

See https://github.com/openaddresses/population/blob/d24073956/code/templates/index.html

0ac4bffb0fdeceeed91eac99eaea7f9fc7b4f783 authored almost 8 years ago

Bumped to 4.8.0 with added coverage report PostGIS and tables

2164980cd43da13e360d887b52f080a6ddded2d4 authored almost 8 years ago

Merge pull request #582 from openaddresses/migurski/include-population-page

Dark launch population page

f2b2b22934136886e3123d6589d53292596dc565 authored almost 8 years ago

Added test to calculate Null Island coverage

21e3058babeaf20d19821f5bbf86aaedb85f7c74 authored almost 8 years ago

Added coverage-related database schema

810f783f3ed22727bac1ef87a67d6a74f9a9c170 authored almost 8 years ago

Copied over code/import-world-render.py from Population repo

See https://github.com/openaddresses/population/blob/34cd7b688a35/code/import-world-render.py

81df7244ab42e4b2391fc0021aa3b58a4b423ef2 authored almost 8 years ago

Stubbed in openaddr-calculate-coverage script

f4aebd826b2243ded33af716702ac81fdf29d145 authored almost 8 years ago

Stubbed in a simple coverage page

aed269a97a4b05f021aa887434edc46001f3997b authored almost 8 years ago

Bumped to 4.7.0 with added RunState.run_id property

3786031a337493510b798c73305c7a47b6740ca1 authored almost 8 years ago

Merge pull request #578 from openaddresses/migurski/add-runstate-ids

Add RunState.run_id property

a6278c8bfea0fe0c97fbcedfef3887a56e55cf36 authored almost 8 years ago

Expanded slippymap URL generator to use new RunState.run_id

61e07008df04434ca36d8a3c776cc83975c58ee7 authored almost 8 years ago

Expanded TestHook.test_get_job to cover output more extensively

4a1cc130ded3c82043bee9c53a23b30a41f252c2 authored almost 8 years ago

Added and tested RunState.run_id property

957c7955f1c033c1cf0f14bbe21b4de310cfa17d authored almost 8 years ago

Bumped to 4.6.1 with fixed job page bug

42f5e4239aa506f5ded1182191f46d5808693452 authored almost 8 years ago

Merge pull request #577 from openaddresses/migurski/fix-job-page-again

Got rid of this prior hack

b816129f2c5d92e3317d4885dfb9347920ec9b40 authored almost 8 years ago

Sorting keys to be more reliable under tests

fa61ca8ca09e424a5dc186f694fec408801cbe10 authored almost 8 years ago

Got rid of this prior hack

8191171153c1398d178ffa6a7528432ea3867afa authored almost 8 years ago

Bumped to 4.6.0 with added RunState conversion on boundaries

14f9430614cf1db5543ae6b0090c195fb2398c0d authored almost 8 years ago

Merge pull request #576 from openaddresses/migurski/complete-runstate-usage

Complete RunState usage

b066f55bfc39607c6887de3bdcf8a69a75ddf6ba authored almost 8 years ago

Made objects.result_dictionary2runstate() a real, tested function

603237cf97d07115921d00c4301d7f7d07fa70f5 authored almost 8 years ago

Moved job/RunState juggling into utility functions

e0e2536f730c0cd73573a7a6224e903345cea183 authored almost 8 years ago

Fixed conversion to RunState instance in pop_task_from_donequeue()

166a4a7fb2f1493c43f3629b30c96dce57347797 authored almost 8 years ago

Accounting for stateless jobs

f502304cc3879b257eb45094dd5213dd90be485c authored almost 8 years ago

Fixed jobs functions to use RunState instances

e855befe829dd7688ddc861b2272e83e9be63c9f authored almost 8 years ago

Modified jobs tests to use RunState instances

17a76bfc4381a23315c8ea32bd30a4a7048db05f authored almost 8 years ago

Bumped to 4.5.2 with fixed job pages display bug

14134935ba0b5e49b3a6415edc7d2a0c3285e2ba authored almost 8 years ago

Merge pull request #575 from openaddresses/migurski/complete-runstate-usage

Accepting either "state" or "output" in webhooks.app_get_job()

b7959c39fb791851d98bc7cbd3753857a497ddae authored almost 8 years ago

Accepting either "state" or "output" in webhooks.app_get_job()

ebaec25b9ea8760a21128963c6d6ca5f2adf14ae authored almost 8 years ago

Bumped to 4.5.1 with RunState objects for pop_task_from_taskqueue() and front page count

d04be6ea859384c7b9b36656dca4620d6b777e9c authored almost 8 years ago

Merge pull request #573 from openaddresses/migurski/update-top-paragraph

Update top paragraph with sources count

36480811931b98def76dba25262acb5e2fcc0fff authored almost 8 years ago

Switched name of objects.read_completed_set_runs functions

b000567d717b68395c28cc2e30f7a18b1ee03afd authored almost 8 years ago

Added objects.read_completed_set_runs_count()

2df63110f6cdd54b0aaa1e088fbd7f7147222b5a authored almost 8 years ago

Added total sources count to front page

ce83b5127bb510a94aa6e72ba557cae32e1aa428 authored almost 8 years ago

Merge pull request #572 from openaddresses/migurski/use-runstate-objects

Use RunState objects

62cedabed0427dc9a496b32c477cfa3608e83a72 authored almost 8 years ago

Modified return of objects.get_completed_file_run() to include RunState instance

c2c239efb2ca1c31996597182632c0504a129a2f authored almost 8 years ago

Ecosyste.ms: OpenCollective

github.com/openaddresses/batch-machine