Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/openaddresses/machine

Scripts for running OpenAddresses on a complete data set and publishing the results.
https://github.com/openaddresses/machine

Added some log statements

5a20749d92efb39b5676fa499fbca8d76dbb4875 authored about 8 years ago by Michal Migurski <[email protected]>
Added some log statements

6204c63c0cfd69660e3f6d49220460bdcb9741a9 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.4.1 with fix to an import and index page size

99e50adc7dd460167a040e77fbda3efd08345813 authored about 8 years ago by Michal Migurski <[email protected]>
Added link to show complete runs on index page

9aa8085d3c1b2b0b29509b356b4918c47e5537ff authored about 8 years ago by Michal Migurski <[email protected]>
Fixed flask CORS import

627d3735d09985280c1aaa1f25b2b6387c5645a7 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.4.0 with added cache file S3 POST with Github auth

c8410afa214ded1202f2b4f95559337c79b22902 authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #415 from openaddresses/migurski/add-s3-upload

Add S3 upload for cache

a29a88726dee3ecd63a3059f06f0c3f29128bea4 authored about 8 years ago by migurski <[email protected]>
Do not set up SNS logging if no ARN present

9527facb03dcf4d0b9b764a87f731cb5d2e0e77a authored about 8 years ago by Michal Migurski <[email protected]>
Added missing AWS config to Flask tests

fa4061505150a394e05ed02193c8195503636547 authored about 8 years ago by Michal Migurski <[email protected]>
Added user-based subdirectory and better links

48dd9ef2f3aaaab6d847dff72e66c7314a642fa3 authored about 8 years ago by Michal Migurski <[email protected]>
Added uploaded file display

bc166c0fb963db47f600862fe687e4e35a210f49 authored about 8 years ago by Michal Migurski <[email protected]>
Extended base.html from oauth-hello.html

611e5154348d416007ffde87beea442fa5f19f83 authored about 8 years ago by Michal Migurski <[email protected]>
Moved upload form to HTML templates

f5b45bf432fb05bef513bea88c5a8782969ace19 authored about 8 years ago by Michal Migurski <[email protected]>
Added and tested new S3 POST upload functionality

f5fd384efcda7a1be4cfa759b4163a44797c0475 authored about 8 years ago by Michal Migurski <[email protected]>
Made "github user" session key into a constant

d30b5807dfcf73c4b4ebd2ab59061ba13b806d36 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.3.2 with fixed collections coordinate bounds

8b9d6f4e47340f462d3394512f68557fd032dd5e authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #412 from openaddresses/migurski/fix-collection-overflow

Fix collection overflows

9647819bf6dcbe6451f116c622cefe26d68145f6 authored about 8 years ago by migurski <[email protected]>
Fixed a source of indeterminacy

8074f2a399a445c47ece7a7116d3e175b0a623ac authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.3.1 with tweaked crontab timing

9cad506e460246a581ec03e9fabfe14f2015f102 authored about 8 years ago by Michal Migurski <[email protected]>
Expanded test of expand_and_add_csv_to_zipfile()

c02d8e1d315b097ca94f643f53fd513eac3ebe9f authored about 8 years ago by Michal Migurski <[email protected]>
Fixed handling of overflowing coordinates in expand_and_add_csv_to_zipfile()

48021edada32c9babcf93d96e40cc87c793d37f7 authored about 8 years ago by Michal Migurski <[email protected]>
Added failing test with overflowing us/co/arapahoe coordinates

19caf40ff9f07f3c45d285e1d60c064da2ee3402 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.3.0 with added tile index URLs and license content

ff9db7b876b50c658a702668a3e618ae7cbd78d2 authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #411 from openaddresses/migurski/add-tileindex-output

Extend tileindex output and links

a9ab08cc05380b5c911ec5aa88116c3134c30651 authored about 8 years ago by migurski <[email protected]>
Fixed some Python 2 nonsense

d4602ceed212365aa83bf3cdf9491d1ba9f7f965 authored about 8 years ago by Michal Migurski <[email protected]>
Switched to configured S3 bucket name

520dc1d45f44f4c153514b2256a86d540d7de0e9 authored about 8 years ago by Michal Migurski <[email protected]>
Added tileindex_url to API responses

ed1b15b6bc64bd0c37001ee2d486e15b8eac660a authored about 8 years ago by Michal Migurski <[email protected]>
Added Portland Metro to tile index, and verifying that it's skipped for license reasons

34cc488d4c8b60646df5937c634651c1aba65804 authored about 8 years ago by Michal Migurski <[email protected]>
Added LICENSE.txt to published tiles

e2d18c61f18069dbc4e204e1f161f3d2ecd63d58 authored about 8 years ago by Michal Migurski <[email protected]>
Started storing results instead of states in ci.tileindex.Tile

41c3103804d8c6f449847ccec0b1fe958d6c8210 authored about 8 years ago by Michal Migurski <[email protected]>
Removed special license summary code in ci.collect.CollectorPublisher

7139c4ba24acc6001c67615cc665c648c984de4e authored about 8 years ago by Michal Migurski <[email protected]>
Added util.summarize_result_licenses()

1f42a1b77c4c6a546e7b2fb78f3e48284904a535 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.2.1 with updated dependency versions

be83b3c92b1b0550df153e9f665d7a0c287cff94 authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #409 from openaddresses/migurski/upgrade-deps

Upgrade various dependencies

d5747d74803f4ef721d33c9595482edc8a010c06 authored about 8 years ago by migurski <[email protected]>
Bumped Shapely and Fiona versions

806117bcf3258721774f6342d96a606bbcb88a5e authored about 8 years ago by Michal Migurski <[email protected]>
Bumped boto3 version

993180b5d55cf4edca0d5147fe02c7e475f96033 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped pq and psycopg2 versions

1563025cec604ac4e3c37aa46a925972b9ea1eca authored about 8 years ago by Michal Migurski <[email protected]>
Bumped mock version

f72403c4130986bba527f176de2eff93958b88bd authored about 8 years ago by Michal Migurski <[email protected]>
Bumped Werkzeug and gunicorn versions

b9dfe5337573675bff5836634017128e5f0688ed authored about 8 years ago by Michal Migurski <[email protected]>
Bumped Flask and Flask-Cors versions

cf31df1a9b33035dd12f05b7f95145917cec07b3 authored about 8 years ago by Michal Migurski <[email protected]>
Pinned httmock

dd68412a5d597472da1e16366a35593731a3ccc2 authored about 8 years ago by Michal Migurski <[email protected]>
Pinned boto, jinja, dateutils, and ijson

d84464cd79e4aa1666c1f5c5d70152a051489b3b authored about 8 years ago by Michal Migurski <[email protected]>
Bumped requests version

d5ed22441e700a62e8344df153e98e9a46279a20 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.2.0 with added openaddr-index-tiles script and crontab

5a47dc9565f7a12fc93d1b51eb25f9f645dd7aa9 authored about 8 years ago by Michal Migurski <[email protected]>
Merge branch 'migurski/add-tileindex-output'

Conflicts:
chef/crontab/recipes/default.rb

65b354852546b043ea0b1eb48c02397da6b88125 authored about 8 years ago by Michal Migurski <[email protected]>
Reduce dotmap frequency to every 5th day

c1161c30b059af0b64c75f2bd47caa3cc64cec27 authored about 8 years ago by Michal Migurski <[email protected]>
Added openaddr-index-tiles job every 3rd day

8eeba44a7c70878a47c1f228302c114043a4ede3 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.1.4 with fixed Github token in enqueue sources

1bcc61ec6b9f77a72075ad9a8616c23b6ee78a00 authored about 8 years ago by Michal Migurski <[email protected]>
Added openaddr-index-tiles script for spatially-indexes tiles

f4b60c0d213b69c10b79f84d2e9ab5e1c24403c8 authored about 8 years ago by Michal Migurski <[email protected]>
Switched to gzipped on-disk storage for tile CSVs

b286e09b689b633065e9eb162f52c70d6dfe1f0f authored about 8 years ago by Michal Migurski <[email protected]>
Dividing tile files into subdirectories, possibly for speed

1779df41576baba8dc10b0ef41905bad069d9220 authored about 8 years ago by Michal Migurski <[email protected]>
Sorted runs by source path for locality

a16d11a0ef2eb9e317e8cd875b4cc3b39a703fd0 authored about 8 years ago by Michal Migurski <[email protected]>
Removed unneeded apt-get install

f53a945a92c1735bda83e1e6f45e0d5d74d4491a authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.1.3 with fix to remote-run LC_ALL

0cb2519d87e7fb140d84886b9ae3615cecd05ce4 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.1.2 with fix to remote-run LC_ALL

324984be17f00f6a87a5fdb2c529f3ff6920ee00 authored about 8 years ago by Michal Migurski <[email protected]>
Added a check for out-of-range lat/lon values

6fce6a2223562630b3fd0bb8e9ce583dd9e20677 authored about 8 years ago by Michal Migurski <[email protected]>
Added a check for bad lat/lon values

cf574ab60235bc7c74152dc302e4521be0a3dbee authored about 8 years ago by Michal Migurski <[email protected]>
Added tileindex Tile.publish()

0fe080141b52d91f2d933c280a07695bbb484690 authored about 8 years ago by Michal Migurski <[email protected]>
Added ci.tileindex.main() entry point

ba1138090f8451471fd409e84fa1f2bc82448f80 authored about 8 years ago by Michal Migurski <[email protected]>
Parametrized tile sizes

1dec522231027a41c9e7480ede671d1c76f04d35 authored about 8 years ago by Michal Migurski <[email protected]>
Stored RunState in indexed tiles

637864041918dc4397e2289791464005b24bbd16 authored about 8 years ago by Michal Migurski <[email protected]>
Added source_base to points and tiles

5bd8ddec83f547a4b79ecb20d63e155637a8e2e1 authored about 8 years ago by Michal Migurski <[email protected]>
Populating tile dict with tileindex.populate_tiles()

23ee5a7fb0c6dffc01bfbb362283400daf226c16 authored about 8 years ago by Michal Migurski <[email protected]>
Added missing outputs files

5007cfccc8b39954a891f29075f0d2766f212ab2 authored about 8 years ago by Michal Migurski <[email protected]>
Removed some print statements

79cd17404fdfeaf8d13d688caeef51de91b15363 authored about 8 years ago by Michal Migurski <[email protected]>
Added iterate_point_blocks() to group points

b9ad0d7e5960267b8e5366e9fcd99d5106a19cb6 authored about 8 years ago by Michal Migurski <[email protected]>
Added tileindex.iterate_runs_points()

53ea3c68ad8a8aab92006cb8483311696592b8cc authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.1.1 with fixed LC_ALL crontab environments

f5384e9a71810f2d9ceb08b45889e599e4439ee2 authored about 8 years ago by Michal Migurski <[email protected]>
Added LC_ALL to each crontab entry

036b1591026a4e93672179213e08cf1aa0301a73 authored about 8 years ago by Michal Migurski <[email protected]>
Added dummy tile index test class

ac61d2dfd4647d88d3703ada9fa5370621c51cb5 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.1.0 with added partial secret /hook header

051893d7e7cace779e2fe5cc736dbdc739a6a14f authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #406 from openaddresses/migurski/add-secret-output

Added partial secret output to /hook

38ec4d145829421609054ba63b021de5c3539ccc authored about 8 years ago by migurski <[email protected]>
Added partial secret output to /hook

50ad44db97dda3001826de96d77c05ca5fa7997f authored about 8 years ago by Michal Migurski <[email protected]>
Added installation instructions

3dd70667bf51bdef2bd6b2efcc04111143448c5a authored about 8 years ago by Michal Migurski <[email protected]>
Updated docs to reflect 3.0.7

ff1f7c4e6ab499b91736ab7c5e9dcb32320a1663 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.0.7 with fixed S3 multipart encoding and coverage maps

7fb01f41d74ee09968f609e4b21133b7e5ca2f9a authored about 8 years ago by Michal Migurski <[email protected]>
Configured front page to use correct S3 bucket

921c51b7818cc9e737b85ea02d08cfceb28eee5d authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #405 from openaddresses/migurski/fix-multipart-encoding

Multipart upload must use raw bytes

b9584cc8657c1523b6a435645f669e8890da7d41 authored about 8 years ago by migurski <[email protected]>
Ensured that multipart upload uses raw bytes

286cec52980e85e0b03f4473edc3eeddff27a639 authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.0.6 with typo fix

7d1fde719856a611dc596eea0b62449b46581bdf authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.0.5 with fixed locale and S3 bucket config

165ec3b79080d29837f753d890c5c7cb433b59a1 authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #403 from openaddresses/migurski/fix-unicode-surrogates

Fixed system encoding to unicode

981062fcbc4c2c9a3c9baa2da162c279ac977b03 authored about 8 years ago by migurski <[email protected]>
Cleaned up some remaining comments

e36d90c6fafd5cdea77d2c5ebfd527155128b40f authored about 8 years ago by Michal Migurski <[email protected]>
Resetting LC_ALL to C.UTF-8 most places

618960559c6a963ae14ef3e69b81ea7cda7eb5fc authored about 8 years ago by Michal Migurski <[email protected]>
Setting LC_ALL for webhooks

28dec77014c2e0ef990b50bb881a4d26988c17ca authored about 8 years ago by Michal Migurski <[email protected]>
Setting LC_ALL for workers

Based on http://stackoverflow.com/questions/20936384/change-python-filesystem-encoding

f1391ea1f9be3323c5a3fbbd4713710fd02bc300 authored about 8 years ago by Michal Migurski <[email protected]>
Checking on sys.getfilesystemencoding()

61ff9b3b0d8a1a7e7424b235f580f45832a034e5 authored about 8 years ago by Michal Migurski <[email protected]>
oops

044de9da7b8dc65425e9df3841ba657c5a164a43 authored about 8 years ago by Michal Migurski <[email protected]>
Removed encoding from process-one args; reverted 20dca7bd762

83d604126115840566d779e0d5c229ee3c000681 authored about 8 years ago by Michal Migurski <[email protected]>
Added more logging of process data

efbf48aec1e2513f9c8e6dd1d2adf60a1d723f10 authored about 8 years ago by Michal Migurski <[email protected]>
Added more logging of process data

192d6b732f57157c6fc384dcf7a4fbfc5bfc99e3 authored about 8 years ago by Michal Migurski <[email protected]>
Added logging of process data

b4a591b8f75fa22a6ff9ca0eae0212e4a59e282d authored about 8 years ago by Michal Migurski <[email protected]>
Updated enqueue and collect to use AWS_S3_BUCKET environment variable

91d0539431d753f193f37aff3f0c6223cd545679 authored about 8 years ago by Michal Migurski <[email protected]>
Slightly better place for this transformation

eac1e5bcdf195ec00b0ade144021c3988a1454db authored about 8 years ago by Michal Migurski <[email protected]>
Bumped to 3.0.4 with fixed use of bytes(None) and S3 bucket config

4c4740c3eecf57c97d9ea26c6aa9989de494b78d authored about 8 years ago by Michal Migurski <[email protected]>
Merge pull request #401 from openaddresses/migurski/source-data-bytes

Fixed some behaviors with missing / old data

45bc3672089322d945789679f188ca3160660b52 authored about 8 years ago by migurski <[email protected]>
fixed NoneType iterable problem

bytes(None) behavior changed in Python 3.x to an exception

34b9172073c8748c9cd9b6902956459bc3e816d2 authored about 8 years ago by Michal Migurski <[email protected]>
Replicated NoneType iterable problem

0fe6829b05ec1b1a4ede7f00313cce48c8e9cde0 authored about 8 years ago by Michal Migurski <[email protected]>
Fixed a few tests

20dca7bd762bf80241ed95d2f801de5bed8a28d2 authored about 8 years ago by Michal Migurski <[email protected]>
Trying to further encode work filename to UTF8

a4736982f13de47297e5022e7571a6c58a01a5bb authored about 8 years ago by Michal Migurski <[email protected]>