Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/censusreporter/census-postgres

PostgreSQL schema and import scripts for recent US Census data
https://github.com/censusreporter/census-postgres

Table ID column name needs to be configurable

9f7bd889504e6723409ac3e7e17ac40b96b76a16 authored over 10 years ago by Ian Dees <[email protected]>
Add ACS 2013 1-yr config

e759c061f5c04ffbe5bfcefbf9791393017ec193 authored over 10 years ago by Ian Dees <[email protected]>
Add generated acs2012 5year data.

87701ab86b409c79bae0d5220320faf04290593a authored about 11 years ago by Ian Dees <[email protected]>
Add ACS 2012 3yr postgres stuff.

5b18b44319b034fb17cf6c3de3e4547d402bdc89 authored about 11 years ago by Ian Dees <[email protected]>
Add section for 2012 3yr.

6e78ecafcd694ba21dd97c08d9cd809dd23825cd authored about 11 years ago by Ian Dees <[email protected]>
Manually remove C07202, C07203, and C05001 from insertion step.

a5be381bcc14361021d223d5f27830bd7f22eede authored over 11 years ago by Ian Dees <[email protected]>
Manually remove C07202 and C07203 from sequence 175 of 2009 1yr.

ea51c434c98d08d426f4e155c5711daf8f7c78c9 authored over 11 years ago by Ian Dees <[email protected]>
Manually remove C05001 from sequence 169 because it doesn't exist in the data.

ef49eb7c156de3e140c37d8b9519ac9b19106b26 authored over 11 years ago by Ian Dees <[email protected]>
Manually fix the 2007 release geoheaders.

a9452ede1bd5fa2f2a599ff306d55ab8896e7473 authored over 11 years ago by Ian Dees <[email protected]>
Manually fix 2007 1yr's extra column in sequence 141.

3af38e49e89c5885541b3c4bd843f6002bcfde81 authored over 11 years ago by Ian Dees <[email protected]>
Add a script that fixes broken 2007 CSV data.

d91da4fd54ea2cc6d3e0d1b4c4bc8d16dfecb366 authored over 11 years ago by Ian Dees <[email protected]>
Manually add blank rows to the 2007 1yr import tables.

332d6b7817c05c85d855139aba32aae90e1a15e8 authored over 11 years ago by Ian Dees <[email protected]>
Manually fix 2008 3yr typo.

097c2cce65ba9738ecab3abcac41a316aa76f3b7 authored over 11 years ago by Ian Dees <[email protected]>
Manually fixing B25010 in 2008_3yr.

cf01375dbb7a45925c15a210e43f2395a38a0a3d authored over 11 years ago by Ian Dees <[email protected]>
Manually fix the geoheader columns since 2008 is slightly different.

3391276a1edcf03ced5845cdb22f80992dfdb1c9 authored over 11 years ago by Ian Dees <[email protected]>
Manually fix the incorrectly-labeled B25010 table columns.

226184bb43ac4400648e5f36f166bd1e74751d04 authored over 11 years ago by Ian Dees <[email protected]>
Manually fix the incorrectly-labeled B23020 table columns.

e3660dc47e33c7ac8225e9e346c26dfef2f5fab4 authored over 11 years ago by Ian Dees <[email protected]>
Don't include the duplicate geoheader files.

03a69bfa6d217baf83663475657d1d22b7acad08 authored over 11 years ago by Ian Dees <[email protected]>
Widening the geoid column.

d2b4ae8ae519b373aa3d0a27206f04e59466ce86 authored over 11 years ago by Ian Dees <[email protected]>
Give the sequence tables a wider geoid column.

70a6faa20cca6250445863a9b6073fdab33f7e25 authored over 11 years ago by Ian Dees <[email protected]>
Correct spelling mistake.

23a251a873706550651b89d98b42b05bf7e8bdbe authored over 11 years ago by Ian Dees <[email protected]>
Remove duplicate view creates based on table_id.

97b5088addef935969c8dd947bd82db591482157 authored over 11 years ago by Ian Dees <[email protected]>
Getting the current sqn is a bit too cumbersome here.

1b0c795b023ce395cb460863c297db29a7f5051d authored over 11 years ago by Ian Dees <[email protected]>
Don't sort in-place.

2db09b2ed6a0441590714a69d8f974f7b801d40b authored over 11 years ago by Ian Dees <[email protected]>
Fix typo

ce5278d2dab4ad22f78759526327ba8f1f009a32 authored over 11 years ago by Ian Dees <[email protected]>
Keep track of the tables we've written out so that we don't let dupes through.

9157140a29db018be47dc4c4b82cffb0fd3f8ab1 authored over 11 years ago by Ian Dees <[email protected]>
Rerun the sql to reflect the joining changes.

e59c156a495b683c82e0019a34ebd91c122c175a authored over 11 years ago by Ian Dees <[email protected]>
Keep sequences in order to not cause unnecessary git diffs.

2ee9c8f1d06d28f99021e37ac0240ed5d77e1539 authored over 11 years ago by Ian Dees <[email protected]>
Sort the geoheader files list so git doesn't barf on the diff.

698b2c4d659470d163e5c7ed46de1727eee11e46 authored over 11 years ago by Ian Dees <[email protected]>
Join across sequences correctly.

456a0703f3e364086e3cac1262d51b4c1847b1fc authored over 11 years ago by Ian Dees <[email protected]>
Join across multiple sequences for extra-wide tables.

f21459618dbad81c8ecf38d65c6f4f10ba568405 authored over 11 years ago by Ian Dees <[email protected]>
The join should be on geoid here, not stusab,logrecno.

51874cf2c9e03f525cefe1adf6fa13de1a8226cd authored over 11 years ago by Ian Dees <[email protected]>
Correct my join syntax.

8edc1b0fc13fdce8d52cae34c6ea256b20211980 authored over 11 years ago by Ian Dees <[email protected]>
Fix my join syntax.

7a19069e20b58b82e19b659d57c3a4ee39cba41d authored over 11 years ago by Ian Dees <[email protected]>
Adding generated 2012 1yr sql.

34f51bddefc14f0745f2055dc349cb1500af8dc8 authored over 11 years ago by Ian Dees <[email protected]>
Spaces seem to be nulls in the 2012 release.

b636098af41d23c2b9dffcb579335199bdee148b authored over 11 years ago by Ian Dees <[email protected]>
Adding 2012 to the config for building sql files and fixing ordering.

7abd92c3db1cccc29100e5147a7627ddab2174cb authored over 11 years ago by Ian Dees <[email protected]>
Add robust parsing for the sql build python.

9ac9cbb51320071ceaa9c41b7e61a505ce2ead1b authored over 11 years ago by Ian Dees <[email protected]>
Add a drop for the tmp_geoheader.

3a39b41393cdbbb49f77fcee8fe3dc933e82465a authored over 11 years ago by Ian Dees <[email protected]>
Make the insert into real seq tables more explicit.

60861492917533ba89aeba4f3e973443a82b8821 authored over 11 years ago by Ian Dees <[email protected]>
Fix sequence import script comma issue.

880d12699a60cabcb6fcba11f3de0bce1ad4f44d authored over 11 years ago by Ian Dees <[email protected]>
Update the precomputed files after rebuilding them.

eb0621330c5f292bec7d9ed69915d646f8121160 authored over 11 years ago by Ian Dees <[email protected]>
Pass the release through everywhere.

e747371e1d45f02aa1befb2877ec92ede309db2e authored over 11 years ago by Ian Dees <[email protected]>
Trying to get geoid flowing through the import process.

9419fc4b1b0b12173171f7e6638647f12ba46cab authored over 11 years ago by Ian Dees <[email protected]>
Update SCHEMA.md

db17fdd75302eafd4ae155559f84d5dd27d1c0f6 authored over 11 years ago by Ian Dees <[email protected]>
Add some documentation about the schema.

6b0fb6d7308416e5b0de8f5a904a04e5438cc42b authored over 11 years ago by Ian Dees <[email protected]>
Clean up the geoheader import scripts a bit.

8a533ee718c89c18d811f5c3a8c6f5c427ee7e06 authored over 11 years ago by Ian Dees <[email protected]>
Make sure the paths for the 2007 geoheader import are correct.

3b6420871ae3a6a2026cf1c1ee9aefbd986e515c authored over 11 years ago by Ian Dees <[email protected]>
Make sure the geoheader COPYs specify the latin1 encoding.

7ece59fed0db33babf6b8a1b589d398d9323ed23 authored over 11 years ago by Ian Dees <[email protected]>
Add 2007 3 yr sql scripts.

524cf7cf65c8705b21a900270493115a75f59870 authored over 11 years ago by Ian Dees <[email protected]>
Remove the extra space at the beginning of the sequence number column name.

e6cd57cec629dafc3a2a22687c97fe2767d0fcdc authored over 11 years ago by Ian Dees <[email protected]>
Handle unicode/utf8 problems

b0fc2de8ae81792aa89b1c2ca265714154fc8a6a authored over 11 years ago by Ian Dees <[email protected]>
Add a xls to csv conversion script.

38510f3d450b35eb668e591639a573f33ddc749c authored over 11 years ago by Ian Dees <[email protected]>
Add 2007 1 yr sql scripts.

0bba2258e34b0e1eddc3ab67ed13763c9d84c85a authored over 11 years ago by Ian Dees <[email protected]>
Add 2007 configs for the build_sql_files command.

9261dc355ed42ed553f3a492b7cfbc98a85bc6d0 authored over 11 years ago by Ian Dees <[email protected]>
Add 2007 1yr lookup table CSV.

0ca53aa4f668ef3d101bab5bc3a8b08bbddc8b08 authored over 11 years ago by Ian Dees <[email protected]>
Add 2008 3 yr sql.

569c85149098309c91909d3f8a24700b69c15a1a authored over 11 years ago by Ian Dees <[email protected]>
Fix table id column name for 3yr lookup table.

c5ba10233fd4b7cb1ea21143a003d02f3cdfc7aa authored over 11 years ago by Ian Dees <[email protected]>
Rename the 2008 lookup CSVs to use .txt extension for consistency.

2948c35004958d5350f03beadbcacf6c88bb6a74 authored over 11 years ago by Ian Dees <[email protected]>
Add 2008 1 year SQL.

6f916e5f374009f0c810170ae4886b1d913bcd4d authored over 11 years ago by Ian Dees <[email protected]>
The 2008 files have .7 markers instead of .5.

f8d96b714b49b0a1d9c1fe9cc8338aa1cb3ed407 authored over 11 years ago by Ian Dees <[email protected]>
Add 2008 custom config stuff.

06deea26763c846d4752d749fe8d20e5ecf998c5 authored over 11 years ago by Ian Dees <[email protected]>
Add the CSV versions of the sqn lookup for 2008.

69910ccce5ca0d2e9f872cb7165f647bb974244c authored over 11 years ago by Ian Dees <[email protected]>
Fixing column names for 2009 5yr.

7fabd6e458998195089f6199af95165668a6b6a4 authored over 11 years ago by Ian Dees <[email protected]>
Fixing column names for 2009 1yr.

ef9bfbd41b43d59a7a42dd5cf8f11cc47b140d14 authored over 11 years ago by Ian Dees <[email protected]>
Fixing column names for 2009 3yr.

7f94e4cd7c008ad35cfa5ff0a26f0d2490baf9f3 authored over 11 years ago by Ian Dees <[email protected]>
Fixing column names for 2010 3yr.

92c98e9ba73e70b18ca2199720f57dc10dab72cd authored over 11 years ago by Ian Dees <[email protected]>
Fixing column names for 2010 1yr.

f9b8926b89c256bb9c4cb6dde9c332fec8f8ab4a authored over 11 years ago by Ian Dees <[email protected]>
Fixing column names for 2011 1yr.

48c3bc1df1ba6e30081b19228c29521d6592aba2 authored over 11 years ago by Ian Dees <[email protected]>
Fixing column names for 2011 3yr.

f8c337fae0817ce79b005c2faaee46927dbd19ca authored over 11 years ago by Ian Dees <[email protected]>
Add .gitignore

0a4bab330deec7d28854a448ad3e93af1c53c2a0 authored over 11 years ago by Ian Dees <[email protected]>
Pad with 3 zeroes instead of 4 for the column names.

f3b8810005bdc4d87d24199c7a08e4fc5ac17741 authored over 11 years ago by Ian Dees <[email protected]>
Remove duplicated columns from the generated SQL for 2009 3yr.

f97c46785e67ac9537131e215554839d5e0d7585 authored over 11 years ago by Ian Dees <[email protected]>
Don't reset the line number to zero.

Some tables cross sequence boundaries, so we need to let the line number increment past the sequ...

bf75cf253c667d435fe454b010b5e55d4d685f7b authored over 11 years ago by Ian Dees <[email protected]>
Try to let skipping go back to '1'.

90225fa6b5f58ccf52a75d4949ef74d37665c6ca authored over 11 years ago by Ian Dees <[email protected]>
Try to do a better job of skipping labels.

9b76530d1040d03634a6fb45a0ea323d503b9acb authored over 11 years ago by Ian Dees <[email protected]>
Also mark : as headers when linenumber ends in 5.

f6f761590ab4727ae2ea0d761094555f0e91e1c6 authored over 11 years ago by Ian Dees <[email protected]>
Remove some more duplicate columns.

36a0712b70f9f4b8ef6cdaf4fda9c0c5f0e70b24 authored over 11 years ago by Ian Dees <[email protected]>
There aren't always spaces before the -- labels.

582993bc5b332a7fdb4802a3dfd5c72f1aace75b authored over 11 years ago by Ian Dees <[email protected]>
Remove duplicate columns created from labels.

5a3d8fa9ff3e4d152addea9affb1e7e442a80a46 authored over 11 years ago by Ian Dees <[email protected]>
Skip over labels with -- at the end of the title.

88e0a10e711003380b26d1798bf9242a86ad7ceb authored over 11 years ago by Ian Dees <[email protected]>
Add generated ACS 2009 5yr.

6b485a59a0a043733e7765c75db739d9d68c8f42 authored over 11 years ago by Ian Dees <[email protected]>
Revert "Try to skip over completely blank lines in the mapping file."

This reverts commit 7b9b0abf763690f4f2d70e926e5c0c44d5bfca25.

af97d086cb4e606d13c6f0cd1afc1fd34c1cd761 authored over 11 years ago by Ian Dees <[email protected]>
Try to skip over completely blank lines in the mapping file.

7b9b0abf763690f4f2d70e926e5c0c44d5bfca25 authored over 11 years ago by Ian Dees <[email protected]>
Add generated ACS 2009 3yr.

955c579dd9364fa73cde8857d69124a643309a42 authored over 11 years ago by Ian Dees <[email protected]>
Add generated ACS 2009 1yr.

20d3f215aa8bb25de4b4ea128e31917b492121b0 authored over 11 years ago by Ian Dees <[email protected]>
Adding config stuff for acs2009.

8ee9eb06cf15019aa46f4602ac9f564b5302b61f authored over 11 years ago by Ian Dees <[email protected]>
Remove the schema set lines.

bc982a86dfaa20b31e875049b27f5d7ea591aa44 authored over 11 years ago by Ian Dees <[email protected]>
Add generated 2010 3yr SQL.

fa44d0b609a409a6340399be528eb1d26e9c0cb2 authored over 11 years ago by Ian Dees <[email protected]>
Add generated 2011 3yr SQL.

a01aed28af7bc84cf3486cf675d510bd70f79003 authored over 11 years ago by Ian Dees <[email protected]>
Add generated 2011 1-year ACS scripts.

793002a234315ef4bc53afa64a64c62835e7c5ac authored over 11 years ago by Ian Dees <[email protected]>
2010, not 2011

f24a79f6f975f86775cd26186065d68938680ed1 authored over 11 years ago by Ian Dees <[email protected]>
2011's mapping file has . as a null character too.

d2611c6cfbcedefd371289a85935d3b7ee9fc8bb authored over 11 years ago by Ian Dees <[email protected]>
Allow for year-specific line number column name.

fb19d1e38322f3e67e345af566a5aa9251eb5711 authored over 11 years ago by Ian Dees <[email protected]>
Fix the SELECT on the generated views file.

eecfb277a5c4dbd65e2361ea8abdf6a5872c8b92 authored over 11 years ago by Ian Dees <[email protected]>
Forgot the SELECTs when creating the view.

e8eb76288babe38863112916a8b9833a5dedfed2 authored over 11 years ago by Ian Dees <[email protected]>
Fix the parens on the generated views file.

95fe767abd2235efa6edbb2458d3e2db597c0cc4 authored over 11 years ago by Ian Dees <[email protected]>
Ditch the parens.

869a7dce2a09304ddc8368138882e9f69acc9bd2 authored over 11 years ago by Ian Dees <[email protected]>
Fix the view creation script for 2011 1-year.

3c4c06cbac3e89e7d4e9e9f7de4090d2f7418532 authored over 11 years ago by Ian Dees <[email protected]>
Fix the format args.

47dfee92d342be6637201178b9ab3361de8514d5 authored over 11 years ago by Ian Dees <[email protected]>