Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
github.com/censusreporter/census-api
The home for the API that powers the Census Reporter project.
https://github.com/censusreporter/census-api
2fbaaa1db07cb319f7b4f7b24357002206733b09 authored over 8 years ago by Ian Dees <[email protected]>
48d49dbac8b73e615cef4d3090090ced85506db6 authored over 8 years ago by Ian Dees <[email protected]>
Correct spelling of "spreadsheet" in API.md
8bab5f713d16747d42c8c9fd175e84fcbdabc9ad authored over 8 years ago by Ian Dees <[email protected]>Correct spelling of "spreadsheet"
a6f75ca039c565dcf8d0500d6643ce3fc84e833b authored over 8 years ago by Clifton McIntosh <[email protected]>5e4482ddeed133c232b74d320226a1ed745110da authored over 8 years ago by Joe Germuska <[email protected]>
b0aca3efc26050e1349933b940bad285e7b300f5 authored over 8 years ago by Joe Germuska <[email protected]>
70b6eaaaffc0e0bae1040ca98396b1152b193436 authored over 8 years ago by Tushar Chandra <[email protected]>
011eb571c34d38f830ed653326cfd9f1760fa795 authored over 8 years ago by Tushar Chandra <[email protected]>
cc5ef6117308ab2eccb21341c4b2095a66cac6a6 authored over 8 years ago by Joe Germuska <[email protected]>
Add sumlevels 252 and 254 to SUMLEV_NAMES
4f2d40eb47ec1363567cf5ac9a1b9c04573143ab authored over 8 years ago by Joe Germuska <[email protected]>Change certain error codes from 400 to 404
21e95dc9ebc628f981681d7ab38378b2edd51ef6 authored over 8 years ago by Joe Germuska <[email protected]>
Add sumlevels 252 and 254 to the list of valid sumlevels. This is
related to censusreporter/cens...
Changed certain error codes from 400 to 404 to better reflect what
is actually happening (i.e., ...
47fada94a1d6a9836a381e2212f924389d8bf09a authored over 8 years ago by Tushar Chandra <[email protected]>
This script now reads the annotations next to each table code (thanks
to the modifications to to...
0693e8b68668c8f05181328b209625b21052bb3b authored over 8 years ago by Tushar Chandra <[email protected]>
Modify topic_scraper.py to detect annotations to table codes. This
searches the characters after...
9a33ab71c59d6bbc26b8ca262a815d32bb93cfcd authored over 8 years ago by Joe Germuska <[email protected]>
82f75590f2af4887bdac0b9138641ccdf1d5b6c8 authored over 8 years ago by Joe Germuska <[email protected]>
The HTMLStripper class removes HTML tags from a page, leaving only
the contents of those tags (i...
table_tester scrapes all topic pages and checks every table referenced
on those pages for existe...
Table scraping now happens when the TopicPageParser is initialized,
using a regex search for tab...
Add a note that if the search_metadata table is rebuilt, the topic
scraper must be run again as ...
109d5ecb42402d4a43296c42dd975b534b61b683 authored over 8 years ago by Tushar Chandra <[email protected]>
Group score computation logic into one block, rather than having
three separate blocks for each ...
e00c95fb5d1411b51b44a58f675e8172ee93bd6d authored over 8 years ago by Tushar Chandra <[email protected]>
The profile URLs returned only use the geoid now, rather than the
geoid and display name earlier...
0b441e3776d5465fbe2f90be6a911338b0bd4bf5 authored over 8 years ago by Tushar Chandra <[email protected]>
44f721970467cc29d28d0bc3043b0d12d4504ab6 authored over 8 years ago by Tushar Chandra <[email protected]>
a3c42fbb9b182ea6678322a42dbf8985b2f4f25c authored over 8 years ago by Tushar Chandra <[email protected]>
Refactor compute_profile_score() and compute_table_score() into
one function, compute_score(). T...
Refactor table_search(), profile_search(), and topic_search() into
one function to make more sen...
The full text search endpoint now returns topics as well as profiles
and tables. There is work t...
topic_scraper.py now adds the URL to search_metadata. It was necessary
to include this in the da...
c3fcedc62d0035b1b45d8f264c48c9b27a67d837 authored over 8 years ago by Tushar Chandra <[email protected]>
Removed query_script.py, as there have been many changes to the API
and to the database that wer...
The glossary page on Census Reporter is now scraped as well, and
it is indexed as a topic page a...
The functions created before now update search_metadata with topic
page entries. Data for the to...
Add functions to remove old topics from search_metadata (it should
be cleaned every time the scr...
24efe3b9d0228d9a8ad762dac472239855bac4db authored over 8 years ago by Tushar Chandra <[email protected]>
Minor bugfixes; a couple of words were getting concatenated together,
which I took care of. The ...
TopicPageParser now scrapes individual topics pages, and it gets both
the relevant text on the p...
Topic scraper builds a list of topic pages and their URLs. The next
step is to scrape each page.
For local testing purposes, the app.S3 connection initialization block
is now inside a try excep...
884c7cc28108c40e711c55ac66cb15be29854586 authored over 8 years ago by Tushar Chandra <[email protected]>
Replacing apostrophes with spaces in the query string, which is
what postgres did when building ...
2c855c57011eee935f2c8aeed11f4139d9150189 authored over 8 years ago by Joon Park <[email protected]>
8f7a912f86662c33e32fdc47b719098e4e3b71da authored over 8 years ago by Joon Park <[email protected]>
e6a68c65506e1658a90a5340e77c2b59c6530c8b authored over 8 years ago by Joe Germuska <[email protected]>
d796bab637ce1efa80281e2e9c3714910f5e0d6c authored over 8 years ago by Tushar Chandra <[email protected]>
Sumlevel exclusion vetos were written as numbers when they should have
been strings.
5538438202cba19705dfa67bf84a512da793ed16 authored over 8 years ago by Tushar Chandra <[email protected]>
a72ffbb4524fa6f606d43389856f931e62aef4d5 authored over 8 years ago by Tushar Chandra <[email protected]>
1de8766c8bbe14553683852d0c512955630ffa2d authored over 8 years ago by Tushar Chandra <[email protected]>
Remove full text table search and profile search functions that are
entirely obsolete after the ...
d76ef0895cd1f639616f8827fa5b2871e14e3054 authored over 8 years ago by Tushar Chandra <[email protected]>
The 'topics' field is now a list rather than a string, to stay
faithful to the original API format.
b30da33b49d3680715bbc60c8f30cdeed0e066e6 authored over 8 years ago by Tushar Chandra <[email protected]>
Removed pagination functionality added in the last commit. Removed
the PositiveInteger validatio...
Added another qwarg, "page", to api.py, which allows for one to obtain
more results. Different v...
Added functionality to search for only profiles or only tables (or,
by default, both). This was ...
This support is implemented on the database end. Refer to
abbreviations.md for instructions on h...
When there are multiple tables represented by a tabulation, we
need to choose one to link to tha...
The Python scripts now search tabulations, reflecting the changes to
the metadata search table. ...
The search_metadata table will now include tabulations, not tables.
This is done in an effort to...
0b01cf5fd222d6afb135d390b5aec5f00e95c553 authored over 8 years ago by Tushar Chandra <[email protected]>
Eliminated removal of stopwords on profiles, so that names such as
"Columbus, IN" did not get pa...
355059735cb1c19d8227edac2006ba74137b95d8 authored over 8 years ago by Tushar Chandra <[email protected]>
b36dd98d3958c7e004aa25cf13b23c903942cebd authored over 8 years ago by Tushar Chandra <[email protected]>
c983fb6c5962612199f4e9f1b8d4bfba2eda4a40 authored over 8 years ago by Joon Park <[email protected]>
88de0d3d90d98ba3940f6dc743dd127c93f28511 authored over 8 years ago by Tushar Chandra <[email protected]>
27e5a89b5268886e555baafea10cc6b57a6e39de authored over 8 years ago by Tushar Chandra <[email protected]>
ae9f25e2aa43c5a7bca1238c3b9c6b5130663cf6 authored over 8 years ago by Joon Park <[email protected]>
23193cc81592fd0967b41c61cd7c134944870b6c authored over 8 years ago by Joon Park <[email protected]>
api.py now includes a function to search both tables and profiles,
implementing the functionalit...
e0c2c1a24debf1334ed70483f98f53385d8727db authored over 8 years ago by Tushar Chandra <[email protected]>
In addition, modified query_script.py to take into account the
new data shapes from table_ and p...
9554607e4440bc4e0268c20800e0a34074e0da06 authored over 8 years ago by Tushar Chandra <[email protected]>
In addition, modified the table querying script to target the combined
metadata table, simplifyi...
8ab33aa4ac0971a7bd49781fadf052591ef4e651 authored over 8 years ago by Tushar Chandra <[email protected]>
The first change is that profile_query_script.py and table_query_script.py
were refactored to ha...
Also begin commenting score.py script.
19d4f73d6b97b39453645d49ea02e17a9def8323 authored over 8 years ago by Joon Park <[email protected]>
score.py takes the query 'ithaca' and shows the expected search results
alongside their custom c...
Also added minor clarification in full-text guide file and refactored a
few lines in api.py
The metadata_profile_script and metadata_table_script files were
updated with additional documen...
88fb4d4c6800a6adaeb307dbfa394c03fea8d864 authored over 8 years ago by Joon Park <[email protected]>
Add the line "add2virtualenv ." to the install instructions. Otherwise
locally running environme...
For local testing purposes, the app.S3 connection initialization block
is now inside a try excep...
The route is 2.1/geo/search. The query output still needs to be verified
to match the previous v...
c13df9080fba50aa821a98a4e15073ff324ce908 authored over 8 years ago by Joe Germuska <[email protected]>
8ea081f26ce03f14d7b22fa2a89f88e332e715af authored over 8 years ago by Joe Germuska <[email protected]>
The route is under /2.1/geo/search and the create script may be
incomplete in the information it...
387810513e607f0eaf694d6eff5b029e4473d908 authored over 8 years ago by Tushar Chandra <[email protected]>
Added a "alter table" statement to change the owner of
table_search_metadata to census.
/2.1/table/search now functions as a basic route for the full-text
search tabulation data.
4c49bc47dc6ae04a34dfb841f97ea7569fadc264 authored over 8 years ago by Joon Park <[email protected]>
Wrote a script that creates a table, table_search_metadata,
which stores information about the a...
58fbfafdc5bf94c118ff76c288df6fa8ee7b8bef authored over 8 years ago by Joon Park <[email protected]>
The INSTALL.md was also edited to better reflect an OS X pylibmc
install.
658e5df060b80e0a58fe5fe4370250a52a874058 authored over 8 years ago by Joon Park <[email protected]>