github.com/openvenues/libpostal commits | Ecosyste.ms: OpenCollective

[docs][ci skip] Adding parser label definitions to the README

a2b84a01771564386b45dc7f542a1babfbfaaa85 authored about 8 years ago

[openaddresses] add OSM boundaries for Milwaukee county as many of the cities appear to be IDs

83e38d9a8c483a0dde80887cab11e6bed9cfcd21 authored about 8 years ago

[openaddresses] removing pre_release_downloads as they're all in master now, adding city_replacements for all data sets where OSM boundaries are used

eab629802ce0ae7979efcdae8fc9baef1ec86cc2 authored about 8 years ago

[openaddresses] adding city_replacements for Lake County, FL

69f1137532bd33273ef3028a04c574fa238add5e authored about 8 years ago

[openaddresses] adding correct state for Glarus, Switzerland, ignoring city in Milwaukee if it's purely numeric

c025b0f7d41d6c13427fd09097c991cd31fcb99b authored about 8 years ago

[addresses] stripping unit phrases from streets in OpenAddresses as well, return value wasn't getting used before

d51f9dbb0e8d957a952c602fa006a8d2a3d0b50d authored about 8 years ago

[addresses] stripping unit from street using the libpostal dictionaries in all the address data sets. Happens surprisingly often in OpenStreetMap as well as OpenAddresses

cfdef1788c318bcf2ceb4c1ed5bd37c3dd692925 authored about 8 years ago

[openaddresses] adding Swiss cantons of Grigioni/Graubünden, Glarus, Uri, and Schwyz

3fbd4426b748abc3c153349b1f259cdcd7cc93ab authored about 8 years ago

[openaddresses] adding Cambell and Pendleton County KY and San Benito County, CA

9c14d47f24157aeee94653066d0225cf98786c32 authored about 8 years ago

Merge pull request #152 from rinigus/master_rpc_malloc

changes required for cross-compilation of ARM target

2b3a6f663e9178ad0e2d5df8b443a1be82a081c7 authored about 8 years ago

[fix] unidata file

321f2034d22258bcda34dda57f18ba87d22c8f0b authored about 8 years ago

[fix] also fix german-ascii transliteration on uppercase U with umlaut

7a31802a045ebcb61debb9a35f7f88ab3805cd93 authored about 8 years ago

[transliteration] making the custom rules in transliteration less repetitious and accessible from elsewhere, removing string names for common transliterators and using constants

25723fcea2b8b9c7e83d592ac29e3ab446cef1f1 authored about 8 years ago

[openaddresses] add Canton of Solothurn, Switzerland

3fcaae3dbc0a7cb5cd448f1c2abb1e33dff3c7c3 authored about 8 years ago

[openaddresses] adding Schaffhausen, also adding language=de for the last few cantons

4182123fa6aea39d8191764c3248c8e99853f216 authored about 8 years ago

[openaddresses] add Basel-Stadt, Switzerland

72e6bf043b197c1e14bc5cd72d78c49ade3ce5eb authored about 8 years ago

[openaddresses] add Boyd County, KY

3d16c20d249e2f48ac7ac35d2b6fd764abc074a7 authored about 8 years ago

drop AC_FUNC_MALLOC and _REALLOC and check for them as regular functions; add extra cflags for scanner

26aeb0ebec546899168d98f9fe0b25de2bc7a8c5 authored about 8 years ago

[openaddresses] add Canton of Basel-Landschaft, Switzerland

c5cca4c82fddfd78154c484d7a917671b24b2c6f authored about 8 years ago

[openaddresses] adding Jamaica countrywide to OpenAddresses config

3e7042597ecd7ce47476115f91bd68dfc40656f2 authored about 8 years ago

[formatting] moving postcode to the beginning of the address only in countries using the continental European conventions. Creates more ambiguity than is worthwhile in the US, etc. when, say, house_number is removed from a training example and the postcode is inserted first (could very easily be a house_number)

bcd61ffbe8ac2e80207e347173f945af55239710 authored about 8 years ago

[fix] address configs for Greek/Hebrew

38e147d21063ff7621b4fa50eb27d091fbb76ec1 authored about 8 years ago

[addresses] adding Calle to purely numeric Spanish street names in OSM as well

de2dffa3152eb6a78c456e9d7d10090fd4292ee3 authored about 8 years ago

[transliteration] regenerated transliteration_scripts_data.c

ccd555d02008483f202221a6d7d5c9c73698242f authored about 8 years ago

[transliteration] adding german-ascii transliteration to Estonian to handle umlauts (ä => ae, etc.)

600b40d2f6c08916bb80127e4a4074d7d8c88499 authored about 8 years ago

[osm] add wikipedia:* to rail station exception

b2b7f6f15543c61837ef4bc23d857cfdb22452d3 authored about 8 years ago

[openaddresses] adding Rio de Janeiro, Stockholm, and Liechtenstein. Adding higher CLDR country probability for smaller countries

a99a1e759ef80e194ae5d5ee64192a1080b5b577 authored about 8 years ago

[strings] adding utf8_is_whitespace to the header so it can be referenced from multiple files

77035fbdbd3df689f7514e2f2d620d3f0484ccdb authored about 8 years ago

[normalize] add NORMALIZE_STRING_SIMPLE_LATIN_ASCII option to pynormalize

400ea589efa1e3329f7e28d541b70374e57982e5 authored about 8 years ago

[logging] converting most of the steps in building the transliteration table to use debug logging

182976214c1a5355ea38564a59f0c07b5861029f authored about 8 years ago

[transliteration] constant for the html-escape transliterator

d8d38407006e3ae0dcbfa8212c0b1b99b988667c authored about 8 years ago

[strings] fix lowercasing in string_utils.c

4ad3a52fe1cb2c67b6d0716c2d7829f6234f86f2 authored about 8 years ago

[normalize] use the new utf8proc lowercasing (as opposed to case folding), free copies since none of the string functions operate in-place any more, add minimal HTML escaping transliterator even to ASCII text

a78937f26553cc5dbb5006d9d1158af8602e2681 authored about 8 years ago

[strings] reverting to utf8proc v1.3.1, as 2.0 and above can chop off certain sequences

5c56a44faa973c0ccbb42e87fab43c987990b39d authored about 8 years ago

[dictionaries] regenerating address_expansion_data.c from upstream changes

fe88630f7802173953add48997fd3258d69ea50f authored about 8 years ago

Merge remote-tracking branch 'origin/master' into parser-data

101bbcc02d97b4d539e75af0d0841eccb50adbdc authored about 8 years ago

[auto][ci skip] Adding data files from Travis build #188

d61e90a33d5d06882b7fd5d1abfa4da8cf065c76 authored about 8 years ago

Merge pull request #149 from iestynpryce/master

Enhanced the Welsh (cy) language dictionaries.

6048d6a71edb09f5774ca4a17435cce1933a6c44 authored about 8 years ago

[transliteration] add decompose option when stripping accents

0b5cc96654ae5acbb53fb3f92a46b48b405a5123 authored about 8 years ago

[fix] new string tree iterator, don't decrement permutations on rollovers

7d6c85aeeca8900c060ef2f84306b055d4c56ce1 authored about 8 years ago

[fix] moving enum

1780c5e053d8164fe6d215c9c32d6c5b59b247e2 authored about 8 years ago

Enhanced the Welsh (cy) language dictionaries.

d8ee43156eeddfc5625048df58e51b90d7b47230 authored about 8 years ago

[strings] fixing and simplifying string tree iterator. This version is inspired by Python's itertools.product (itertoolsmodule.c has so many goodies)

475aa3dbfa19bf053494807f9c52f9abf22d2a32 authored about 8 years ago

[strings] header changes for new utf8 lower/upper functions

261ec3888a340e3b81c99f57b75dfbb9e56221cc authored about 8 years ago

[strings] making string_tree_iterator_done more meaningful (returns true if the iterator has no paths left to traverse)

58b063b63285d0842dcc00ffe44cc1866b71120b authored about 8 years ago

[strings] adding latest utf8proc, new functions for utf8_lower (instead of case folding) and utf8_upper, and a utf8_is_whitespace that takes things like tabs into account

89780003207550d22dcdc736bfb87e85d5f7e491 authored about 8 years ago

[parser/cli] adding .print_features option in address_parser client for debugging

db16e656ca2605592995f1b0666c93e5c443c428 authored about 8 years ago

[phrases] fix case in trie search when searching for tokens in a string tail. If we're on the last token in a sequenence and the token matches the tail, check that the tail is complete, and if so return the match before exiting the loop. Affects multiword phrases that tend to appear toward the end of a sequence (long country names like "United States of America", etc.)

bdb51a244e72099b7b96329b4e311bda4490d6ee authored about 8 years ago

[places] adding is_in property to the set of tags for the places index. This may allow us to make more granular exceptions for node-based places that are actually suburbs but classified as {hamlet, village, locality, town}, etc. if the is_in contains a city that's also a boundary or nearby point

2d077699e674e06d7dd11828ef9e8dab93673712 authored about 8 years ago

[boundaries] mapping place=hamlet to suburb for all of Malaysia. place=village becomes suburb as well in the urban core

cad57b94b25ad446eab7b947a64a9bb66bd74ec8 authored about 8 years ago

[addresses] only add village as city component if no city can be found in the area

21a2a7419a1815b500c7ff41361ba828c6e778df authored about 8 years ago

[openaddresses] adding Joinville, Brasil and adding OSM boundaries for Brasilian address data sets

8080e16791cc2be416207f89ccd39686a3aca5dd authored about 8 years ago

[dictionaries] removing Belarusian place_names.txt

0b6947840c1b08f52978867a80c40ead44d9be4f authored about 8 years ago

[build] Makefile changes for new parser feature extraction

05732f671847cf25ba4d7f2f5ede0c2cf653a75d authored about 8 years ago

[api] remove geodb from libpostal.c

091167ed3c5053700719d60c01a3e409c08f5f62 authored about 8 years ago

[parser] first pass at new parser feature extraction

- removing geodb phrases
- use Latin-ASCII-simple transliteration (no umlauts, etc.)
- no digit ...

acd953ce51707316f6bd62657074476f0f368306 authored about 8 years ago

[parser] remove geodb from address_parser_test, sort confusion matrix

e62101b8bfbd12c088859ce9b7cb8aae391b3157 authored about 8 years ago

[parser] remove geodb and fix small memory leak in address_parser_train

174529e8d09353ebe27957d22bbad5e4bf29aedf authored about 8 years ago

[merge] merging in master

bde5fdfaad0ad306183f1bea3af709b057b2d935 authored about 8 years ago

Merge remote-tracking branch 'origin/master' into parser-data

646d96e13e49979c597ff902602dd328448d03a4 authored about 8 years ago

[openaddresses] adding SEMCOG counties, MI

a26a01ece313987fe8e5646849ba440e7c1f0d96 authored about 8 years ago

[places] additional form for West Indies

22b4a215f4ec239ca694ca866dd5b0f3d2d7cbde authored about 8 years ago

[fix] var name

f58ebbdf7fb68c3236e9e30e22471edf483570b6 authored about 8 years ago

[fix] genitive case for Russian/Ukrainian toponyms, not locative (#125)

7ee44a584b16893531f5696a2179812d7fd7a2fb authored about 8 years ago

[addresses] making the город/г. prefix apply to the Russian language rather than the country

e6e4b28e434f4e717ee2d0b5e79b6f11d06f0bba authored about 8 years ago

[fix] default None

f995fdf9d2ffc04b215e54a5b1039f61cdf1f07f authored about 8 years ago

[openaddresses] adding locative names in OpenAddresses as well, which contains some Ukraine data sets

3dc6a69bf55c378e7c8c4d16df3b0c80b2e01d70 authored about 8 years ago

[fix] moving checks inside the add_locatives function, fixing float cast

91013fe296307650de743f1aa506d21330525cca authored about 8 years ago

[addresses] adding pymorphy2 for converting Russian and Ukrainian place names (sticking with state and staet_district for the moment) to the locative case as mentioned in #125

6f009fb8a68566ca9c3bdff87bc1c785af5803af authored about 8 years ago

[boundaries] actually, the urban okrugs/districts seem to function more like neighborhoods in St Petersburg and Moscow, calling the raions city_district and the okrugs suburb

e91907a21b32aad3b3bea89552dc0ba37f1aeca3 authored about 8 years ago

[auto][ci skip] Adding data files from Travis build #186

6c35eb9e65f5cef8b7c8826881cc625f88084209 authored about 8 years ago

[merge] merging in master

a86d6d552803b3adf49c8937551cb1f8c463b522 authored about 8 years ago

Merge pull request #147 from Komzpa/patch-1

Remove place names that are not place names (RU, BE)

47c3b0091bec2332bb406c6e6ee7a65c322303dd authored about 8 years ago

[dictionaries] new Ukrainian place names dictionary from http://wiki.openstreetmap.org/wiki/Nominatim/Special_Phrases/UK

e23951a90fbabb3bf006121bc89dfdd21db43046 authored about 8 years ago

[dictionaries] new Russian place names dictionary from http://wiki.openstreetmap.org/wiki/Nominatim/Special_Phrases/RU

0bcaf816c4ce0dc5a126d58ea73b880c1d2fd7fd authored about 8 years ago

[fix] add global_overrides_last=True for federal cities in Russia

561d195be4ade40df6655cd8ec0a6e2d33d6b23a authored about 8 years ago

[boundaries] adding Moscow and St Petersburg as cities despite technically having "state" boundaries

4ce8f414ef06f97105922524c9c943bbea4bf734 authored about 8 years ago

[fix] /exceptions/overrides/

12c7bed27573f3b169df3b50664d9a9d62af1eb7 authored about 8 years ago

[fix] /containing/contained_by/

1afe97b5088247d0886378410620781f7a166017 authored about 8 years ago

[boundaries] admin_level=8 is city_district in Moscow and St Petersburg

66eda96b75f4ab540903949ff637360b8844e94f authored about 8 years ago

[formatting] adding non-zero invert probabilities to all the former Soviet states. Other template insertions can still apply afterward for #125

4344c5fdf37f508d90f68331eec22fdfa665a2fb authored about 8 years ago

[formatting] adding the ability to invert the address template (line by line, preserving order within each line) with certain probabilities

25e966411dff10ee42d7bbe7e82adf6fecee6987 authored about 8 years ago

[names/ru] adding г. (город) prefix to Russian city names 50% of the time in various forms per #125

1c17f1f2e2ffd61c2b778398ea9d145c606b2754 authored about 8 years ago

[names] adding configurable prefix/suffix additions for boundary names

165056ccd80caf36f5faf3dcfbc21c44475a9bf6 authored about 8 years ago

[auto][ci skip] Adding data files from Travis build #184

dc528affd5014dc71ef463fc2d4a2bbdd02eef3e authored about 8 years ago

Merge pull request #148 from Komzpa/patch-2

Ukrainian place names that are actually whatever

2a42ea016b3f22bce34595b095a6561f5aa64d6f authored about 8 years ago

Ukrainian place names that are actually whatever

e514778645cbc18be0ffb2a9b1063fb72e1adc43 authored about 8 years ago

Remove Russian place names that are actually street names

dba8c28e6acf98f52235fa36f0012dff5ea1f757 authored about 8 years ago

Remove Belarusian place names that are not place names

These all are parts of streets.

38a6618e403dcbf7640d637232f66904c5c06f84 authored about 8 years ago

[addresses] move country-specific cleanups to before reverse geocoding as those deal with the user-specified components

80a9c1b3080a3e4e87cb92c69263ac62681cb9e9 authored about 8 years ago

[names] adding regional council and regional municipality to suffixes

d9c28ec16028ea43601debfa6b789dce37152e88 authored about 8 years ago

[osm/places] adding option to only format place tags for city and smaller admins, using for polygons as larger polys should be included elsewhere anyway

6163dbae395245b1592d1d496b537fd08064e50e authored about 8 years ago

[fix] only applying separator tag to commas

6eee6896852989352e77fc259ffbe79240888ea7 authored about 8 years ago

[names] one more for South Africa: District Municipality

6192ac985aabe3e7cc70bf2f7cbd30d62751ad76 authored about 8 years ago

[names] same with Metropolitan Municipality

2cdf30a79ec8393fee8900eaa2a70142da74ee9e authored about 8 years ago

[names] add Local Municipality to English ignorable suffixes (seen in South Africa)

2e3c1dee67ebcfdc3c149a729a4b9bb1f0b63afb authored about 8 years ago

[fix] combined components

76d8fc1d37a6651e280fe2f4203784d28452b544 authored about 8 years ago

[fix] remove reference to ftfy in the formatter

c3bf63bc189bd1cd1eb402400d41fbaf6263214e authored about 8 years ago

[osm] adding the excellent ftfy (https://github.com/LuminosoInsight/python-ftfy) to fix Mojibake, etc. in address components

8abbb273b2da0fb0811dffa32da06afe50745845 authored about 8 years ago

[formatting] giving single hyphens the separator tag

7ec368542b48561b692ce8c00729718148e6c6d2 authored about 8 years ago