github.com/pelias/csv-importer commits | Ecosyste.ms: OpenCollective

Merge pull request #31 from pelias/greenkeeper/fs-extra-8.0.0

Update fs-extra to the latest version 🚀

9d76bacf18c974053de71ec5a8a139aa41caa905 authored over 5 years ago by Julian Simioni <[email protected]>

fix(package): update fs-extra to version 8.0.0

0c143e620515d063d3b0e20593acdde6a9f799bc authored over 5 years ago by greenkeeper[bot] <greenkeeper[bot]@users.noreply.github.com>

Merge pull request #28 from pelias/greenkeeper/pelias-config-4.0.0

fix(package): update pelias-config to version 4.0.0

245822390105824e54fe0933b4c7999854eeeac1 authored over 5 years ago by Julian Simioni <[email protected]>

fix(package): update pelias-config to version 4.0.0

Closes #27

f1d297247678dc85039c3f89e0e141456df4919f authored over 5 years ago by greenkeeper[bot] <greenkeeper[bot]@users.noreply.github.com>

Merge pull request #25 from pelias/greenkeeper/tmp-0.1.0

Update tmp to the latest version 🚀

c474b5eb1940109ad8fcbf37bce4eee5a59cf40a authored over 5 years ago by Julian Simioni <[email protected]>

fix(package): update tmp to version 0.1.0

8dd426a678ee0393ade2c1af29c8ed7801d11dc0 authored over 5 years ago by greenkeeper[bot] <greenkeeper[bot]@users.noreply.github.com>

Merge pull request #24 from pelias/deps

chore(deps): update pelias-wof-admin-lookup npm module

93705f5e4573aac9b12a66c98aa173dda72d7925 authored over 5 years ago by Peter Johnson <[email protected]>

chore(deps): update pelias-wof-admin-lookup npm module

92dec43a09cfa820f935816b0d64cbb6f5e5c6d7 authored over 5 years ago by missinglink <[email protected]>

Merge pull request #22 from pelias/dbclient-name

feat(logger): Use dbclient name functionality

e861e59b3e23f7230436a71a80c5e60385a02b44 authored over 5 years ago by Julian Simioni <[email protected]>

feat(logger): Use dbclient name functionality

This allows distinguishing which logger output lines correspond to which
importer during an impo...

f48930c59133ad70c3add4e0efe125a5731c9ea3 authored over 5 years ago by Julian Simioni <[email protected]>

chore(importPipeline): Avoid using dependency injection for dbclient

859ca0bd61ba3d7adfaa9ae676d271a07df865c5 authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #8 from pelias/intersections

Add support for `cross_street` address field

9e80d641ccd4455fc9cf2ac7aefbc76778153742 authored over 5 years ago by Julian Simioni <[email protected]>

feat(schema): Add support for `cross_street` address field

This uses the support for `cross_street` added in
https://github.com/pelias/model/pull/111

6f315afd571cbb216217bbac22b9230d7e240b5e authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #13 from pelias/custom-data

Add custom data support

8becea744845aef062e7bfd2673d010ab4176925 authored over 5 years ago by Julian Simioni <[email protected]>

feat(custom_data): Add custom data support

This adds support for arbitrary custom data via JSON formatted CSV
columns.

Connects https://gi...

975bfd88580cd23823d4e23ff0b33ca4e223d248 authored over 5 years ago by Julian Simioni <[email protected]>

Fix formatting in readme section

cb32fbe4ba55d7c4af5b5e82501955e44af001d0 authored over 5 years ago by Julian Simioni <[email protected]>

chore(tests): Fix usage of tape

d830da3156114215c1dba9d506a101a75731f97f authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #20 from pelias/download-documentation

Documentation for downloader

27f88c362221a92e0bd3097fd4fe850c48d6547c authored over 5 years ago by Julian Simioni <[email protected]>

fix(docs): Add documentation for download functionality

Fixes https://github.com/pelias/csv-importer/issues/16

709d1d33585b47b9d446c438517069ed72e41e48 authored over 5 years ago by Julian Simioni <[email protected]>

Add documentation for ID column

11ede7a3b2a0bebabdcfeb84944a81d05fadd611 authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #19 from pelias/remove-oa-references

chore(comments): Remove out of date references to OpenAddresses

0f1ffa85730bfe644690db39501f3ec0a0e404d6 authored over 5 years ago by Julian Simioni <[email protected]>

chore(comments): Remove out of date references to OpenAddresses

This cleans up the last bits of code remaining from converting the OA
importer to the CSV import...

6c3ad9a18324fcee01b1cdc1c9f5f543a74a6b1d authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #18 from pelias/addAdminLookup

feat(import): Add admin lookup

b25080907ee0e58266cbe2c8ee3754a668278122 authored over 5 years ago by Julian Simioni <[email protected]>

feat(import): Add admin lookup

Admin lookup support via [wof-admin-lookup](https://github.com/pelias/wof-admin-lookup)
was omit...

23df03766737a2f276ecd6ae1a08f12cf7caa9d8 authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #15 from pelias/remove-required-keys

fix(schema): Remove required keys

c877829a178db10deb975c5af6f6e506ae55c2a0 authored over 5 years ago by Julian Simioni <[email protected]>

fix(schema): Remove required keys

The CSV importer is designed to be optional, and thus all config options
should be optional as w...

3268aa5c399d0950181b92975c7a515d4951d368 authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #14 from pelias/fix-docker-path

fix(docker): Use correct path name for code

a669c22a440639216d7fedb5c32f966ce83d271d authored over 5 years ago by Julian Simioni <[email protected]>

fix(docker): Use correct path name for code

The path previously contained `openaddresses`, since that's the origin of
this code. While it ha...

92703fcc707c0c60265d0a963e68696e251c39a6 authored over 5 years ago by Julian Simioni <[email protected]>

fix(Docker): Avoid reinstalling npm modules on code changes

8345b25edd913527f59829759a778b159bf49e52 authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #11 from pelias/fix-download-on-empty-config

fix(download): avoid error with empty config

e6cced6ecc4a3c587a49055f31414ae7a633d744 authored over 5 years ago by Julian Simioni <[email protected]>

fix(download): avoid error with empty config

We want the CSV importer to gracefully handle empty or incomplete
configs, since many people won...

eee8fcc4503f88e02d9df192fc7d2d228491b9bd authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #10 from pelias/require-lat-lon

fix(documentStream): Require centroid to import record

f428ff8e3737ab1a75c7048f4b519e0e4050b343 authored over 5 years ago by Julian Simioni <[email protected]>

fix(documentStream): Require centroid to import record

86743aa44b1058a00f7fef35be2a9af4c74f73dc authored over 5 years ago by Julian Simioni <[email protected]>

Merge pull request #9 from pelias/example-data

Add very simple example CSV

4b8b6f76ba6e904b5a2c2c3fbe2e99a151ea4716 authored over 5 years ago by Julian Simioni <[email protected]>

Add very simple example CSV

16ee54685fa448acd8714d6f0d7c8f52976a7a95 authored over 5 years ago by Julian Simioni <[email protected]>

Readme updates

59b7ff3a33c9dd05c216861bf439eb207dd0a262 authored almost 6 years ago by Julian Simioni <[email protected]>

Merge pull request #7 from pelias/greenkeeper/temp-0.9.0

Update temp to the latest version 🚀

795cccd8883bb710d7fcb6ccfddd52edad50d205 authored almost 6 years ago by Julian Simioni <[email protected]>

chore(package): update temp to version 0.9.0

4d2678db1e3cd4c0ede4a28f091722ebf0d51235 authored almost 6 years ago by greenkeeper[bot] <greenkeeper[bot]@users.noreply.github.com>

Merge pull request #6 from pelias/greenkeeper/initial

Update dependencies to enable Greenkeeper 🌴

2f1ba19aabd538911d19de2f8334d612017238cc authored almost 6 years ago by Julian Simioni <[email protected]>

docs(readme): add Greenkeeper badge

80e0308b3cf71b72189a34858398d16124fa94ad authored almost 6 years ago by greenkeeper[bot] <greenkeeper[bot]@users.noreply.github.com>

chore(package): update dependencies

913c53f7b06e1e6a14790a2aa41d9476ee139e1f authored almost 6 years ago by greenkeeper[bot] <greenkeeper[bot]@users.noreply.github.com>

Merge pull request #5 from pelias/ci-and-nodejs-updates

CI and Node.js updates

e8399a5db1cd38f93e5175318ca65b192c299ef0 authored almost 6 years ago by Julian Simioni <[email protected]>

chore(CI): Use shared Docker build CI script

Connects https://github.com/pelias/pelias/issues/749

446aa85d3128d055acec9b2dcf8914acd39e805c authored almost 6 years ago by Julian Simioni <[email protected]>

chore(release): Skip semantic-release run on pull reqeusts

This should speed up our CI slightly

cd2c12774230ab6455b1233643489701d617b415 authored almost 6 years ago by Julian Simioni <[email protected]>

chore(release): Run releases off master branch

Connects https://github.com/pelias/pelias/issues/749

f22b5ff3d85961dc080397e83bec8ddd7d956169 authored almost 6 years ago by Julian Simioni <[email protected]>

feat(Node.js): Drop support for Node.js 6

Connects https://github.com/pelias/pelias/issues/752

3954bb16a8f2c61ea2767952443db5fd16b4d463 authored almost 6 years ago by Julian Simioni <[email protected]>

feat(doc): Point to common requirements doc

This will prevent us from having to update supported Node.js versions in many
places for each re...

5b2d628dc69de6270b9f17dd0c08a5787179ea06 authored almost 6 years ago by Julian Simioni <[email protected]>

Make datadir if it does not exist

de21d154ade7767affa85095e665464062bd5fa5 authored about 6 years ago by Julian Simioni <[email protected]>

Merge pull request #4 from pelias/downloader

Add downloader for uncompressed CSV files

f095989f8051c65d75bf679dd95261a8f22b8876 authored about 6 years ago by Julian Simioni <[email protected]>

Add initial downloader for plain files only

e2af41951e0ef9bc65f0624152d039b155152bd7 authored about 6 years ago by Julian Simioni <[email protected]>

Add stub start/download scripts

Connects https://github.com/pelias/pelias/issues/745

2bf5a013ca783d13f5167516e337a47452595187 authored about 6 years ago by Julian Simioni <[email protected]>

Fix readme typos

25275408c2c48cd339059c6e620bfc215a8b3470 authored about 6 years ago by Julian Simioni <[email protected]>

Merge pull request #3 from pelias/tests-and-basic-functionality

Fix Tests and add basic functionality

39431288c84dad3bffd50fc2374efca9065f9b6b authored about 6 years ago by Julian Simioni <[email protected]>

Add readme section on supporting different column types

04b6675fd930684dd374342c43c1cb2a6e12f093 authored about 6 years ago by Julian Simioni <[email protected]>

Allow layer/layer_id (both case insensitive)

5044425a1725ead111947ca0a74c062e27db4148 authored about 6 years ago by Julian Simioni <[email protected]>

Further test parameters module

Using proxyquire instead of depending on pelias-config being unmodified

f10d1870f69d6e5c32579d18f86ccae4fcd4e8cf authored about 6 years ago by Julian Simioni <[email protected]>

Update log output line

688ae7eee991e9409e0c89e851c611bf54ec426b authored about 6 years ago by Julian Simioni <[email protected]>

Update Joi schema for csv importer

651c682035934899c8fe54d1476ebcd78cd9be36 authored about 6 years ago by Julian Simioni <[email protected]>

interpretUserArgs should always use pelias-config path

e449ab576ca82c99d60d5193f5989b2da4915a7f authored about 6 years ago by Julian Simioni <[email protected]>

Remove old download_data

24f923b7670ac05f0c4c7bc0d06a37a18ed7e89c authored about 6 years ago by Julian Simioni <[email protected]>

Remove unused streams

ee465fcc174149d7ab096211c67cb35dadf3d6db authored about 6 years ago by Julian Simioni <[email protected]>

Support ID and HASH for id (both lowercase)

2bda4dc6f36e3c232dfcf5f694290eedfd96fab5 authored about 6 years ago by Julian Simioni <[email protected]>

Iterate on unit tests

ec5fa4dfc6ec7b341f94fcc1c49fc9e67bc2dd84 authored about 6 years ago by Julian Simioni <[email protected]>

Move core of processing into its own function

c9f2704039d64103a81a8edceac289b037ae1d01 authored about 6 years ago by Julian Simioni <[email protected]>

Initial work to get unit tests passing

4962a5c907b3c151528e88a3fab663178e9193b4 authored about 6 years ago by Julian Simioni <[email protected]>

Merge pull request #2 from pelias/semantic-release-build-stage

Add new Semantic Release and CircleCI settings

0e0614ba7e31db8e522be27861f2cc71c28f54d4 authored about 6 years ago by Julian Simioni <[email protected]>

Add pelias user to Dockerfile

e67eef7d6db46cc89e522f9e68565e8d26ff0122 authored about 6 years ago by Julian Simioni <[email protected]>

feat(release): replace semantic-release dep with Travis build stages

This makes CI quicker, and releases more stable.

Connects https://github.com/pelias/api/pull/1187

daf1b4935b21588c0d30af3a3fa61bc0ede42006 authored about 6 years ago by Julian Simioni <[email protected]>

Add CircleCI settings

e53b9413ef5afe2925b5e2f6ea813413e466aeab authored about 6 years ago by Julian Simioni <[email protected]>

chore(npm): add npmrc disabling package-lock.json

A lockfile makes it harder for carat ranges to work as we desire for pelias
packages when runnin...

65b8bedd7cfe8425993d335d6ee3025969e9893c authored about 6 years ago by Julian Simioni <[email protected]>

Merge pull request #1 from pelias/blacklist-stream

feat(blacklist-stream): allow excluding documents via GID blacklist

03e68d51e72ab833eee0465a14b446f88c75adba authored about 6 years ago by Peter Johnson <[email protected]>

feat(blacklist-stream): allow excluding documents via GID blacklist

edf55e714f7b3ce0e221a622df2c2253067b6188 authored about 6 years ago by Peter Johnson <[email protected]>

Add gitignore

053415b59d47faeca8d18f40edc572fc5c8ab2eb authored about 6 years ago by Julian Simioni <[email protected]>

Update package.json

Some of these settings are old

6ffe3ddc942812a65e805e9805e6e244512f791c authored about 6 years ago by Julian Simioni <[email protected]>

Add TravisCI config

325b1ed4d6a3b752b856383bc81003f6960c35cc authored about 6 years ago by Julian Simioni <[email protected]>

Node.js 6

32d4e33f6e834d9d85137070e93c8840a10186e6 authored about 6 years ago by Julian Simioni <[email protected]>

Remove Mars data

00da4364e07278ffcf0d30f904c43682eb98f842 authored about 6 years ago by Julian Simioni <[email protected]>

Use carat ranges

12c4b1b96df72e0852f3121d54bed57391a419f5 authored about 6 years ago by Julian Simioni <[email protected]>

De-marsify

14bde768e86a803ce67091a979516fb3189164f1 authored about 6 years ago by Julian Simioni <[email protected]>

Fix example config

3ee98ce1540b48d8e348ec1ef26c42ae418ad3b6 authored over 6 years ago by Julian Simioni <[email protected]>

Add link to geocodemars.com

52a58f271ca45fc3b4225a7f4dd00389bf85bf81 authored over 6 years ago by Julian Simioni <[email protected]>

Improve documentation of data

a14a2c8ac11c91fac4929673301c9c82b11797fd authored over 6 years ago by Julian Simioni <[email protected]>

Merge pull request #2 from burritojustice/patch-2

spelling...

6882326a3e4e7e666140cf5ce074abcfa421331d authored over 6 years ago by Julian Simioni <[email protected]>

spelling...

07e6d5399a48ccc52a395a0f7e815b9666584698 authored over 6 years ago by burritojustice <[email protected]>

Merge pull request #1 from burritojustice/patch-1

spelling

940b79859e2e4bb71b5ccb83c52f45ce5ca7a387 authored over 6 years ago by Julian Simioni <[email protected]>

spelling

867f73508c17abbf78d749dae494babb9b04607e authored over 6 years ago by burritojustice <[email protected]>

Add a very important note to the readme

704dde88edcc6582bb976fe726217a17aaeb11ca authored over 6 years ago by Julian Simioni <[email protected]>

Make it a mars importer

9d632285d8bf69ca5ea3854ab5e82d7d07f39383 authored over 6 years ago by Julian Simioni <[email protected]>

Add data sources

c44d487468e79d1d4c196aa073300ea697805639 authored over 6 years ago by Julian Simioni <[email protected]>

Add source data

5f9cc6258b89b331b1ac725e16dd38b8263939d7 authored over 6 years ago by Julian Simioni <[email protected]>

Remove some unneeded bits

cf536af652802e001de97306ab86b3eb73af19b3 authored over 6 years ago by Julian Simioni <[email protected]>

Start with the openaddresses code

fe58297b06c6e662f240b64b8d5bdf794d4be8b4 authored over 6 years ago by Julian Simioni <[email protected]>