Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/peermaps/osmxq

indexed quad format for open street map data designed for improved locality and lightweight denormalization
https://github.com/peermaps/osmxq

4.0.2

4220b682130e16fc3b176e04707b51e69e65acd1 authored over 3 years ago by substack <[email protected]>
parallel get_quads()

0099f350d86ffe31695d06feab7ae8c8f336e65e authored over 3 years ago by substack <[email protected]>
parallel flush for ids

ea30a60dce90a25cd37db89c576b26e1dde0915d authored over 3 years ago by substack <[email protected]>
quad flush in parallel

432779a609973d6d5a03696dc12bdc974ea6d188 authored over 3 years ago by substack <[email protected]>
4.0.1

1546948a5988449854c3950aac528b006c3fef56 authored over 3 years ago by substack <[email protected]>
separate counts for updates and total update+existing data in the quad file

3ea10e041ddb3899166f928edec0f41c7bb59a93 authored over 3 years ago by substack <[email protected]>
4.0.0

cc14d8e2db61af8027e41912c382930c1ff2e4a2 authored over 3 years ago by substack <[email protected]>
save a record lookup to place records with refs into a quad

d16491c02393fb8f6d7680fb9acd230f77a38529 authored over 3 years ago by substack <[email protected]>
record_cache instead of quad_cache. stores much less data but goes much slower

b05bcd48eeee0452b3847aa0a57001eaadf18210 authored over 3 years ago by substack <[email protected]>
per id instead of per id block cache

8615231e9d74518522729de3c4fedd669926e789 authored over 3 years ago by substack <[email protected]>
fix unpack offsets and break on 0 size just in case

f34ec2f2f181d7f7fa89604c071b55e6c82f34b8 authored over 3 years ago by substack <[email protected]>
append for ids

e2c3de30a94f70e03148e7a39b35e674f8b0d16a authored over 3 years ago by substack <[email protected]>
append to quad files

107b1977bee915a0b8051e3f999ad274ff7d573d authored over 3 years ago by substack <[email protected]>
3.0.0

a0300bfc5bbff97333e0a89d59c1c0d94339cfad authored over 3 years ago by substack <[email protected]>
partial flushes for ids

8aadd8247b8ef1b75ae196a69e5df940201dd3bb authored over 3 years ago by substack <[email protected]>
2.1.0

5fd3e945156917e8f6a610e293fc3fa2e75219b9 authored over 3 years ago by substack <[email protected]>
partially flush quad files based on biggest N and max age

af7cbb9ec88e8df05ccfe9e22721b391bec9fd82 authored over 3 years ago by substack <[email protected]>
2.0.0

9c1debe865358d68566b54ca1ac0cf342414b4ad authored over 3 years ago by substack <[email protected]>
bigger default quad flush size

b8e4c3388a3c7d9a81a8a4757c4a6b86eca8a4aa authored over 3 years ago by substack <[email protected]>
merged previous stashed update quad overlay

ea44c1c76622e370ecd0ba3ded477f6bfafd7ac3 authored over 3 years ago by substack <[email protected]>
less agressive default cache

266a7c4a9ecfccfeb41c5eb7311009d4ef7603dd authored over 3 years ago by substack <[email protected]>
use id update counter

8727822c96b7544f6566727560af4778d742b42a authored over 3 years ago by substack <[email protected]>
don't require the whole id to block to be in memory to schedule a write to it

c4b4127affbbd758524c9a4d9b81792bc7d12172 authored over 3 years ago by substack <[email protected]>
1.1.0

73eced798a54f88f5e1fd67f2d857d28c6f49857 authored over 3 years ago by substack <[email protected]>
public members for fields

6149a97c8aada8d4cf61765371145dbb52c2ddc0 authored over 3 years ago by substack <[email protected]>
1.0.1

5ee798aedb1891e67c943b35ba35a62bc8554e3b authored over 3 years ago by substack <[email protected]>
fix for unwrap crash

c48443d62404f077643c53fdd22766914e8a40b4 authored over 3 years ago by substack <[email protected]>
more fields that cargo needs

455d69e72a60cd162d51132ae48eb982efa716b2 authored over 3 years ago by substack <[email protected]>
1.0.0

7dc56afc7a3f6720d3e10c0c0d5d307937d14d6b authored over 3 years ago by substack <[email protected]>
decent settings for perf

cad953d3cca18e72b0919872755e5bf5cb1fc4c8 authored over 3 years ago by substack <[email protected]>
don't create empty files by reading them

f8a4298f1cef1c29dcb37c8131e89a1d45f87815 authored over 3 years ago by substack <[email protected]>
fix bug with dropped data

e2e839d9ac711927bdb3ce5d986dd81c23b7daeb authored over 3 years ago by substack <[email protected]>
fixed wrong bbox overlap

3dd4127843bc150c298c491ecd9cef80923d8966 authored over 3 years ago by substack <[email protected]>
set_len() just to be sure. probably don't need this but maybe

e3a026712429368c3c5bb3672c2fab7acd92fa74 authored over 3 years ago by substack <[email protected]>
update the tree on split quad

74c1fa08fa997e7ddcdd49266ae754b4e7759936 authored over 3 years ago by substack <[email protected]>
use local ids to resolve positions for get_quads() in add_records

d68f455e55244d2cee46e1888515085913ece53d authored over 3 years ago by substack <[email protected]>
also check positions from results first in get_quads()

5166a49fa75332dbf7dd34b6369e6b58aa537df0 authored over 3 years ago by substack <[email protected]>
in split quad check records that were just deleted to find position

43460dfc9137e78de4d4d56f979e5b0ec4471c01 authored over 3 years ago by substack <[email protected]>
fix bug where it doesn't insert into quads sometimes

36616dd3e94c1d952f6ba0011617c1a24efab15a authored over 3 years ago by substack <[email protected]>
fix to not drop last batch of records in bin, load refs of refs in denorm

a70894231799ca72de6d889ab778b99275903d42 authored over 3 years ago by substack <[email protected]>
fix remove

02257f81db86ebd1b9e4b8ea22516eb6b31a89ee authored over 3 years ago by substack <[email protected]>
fix meta count

a17190578db520a32f2a066184cc349beb662a45 authored over 3 years ago by substack <[email protected]>
read/write meta

be7deffabf3aa4d0d5a61cb6b0d4aaf76ec5e04a authored over 3 years ago by substack <[email protected]>
denormalize quads

1d370bd9e71a8e89da1cbe4416fd91f2c57620a5 authored over 3 years ago by substack <[email protected]>
stubbed out denormalized record stream

79adb3b708a41e5963f825351e8a734d63bc64ec authored over 3 years ago by substack <[email protected]>
deletes

b8eb9774f2d3a0a024f026042893327f29476ecb authored over 3 years ago by substack <[email protected]>
remove checking quad cache

4daa847d2da25c4a553243281d61f4177a2a2119 authored over 3 years ago by substack <[email protected]>
clear missing_updates after flushing to file

ccc31539832059ebd7d11ebd09bca961c3425fe6 authored over 3 years ago by substack <[email protected]>
missing blocks

826df2fd27f2ea7810903a758550f6295a8e8b6d authored over 3 years ago by substack <[email protected]>
lock using active files mutex not cached fds

2270fbedc0f6eb6dab0944b1dbe54d40fd6a7bc3 authored over 3 years ago by substack <[email protected]>
rwlock on {quad,id}_updates and mutex on storage and stores but still has a problem where stores may be evicted from the lru while being written

a4381bd990f1808b11c07b1c1dc8c22f89dfc867 authored over 3 years ago by substack <[email protected]>
better errors in bin script and flush descriptors

cf7332216cdf72404298e34b4dbc97ca1f43d6c0 authored over 3 years ago by substack <[email protected]>
skip writing empty quad files

aa83c435673467d374a4c5478987d49a39ca6c69 authored over 3 years ago by substack <[email protected]>
fields

75dd2271dbda0dd31cae87e10d6499ba0df74ff8 authored over 3 years ago by substack <[email protected]>
gitignore

f0f7df70cb1f35eefcb89fddae5bda97a0a0e010 authored over 3 years ago by substack <[email protected]>
write id => quad id records

44c74011f187f9987af8cc61abd55f527ac4f4e9 authored over 3 years ago by substack <[email protected]>
pack example and unpack

cc65e6e916d48781e599399e6abd4413602a7cac authored over 3 years ago by substack <[email protected]>
type param for Record instead of boxed

4c821f51a1379aff1559c3c1bde25746c10f5524 authored over 3 years ago by substack <[email protected]>
flush writes

957a674381e0098b6fc836bc6fa7a4e8892873ef authored over 3 years ago by substack <[email protected]>
missing queue

b0e3737a463bf3b66830f74ee8cf69cb3999a579 authored over 3 years ago by substack <[email protected]>
storing cached quad blocks as a hashmap is much faster

757544e3f35c4ecba763023c7ecdf93e13bff6fe authored over 3 years ago by substack <[email protected]>
remove singular methods

fb86411aa7b585d024ca9908562db0da4d72419a authored over 3 years ago by substack <[email protected]>
split quad implementation

09b8bc71b2d76dce009f6ed2a550a0cdce085f2d authored over 3 years ago by substack <[email protected]>
parallel methods are much faster

e9b72efd18e0cf0e95ed9a6582ec5bc16ee3a31b authored over 3 years ago by substack <[email protected]>
basic structure and compiles

956a2d6eb9bfc5056c775507967a026e6d92a94d authored over 3 years ago by substack <[email protected]>