github.com/Blosc/c-blosc2 commits | Ecosyste.ms: OpenCollective

Allow user-defined codecs

e44ac697fa67da83efa01f10e6d4f5b52363c6fe authored almost 4 years ago

Improve the docstrings

c98f575791fb93c6a769260feebe7164e2743b48 authored almost 4 years ago

Use a global register for filters

53a3b149095821b96554932f708b8ee66219c67f authored almost 4 years ago

Rename pipelines

3a6c21b7ff7609a541fe9c03cd80f5fbab47da04 authored almost 4 years ago

Define user-defined filters in filters[] (not in filters_meta[])

ea095a7a0748c9a736376d8114de44be2856f5d5 authored almost 4 years ago

Fix requested changes

ae79cce041abe556c339ca071af1fba082553c33 authored almost 4 years ago

Fix requested changes

b56f9765006f4f784cbd96655b5209f61e620947 authored almost 4 years ago

Allow user-defined filters

0796ac60bc44e6e3db60b20c4cf2ca40deca704b authored almost 4 years ago

Update README_CHUNK_FORMAT.rst

f4118746887a125a86a0fe0a6df1aaba0e94a664 authored almost 4 years ago

Update README_CHUNK_FORMAT.rst

6be7b30e25dde5667938576553082da1ceace7e0 authored almost 4 years ago

Be more explicit on cdata stream format

f6265e3b47089f17be37f767b3c422fa9155432f authored almost 4 years ago

Preliminary implementation

9b0445cc62fd31aa367a8a1254cb8fa2733f83d7 authored almost 4 years ago

Test splitmode with different settings

c4c8c7cb7f22323cda796575f699ad4c953b6661 authored almost 4 years ago

Small optimization

f889a0716a353fcb5c3354e9efd6fb8d4c8f56d5 authored almost 4 years ago

Windows cannot use regular ints as constants

23a9d1dafac3f97601482d828899bddb252112f4 authored almost 4 years ago

Updated benchmark

16f6d4739b0e848f891deae81fe8cff387435458 authored almost 4 years ago

Fast path for memcpyed and special chunks in getitem

4a727370b1c2e9746434c00bf2236db86c31ea5c authored almost 4 years ago

Fix memory leaks in tests

77b7dfd41f4b8ae7cc12c8babd547829a84435da authored almost 4 years ago

Fix a possible buffer overflow in cutest

4284d2a1dd46455bcd17d33055cd6431e462d532 authored almost 4 years ago

Move invariants out of the loop

a5da41cf1efd8dd86adc35ad6ef4f208d23e3903 authored almost 4 years ago

Give more consistent names to special value symbols

dc8ece9d405ce91e54185e48f168fded8403a6d1 authored almost 4 years ago

Preliminary version of fill_special

4c54d3d5f00e5cfa94962c69767a9da84f465c23 authored almost 4 years ago

Add docstring for blosc2_schunk_fill_special()

e35366417d8ebebb37652d8d44e73b7222fa4baa authored almost 4 years ago

Add a test for fill_special

6fbb6f62d3d542b00345b9053d1ddad7dbb6a0a7 authored almost 4 years ago

Support for sparse storage in memory

56f9759e71996a4dcf062c9011676f38b6ecad86 authored almost 4 years ago

Optimzie blocksize for offsets using create_frame.c bench

c46b0fa435d1cdd77d3777e0e05c30e95403fc79 authored almost 4 years ago

Fix the case where (nitems * typesize) % chunksize != 0

7bc12506995847f6e506584306aedd9aedf24f45 authored almost 4 years ago

Fix the nitems computation to be int64

423315df00eacecd0882702fefc84966098e6db1 authored almost 4 years ago

Continue work on fill_special

dd5109ee9350c2416310c78551c8e89405258584 authored almost 4 years ago

Continue work on fill_special

b229a93adfa070d98efed44b33d1a7e9994dbfca authored almost 4 years ago

Force execution of pre/post-filters during schunk copies

dcf22aaa6ea7148f95e4e333abed0cc1cc0f30df authored almost 4 years ago

Fix the postparams offset

bfd5c9e0b3ab3cd8c0778bf2e501b1c2b2ac9056 authored almost 4 years ago

Fix an issue with special chunks

5703e5dd79a490e16f00e8cbab3967eaff5184f5 authored almost 4 years ago

Better capacity check

7794dbef62c467902f84038191cabdcaa0c4862c authored almost 4 years ago

Update issue templates

26b08e6387d4276dfdd4bd54f8ae3396312f91f0 authored almost 4 years ago

Let decompress an empty array

d0b9b7cd0348cc34a68a1221b7c5d9dc912d7137 authored almost 4 years ago

[DOC] Complete the docstrings for some vlmeta functions

38b23d5ab3c67c5528faed5750611f34c3f18f3f authored almost 4 years ago

blosc_read_header -> read_chunk_header for readability

9891844f91bf7dc3531f0a6e549e35dcd3306d71 authored almost 4 years ago

Fix some fuzzer issues

f9f6797a9051aecf4e65fd3800e911c203060afb authored almost 4 years ago

New API for special chunks (for conveying blocksize and more)

765c121fd11b8f721f570f7a868b21941caa79d4 authored almost 4 years ago

Another sanity check for the number of chunks in frame

48123a7d2e7409ecd0e74f64a326fa7f2af0627d authored almost 4 years ago

Fix the docstrings for the new API

0fb1d8637c1ef754a76bf705ea31311f746f69ce authored almost 4 years ago

int memcpy -> int memcpyed

3fa70225d9e016523de3b977fd8942cab58c92f3 authored almost 4 years ago

Another try for fuzzer

f84af976e1d85953d2392dd6f27fa1886059955a authored almost 4 years ago

Support for uninitialized chunks.

Also, added new space for more special values (3 more slots are
available, with 1 more bit avail...

d1ea514286c47433dabcf47b11cf81d2248ca5bf authored almost 4 years ago

[FUZZ] Fix a memory leak

0248b70723b30c8adbd70316e01574f80bde1975 authored almost 4 years ago

Fixed ASAN heap-buffer-overflow when reading frame vlmetalayers. When reading content we should not be using trailer_pos to check bounds as it is only used to enumerate offsets.

https://oss-fuzz.com/testcase-detail/5533861342740480

ce9aa2247006ed182dabb922bd3536b13375c4cf authored almost 4 years ago

Added maximum block size to prevent context tmp buffer from overflowing in 4 * ebsize calculation. Maximum size is 512mb - 4k which is closest in value to (INT32_MAX / 4) - (BLOSC_MAX_TYPESIZE * sizeof(int32_t)). This allows 32-bit apps to allocate enough memory without tmp_nbytes overflowing during context creation.

e670bb4036fd7c840b1c206b8739f292346b1aa9 authored almost 4 years ago

Fixed formatting in blosc2 enums for consistency.

2112e1398b74ea0c6759f82679247ad5f2ab790c authored almost 4 years ago

Try to fix a fuzzer issue

f1f42afb9a7f6b554a71270e5060dc7d33b66145 authored almost 4 years ago

Final fix for postfilters + special chunks

36e9c586abab7aaf8a4f3f49f5ed6d0ccb54cada authored almost 4 years ago

Fix a bug introduced in prev commit

fb61b638be99bf3f89a170fc632ca9478efbd3c8 authored almost 4 years ago

Acceleration path for nitems == 0

40232224b5b3429f55634088c13b9fc6967888c5 authored almost 4 years ago

Fix special values on persistent frames

62800b0f6dcaf61641fda4daaa0851b5bfd8863b authored almost 4 years ago

Fix for parallel decompression of special chunks

6d755d32961aba5405e0f9d7ab7d57859f643532 authored almost 4 years ago

Start supporting postfilters for runlen

cf02dfc992ae5544c92f69befc7093aacf168e77 authored almost 4 years ago

Trying to fix a fuzzer issue

abfebc4c4e0f747be1257a21332feac1477f2c2f authored almost 4 years ago

Trying to fix a fuzzer issue

7af5d836c5ab8a91db89ebb915564fca5d79d6d4 authored almost 4 years ago

Fix the postfilter when no other filters present

f489cdbd0a2567e07365671618fd859a31eec4ae authored almost 4 years ago

Return a length estimate even when no internal frame

9ed0d3cb37b16ac5e3c54cde6b43acfd53cccf78 authored almost 4 years ago

Fix a zero detection issue when using split codecs

c9084224f4eae8cb52dedd39db6790362ded1c7c authored almost 4 years ago

Improve frame creation bench

77872d9f9425c34837d21ee9aea70ab1efa19487 authored almost 4 years ago

Add a bench for creating frames

2b53dc708c254053de69990b1da869c99cfdf409 authored almost 4 years ago

Add a generator for files for the corpus of the fuzzer (and a README)

fff2146e7e30e7670b755e3f72dc2809bb61b848 authored almost 4 years ago

zlib-ng sources updated to 2.0.2

31f8fa1d77a6ea1e7cf113a86b86e39f359bde2d authored almost 4 years ago

Add plugin for btune

eeae3142781f74b69b526db31dfca6a61eee2f79 authored almost 4 years ago

Be explicit on dparams defaults

a3954c73081c1db2a7893950123a228fe6d01b3d authored almost 4 years ago

Update ROADMAP.md

2a0dee4a959616e05e1eec40969068ad1a0e5868 authored almost 4 years ago

Update ROADMAP.md

f384c1a73447d65f50d91fdce0ac744972ecc733 authored almost 4 years ago

Update ROADMAP.md

dc2996296d02729c48007822fd23257a6a813d0b authored almost 4 years ago

pparams -> preparams (for consistency with postparams)

979c7f8e26fce06eacb0be81e27981ce3d4f24ea authored almost 4 years ago

Support for prefiltering the actual src buffer

57f92638b907cbe0dc1645d26dc901d4fbeac477 authored almost 4 years ago

Tests for postfilters are passing now

2939f1f7fca26cd440cc4d93b8cc409e3e75e7ab authored almost 4 years ago

Fix for the remainding postfilter tests

f24c576f17faae36fdd1636e5db71aba912d4be7 authored almost 4 years ago

Actually test some computations :-)

c61ea39ca0d85ffeb1a0576142427d7493861112 authored almost 4 years ago

Check the case where the actual data in buffer has to be postfiltered

ba833721559dac0b2e543d1e32b21564b3dc81b3 authored almost 4 years ago

Very preliminary support for postfilters

e0459598fddd6e2b5119d29f2c621f14650fe5f1 authored almost 4 years ago

Update after board of directors meeting

ca87d15f6e22dfae13f8e867bd7795757c0a6bea authored almost 4 years ago

Mention postfilters in the actions to be done

fca3a5108ba47480f283e80bbe2342137dd32353 authored almost 4 years ago

Fix the codecs that are supported

20f215fc11cacdf3bb20391f658cd83ab1f5624b authored almost 4 years ago

Fix for packages including c-blosc2 as cmake dependency

20b1ded1c0546ec53c9ffeb73823c7bdcf144b70 authored almost 4 years ago

Update release notes

1d7b97ce50b211fade6318bb59bf919c98316325 authored almost 4 years ago

Merge branch 'zlib-ng'

4eefbd18fcb96234aed9ae4ab956af8473041744 authored almost 4 years ago

Merge branch 'master' into zlib-ng

4580eea428c6ce2a0fd5cfdb8240196830615bb7 authored almost 4 years ago

Updated to zstd 1.4.9

f895673e50c333744cb2f171c2c03faeb2006f84 authored almost 4 years ago

Merge changes

eff7f315171e4adfda4b5aeaa25294b30e8193c2 authored almost 4 years ago

Updated to zlib-ng 2.0.1

cd8f7eac1dd81a30e11c7e08effa13812268e88c authored almost 4 years ago

Fix bug when updating the compcode in a context

3451c8c59fabf4d540fc83ddd5c31061aef74ace authored almost 4 years ago

Fixed null-dereference write when unable to create thread context memory.

https://oss-fuzz.com/testcase-detail/4589997492666368

91789b65699fed69b8e31b22b3c02d435b38a24b authored almost 4 years ago

Check to ensure frame header is minimum length required.

27b004bf27c9879226da557b6055e3f151af8a9a authored almost 4 years ago

Fixed ASAN heap-buffer-overflow when reading frame chunk cbytes past the length of the frame.

https://oss-fuzz.com/testcase-detail/5206670272757760

4327a6a1bf568f5b1c59a32152ec5b64811fdba9 authored almost 4 years ago

Fixed ASAN null-deference read trying to free chunk that has already been free.

https://oss-fuzz.com/testcase-detail/5107303620673536

1a79d783cc791faf12fa9f6f6f92c26fb8be4967 authored almost 4 years ago

Not build shared libs

3fa472ca1347822791296b7aacec0c4dd6fa7cdb authored almost 4 years ago

return codes checks added to blosc2.c

776beaf88a7f32ca09ba1d5abc8c7ac4d9144d48 authored almost 4 years ago

Add suport for zlib-ng

8fc28ab8cee01210ea7ff19326a5f17f79fe77ff authored almost 4 years ago

[WIP] First attempt at using zlib-ng

0e261baa4c0729b58023da7a8bb5de8d907081aa authored almost 4 years ago

First attempt at using zlib-ng

0b63329c4763a6a00e813d52d71dd2ac77b651ab authored almost 4 years ago

Fixed MSAN error when doing pipeline filter if compressed stream token is zero.

https://oss-fuzz.com/testcase-detail/6243118761508864
Added check for valid compressed stream tok...

6c7e68cbd611d9a19808c29417eb731e1b4eb829 authored almost 4 years ago

Be more explicit in csize that is zero or negative

2324c9516ee9ea321d312b28a644236aa9ee1d9d authored almost 4 years ago

More updates to ROADMAP

0f3e6550f1a3140c58cd18115311379307035a05 authored almost 4 years ago