github.com/Blosc/c-blosc2 commits | Ecosyste.ms: OpenCollective

Merge pull request #164 from Blosc/new-api-storage2

New api storage2

f801d9372438c8b01caa4bb1e23179614751af58 authored over 4 years ago

Refactorization and low-level renaming

7f00262b5d1fd9777fa98c5d8f509c3355353fde authored over 4 years ago

New blosc2_schunk_to_memframe() and improved docstrings and tests

f73b2e0ab9074fe09fe5a5978d48104c420c39b7 authored over 4 years ago

Fixed a leak introduced in the prev commit

1036fab9c04ee93e6c76e524d6dc6a79779dd063 authored over 4 years ago

More refactorization

441c6dcd46863c1eebc3b372562cf90189dd6905 authored over 4 years ago

Factor out the storage creation

bb84d2c70565acbb721a3cf0e6e95078c0dd1f90 authored over 4 years ago

Merge pull request #163 from Blosc/new-api-storage

New api storage for super-chunks.

a290838ab8616b7008883ee6ef3fa5d0a462afb2 authored over 4 years ago

Fix some docstrings

bcd1895a816d23b52d0479b110d50cd3e5e4fedf authored over 4 years ago

Do a proper malloc

47d0175e53d954438f72134f6200812b84a5de5a authored over 4 years ago

Fix some warnings with MSVC

6c2900162ce502a632002840a12dcf1e15bbf130 authored over 4 years ago

Trying to fix a test on Win32

40dbe17f830df61f82eec85ef937b71bb9042b43 authored over 4 years ago

Fixed a typo recently introduced by error

b6200740ef636f69c4738844faa532b46ef25365 authored over 4 years ago

Add space for the trailing 0 in strcpy

8f05300d1b2b3a2b49ece8dbb194544f32adeaf5 authored over 4 years ago

Fix some leaks in cparams/dparams

ef00fcd3d55429d8994939c65718301a8ae649ac authored over 4 years ago

Add space for the trailing 0 in strcpy

01a791792acda47c71b00a1097c4649101d023d5 authored over 4 years ago

All tests are passing now

9424e99e1101a158bc6b2b8cc4acfedb5302b043 authored over 4 years ago

Fixed a bunch of tests and benchs

9bf77eefb53acc7e044a8b95cb3bd030a4116702 authored over 4 years ago

Add blosc2_schunk_open() and blosc2_schunk_from_memframe()

fcc2c3c72e19f089d75a561093d3206ec71c7091 authored over 4 years ago

storage is passed by value now to blosc2_new_schunk()

6af1ac3c61e75c7b08dbb048ce5df43350cf98ec authored over 4 years ago

blosc2_new_schunk() -> blosc2_schunk_new() and new storage struct. Tests still failing.

ee8472d7bf0bf8c04297dd70c71ef8c5b89381a3 authored over 4 years ago

Merge pull request #160 from Blosc/sparse-storage

Sparse storage

a9f90ded533e4a1d574b220f4a238bc68ce841bb authored over 4 years ago

Merge pull request #162 from nmoinvaz/fixes/compress-block-size

Fixed ASAN overflow when not enough space to write compressed block size

22b1198a0bac7fcd8db06b6619a7044b986f2408 authored over 4 years ago

Fixed asan heap buffer overflow when not enough space to write compressed block size.

c4c6470e88210afc95262c8b9fcc27e30ca043ee authored over 4 years ago

Merge pull request #161 from nmoinvaz/fixes/asan-blosc-int-overflow

Fixed asan integer overflow when checking compressed size bounds.

bb42656cb982f60ce8f1b87f3185bdcd94eb9d0a authored over 4 years ago

Fixed signed/unsigned comparison warnings on MSVC.

9de0ff1d34857441e9a650ac1a1a022a5648e1b2 authored over 4 years ago

Fixed asan integer overflow when checking compressed size bounds.

3466fae4d72c9bd2afb5d62d18cf29beb5c499f2 authored over 4 years ago

Address suggestions by @aleix11alcacer

8db4718130e5ea59e4f5f5ecd799886de14d09da authored over 4 years ago

Add support for the new storage struct in blosc2_empty_schunk()

eeb7ccdffd55666ef8548f243b97b46ae5fc4cf9 authored over 4 years ago

Add a nchunks=0 test case for blosc2_empty_schunk()

71e45846c8da8e9b753655bd2aebf6986fedab57 authored over 4 years ago

Add support for sparse storage support in super-chunks in ROADMAP

3e7e36244b2cec00b9d4279d8f28fcf93666cf55 authored over 4 years ago

Merge pull request #157 from nmoinvaz/fixes/arch32-bloscd-bounds

Fixed heap-buffer-overflow asan read error on 32-bit arch

9f382674c3c80b0c53280540dd5f6670bc62fe41 authored over 4 years ago

Reorder frame offsets (#158)

* WIP

* Tests done

* Add newline at end of line

* Fix requested changes

* Fix memory...

f82602a8557cc568b39b2e6472be4e5f9060483e authored over 4 years ago

Fixed over read check using pointers on 32-bit architectures.

d0e530f3134ccd7e8d64d8bb1a76da700472eaa2 authored over 4 years ago

Fixed heap-buffer-overflow asan read error on 32-bit arch

d314d790853799ac4db940c852dd673dfde8d3cf authored over 4 years ago

Fix the meaning of the `dont_split` flag

f4a74cbff7c021342450f103623a6d9143230e85 authored over 4 years ago

Merge pull request #149 from nmoinvaz/fixes/boffset-check

Check block offset to ensure it is not negative during decompression.

2caa42458b9810fbb766f4fe36ae144ecf993853 authored over 4 years ago

Check block offset to ensure it is not negative during decompression.

e192b62aa44e0f509435595246b0013487aadc92 authored over 4 years ago

Create empty super-chunks (#156)

* Create empty super-chunks

* Fix requested changes

* Fix reque...

de30b5bc722e51473721b934885297d8bfe9eae0 authored over 4 years ago

Inserting chunks in any position (#154)

* WIP

* Add tests for inserting chunks

* Improve docstrings

* F...

947c0ac7644b3539550577b81f8cce245681fa9a authored over 4 years ago

Allowing users to update chunks (#155)

* Allow users to update chunks

* Fix requested changes

6aa1ff65ea699430d5ab7d2641a38ac3cbab15f8 authored over 4 years ago

Merge pull request #150 from nmoinvaz/fixes/asan-mem-leaks

Fixed ASAN memory leaks in unit tests.

a7b7864a57712ad9f47e55777ad9f58d4f15d79d authored over 4 years ago

Merge pull request #152 from nmoinvaz/fixes/asan-frame-overflow

Fixed ASAN global buffer overflow error due to src not being at least 32 bytes.

01614815694218c1b4a3fbfff2f3134716d8d81e authored over 4 years ago

Merge pull request #153 from aleix11alcacer/rewrite-offsets

Reorder offsets

cd546a52429020d48fb711320cf016cae2ed948d authored over 4 years ago

Fix requested changes

429915f9646dd0bb0ac293a38c8beade99d0a386 authored over 4 years ago

Fix requested changes

82ec2dbffc8ec6ba69c6464e8ba5623f5ae73d92 authored over 4 years ago

Fix requested changes

9e3c8bb9ed453a59e4027148b0de7601c3681d24 authored over 4 years ago

Renaming

0944d5ccfb76ad50540a42e83071812cb101104a authored over 4 years ago

Renaming

229061eba7575433562d38902d220a3cea618f2f authored over 4 years ago

Renaming params

f86c64eef565d5741be7f8ee940d6cfab0ef04af authored over 4 years ago

Create blosc2_schunk_rewrite_offsets function

065fc277d78f9f7d3035ff6e28881a4fc33fc0a9 authored over 4 years ago

Fixed ASAN global buffer overflow error due to src not being at least 32 bytes in frame_simple test.

f3f3b73cdd1f273d200e573cd0f7e5d5cfd7158f authored over 4 years ago

Fixed ASAN memory leaks in unit tests.

73ca3178ac8816886d655ea0928a31eb1bbee5f0 authored over 4 years ago

Merge pull request #148 from nmoinvaz/fixes/wrong-size-arg

Fixed wrong size being passed to blosc_run_decompression_with_context.

9de39a266ae28661397448764c63b41f05bdf2c0 authored over 4 years ago

Fixed wrong size being passed to blosc_run_decompression_with_context.

d80b5acaf23ec4c2453a348b35096b99601fcde5 authored over 4 years ago

Remove unnecessary casts in calls to initialize_context_compression and initialize_context_decompression.

c203bdd674779c25ee0342721e41e5b722ff346c authored over 4 years ago

Merge pull request #146 from nmoinvaz/fixes/msan-dict-size

Add secure versions of blosc_compress and blosc_decompress

ed6acfff013ef727226d56b262c67b925730669e authored over 4 years ago

Used fixed-width integer types in API function parameters.

4933924f9fe44d719ece218b0aca960b0a1ea5e4 authored over 4 years ago

Convert fuzzers to use secure functions blosc2_compress and blosc2_decompress.

fd18e1584c8a3452cf6ef841382ad2a644064987 authored over 4 years ago

Reorder parameters in blosc2_compress_ctx so srcsize comes after src.

a739bf96fee8f8d88651e29d6f3ad4bf21006079 authored over 4 years ago

Clean up order of parameters in initialize_context_compression.

c380273d2ea5a1fc5f532b25aa1c9eec36596ab7 authored over 4 years ago

Use secure blosc2_decompress_ctx in decompress fuzzer.

abe3c1adfbabf8751a0644aa6f97935700b356bf authored over 4 years ago

Added blosc2_compress and blosc2_decompress helper functions for easy porting.

62a12d5107e0481737f6c6d8fcd9138871ea73dd authored over 4 years ago

Check if dictionary size is zero during decompression.

b538dc05cc492c87b5c303ad96b0fd76c305f276 authored over 4 years ago

Some cleanup after PR #142

f90c05489f5c5d4335f2a5e3338f57c9e0c13e4a authored over 4 years ago

Add a note on recent API change

a944823a381b0a3cab2cca3170d8ca8e7eae5aea authored over 4 years ago

Merge pull request #144 from nmoinvaz/improvements/srcsize

Added srcsize parameter to blosc2_decompress_ctx and blosc2_getitem_ctx.

73c1a4c6a052f467dc1ad877fbc5b4788495f730 authored over 4 years ago

Merge pull request #143 from nmoinvaz/improvements/frame-doc

Minor changes to the frame document for readability.

d97b4c70f50e54a9bfb2b97eb7e5b9616d38bfc1 authored over 4 years ago

Merge pull request #142 from jinfeihan57/master

using compiler build in function

329cdad3938ecd89257597e06e95c8e458dd6ca8 authored over 4 years ago

Added srcsize parameter to blosc2_decompress_ctx and blosc2_getitem_ctx to prevent reading past the src buffer.

ff8fa1052cac4bea0a8a97d28856b422c5bfbe0b authored over 4 years ago

Minor changes to the frame document for readability.

e7bc730328c10681bce4f8daf283de8e800fca1a authored over 4 years ago

Update README.rst

8de8821d78ac0f018e14804dece7dc00be70c05f authored over 4 years ago

Updated Code of Conduct to Contributor Covenant

a79eb84ed847cc657b8f8c36fd152ad3edf02207 authored over 4 years ago

using compiler build in function

It should fast.

a7285fa867390042964bca4ef218329215051062 authored over 4 years ago

BUILD_FUZZERS require BUILD_STATIC

Fail with an explicit error if BUILD_FUZZERS is enabled without
BUILD_STATIC, and defaul...

7bfcc322c086f41df8188a493c989af21e3707d2 authored over 4 years ago

Update code variables and documentation to use compressed data streams terminology where appropriate.

2d328439f9ea58b7516bc2a8fa37892fd28fed14 authored over 4 years ago

Clarifications to chunk format document.

ccb29e32c1d1a5f4c6c884a6ce517722f2c0d5cc authored over 4 years ago

Rename distance macros to match macros for clarity.

50a7357108e5efe1e1b9c3b407d6214f7e907e00 authored over 4 years ago

add free_new path in test_frame.c

1bf1c0abb671e92d7b1d0151040292340314e130 authored over 4 years ago

Deactivate IPP by default and do not split for LZ4 at all

e120ec32f26f1152fbeaf5765e586dbb2c0efe6c authored over 4 years ago

Use const as much as possible in get_run

ff1fe3f4006a5142023a373a577fee014496cc25 authored over 4 years ago

Specify that everything is little endian

d9a951facac6e95b1a99a7f8ae569c9cff2fd4d4 authored over 4 years ago

Do not wrap comments too much

d680fd2ceedc46e2e9e886162428326815e4ee76 authored over 4 years ago

Documented the whole chunk format

f90e5aca7d8af91fcb7388fc405bdae909add8c9 authored over 4 years ago

First attempt at encoding run-lengths straight in blocks

2fe60549952b476d1229c7fe6d86e6c6e95de8d6 authored over 4 years ago

Fix the get_run function and some other small improvements

a1fb587f651137a4db7db24e97282fcb4c7f8bb0 authored over 4 years ago

Fixed heap-buffer-overflow by bounds checking output buffer when writing distances and writing beginning of next token.

385f68f17cb62a8fced7c2dcf96389a34fefd9a4 authored over 4 years ago

Attempt to execute prefilters when memcpyed flag is set

2cf4384740a7bac44bb9fa2980db03b2123febdc authored over 4 years ago

More prefilter tests and some fixes

0a5dcf3c4a4fcdb35fe0b3deff42c2fec3ea3556 authored over 4 years ago

Fix the prefilters w/out compr and with multithreading

1aff524ed9ac8044116061fc8d0dc8703955bf5e authored over 4 years ago

Give data_out buf space enough for the header

f3099e5d284ecba650feafef8339423520ddfb72 authored over 4 years ago

Delete development environment config files that might conflict with user config.

3594d03b332b2a24adbd465189c4e710ba8a1f79 authored over 4 years ago

Added check to ensure compressed byte fields are valid.

9240ce54d78c888993c0ce5ff9d43c456ea24c1c authored over 4 years ago

Added back GitHub Actions CI fuzz workflow.

This reverts commit 6d5a376f3508eb645d6f3695c3a86b043c292651.

a83f4780ccd23eee46541d5789b9be1c1f6f696c authored over 4 years ago

Fixed large malloc asan error when dictionary size is not checked.

64fd6b78baf939ef32c3bfe118f718242d0e3f4c authored over 4 years ago

Fix a warning introduced recently

ee713df5c86f7b25a0ec9fdb79447b262180c6f3 authored over 4 years ago

Rename parameter

61a9bfa195d353fa7ef5ac4ca5e79752c23e8c49 authored over 4 years ago

Make clevel 9 do a bigger effort in compression

cb01c30bcf9c4eb7b018afb6a69469f2d1dd9f6f authored over 4 years ago

Do actual floating point arithmetic

e8359dfbde3fb2ad1d79d40bc1dd959e44dcab6a authored over 4 years ago

Small refactoring in blosclz

b6df93d7890099749a4b2325a8b101b572a1ff87 authored over 4 years ago

BloscLZ version bumped to 2.3.0

d9e16cbac03cb8ce85d3c1c21a45380e317d5206 authored over 4 years ago