github.com/redis/redis-benchmarks-specification commits

Fixed dbconfig array version of SPEC

58a3cdae251376136d81fb8c1ad888a7bc6a49fe authored over 2 years ago by filipecosta90 <[email protected]>

++Merge branch 'main' of github.com:redis/redis-benchmarks-specification

d059e07efcdea25671b1df50a4d1cf01a4d70493 authored over 2 years ago by filipecosta90 <[email protected]>

Included development how-to on the readme (#102)

* Included development how-to on the readme

abdae4cd3189febde25886106fdad8da1fbd5444 authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

aae515f9cc07c484f982a14fc62657f6b731d38a authored over 2 years ago by filipecosta90 <[email protected]>

change the auto-remove to True, so that we dont accumulate un-used containers

a5c08cb5dced61c1fbd821bddc7c637241f82e74 authored over 2 years ago by Martin Dimitrov <[email protected]>

Merge remote-tracking branch 'redis/main' into main

442f636a6db7fc71ab75d7276d3e4fa9d19b4af7 authored over 2 years ago by Martin Dimitrov <[email protected]>

Adding --test-time to memtier_benchmark-10Mkeys-load-hash-5-fields-with-100B-values-pipeline-10.yml (#100)

* delete the stopped container by default at tear down

* fix test-time on 4 test-cases.

* ...

d89095e8ee3f4092cc3f367f1e103ee46a9cd672 authored over 2 years ago by Martin Dimitrov <[email protected]>

Re-order --preserve_temporary_client_dirs --client_aggregated_results_folder so that we can create an aggregated folder and still delete the temp files after. In addition, delete temp JSON files created by redis-benchmark (and not by memtier-benchmark)

feff069cca054bf34804cb625b11c620497aaf08 authored over 2 years ago by Martin Dimitrov <[email protected]>

adding a test-time=180 to testcase memtier_benchmark-10Mkeys-load-hash-5-fields-with-100B-values-pipeline-10.yml

90733b30cae43b0ddc2a09ad16513f06100e78c2 authored over 2 years ago by Martin Dimitrov <[email protected]>

reverting commit due to conflict with main

42f5b18c9206c0ac948b2fc22f8a69d584d0da7a authored over 2 years ago by Martin Dimitrov <[email protected]>

removed the -n parameter, since it was incompatible with --test-time and was causing the benchmark to fail

ed07f7b1e57ce47be2e0c7ef5bcfc4f924d30374 authored over 2 years ago by Martin Dimitrov <[email protected]>

Fixed 4 test-cases, which were completing too quickly (#98)

* delete the stopped container by default at tear down

* fix test-time on 4 test-cases.

Co...

2b63c5b22bae18c8645d99a80b11a9370bd6b762 authored over 2 years ago by Martin Dimitrov <[email protected]>

Merge branch 'main' into main

edfd92f63693e2e0e93ed8d66be10bc5451a6d9d authored over 2 years ago by filipe oliveira <[email protected]>

Fixed small duration benchmarks for HSET. Included 1KiB HSET variation (#99)

a31f418844a96f04421d856729ef6535f96d725b authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

7284ee1ef77fd72ead9e6d17169aebd75b719ab2 authored over 2 years ago by filipecosta90 <[email protected]>

fix test-time on 4 test-cases.

6f93554ca5b003a448664fff4a7f28137383404d authored over 2 years ago by Martin Dimitrov <[email protected]>

Bumping version from 0.1.29 to 0.1.30 (#97)

* Removed test_commands.py given it's not ready yet

* Bumping version from 0.1.29 to 0.1.30

0d5b44b1cc4cda9551f3370222e0be48563c0d54 authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

f305b920648a68510881a2a5d97fef6c9438651f authored over 2 years ago by filipecosta90 <[email protected]>

delete the stopped container by default at tear down (#96)

Co-authored-by: root <[email protected]>

773aa07626b21c239b839139b11d7e30ff8dfdd0 authored over 2 years ago by Martin Dimitrov <[email protected]>

delete the stopped container by default at tear down

662ce2be0fdfd9e0c772c75bbd2de5438254ea2e authored over 2 years ago by root <[email protected]>

Added --client_aggregated_results_folder and --preserve_temporary_client_dirs to redis-benchmarks-spec-client-runner (#95)

c5e80aa2dde65e5dd14d14a2e85efa7e494b36cf authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

31b397c7e1f6b4d46cfc932684dc71539dc0e6a9 authored over 2 years ago by filipecosta90 <[email protected]>

Extended benchmark with 9 SET datatype new benchmark (#94)

* Removed test_commands.py given it's not ready yet

* Added 11 extra STRING benchmarks

* E...

863a6474e2f0caa6d391a1d8461a02d863f7ae76 authored over 2 years ago by filipe oliveira <[email protected]>

Added 11 extra STRING benchmarks (#93)

* Removed test_commands.py given it's not ready yet

* Added 11 extra STRING benchmarks

00c556e7829ddb0b42e28dba05437b2a955fb00a authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

fcfc1af71c62e97e9b6a98208ecb47fbe0e1434a authored over 2 years ago by filipecosta90 <[email protected]>

Bumping version from 0.1.24 to 0.1.25 (#92)

* Added extra LRANGE, LPUSH, LPOP and RPOP benchmark variations (10B, 100B, and 1KiB)

* Bumpi...

263ca53b220e122cc7fe9180cea75f08239b43ae authored over 2 years ago by filipe oliveira <[email protected]>

Added extra LRANGE, LPUSH, LPOP and RPOP benchmark variations (10B, 100B, and 1KiB) (#91)

df23dc62883192ac08998f0419fc07bb08a9d925 authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

ef2f1e2831cbb933ba692fc71c2e1f365898a09a authored over 2 years ago by filipecosta90 <[email protected]>

Enabled CPU pinning on self-contained-coordinator (#90)

c20433e747da012408a0cd871f1b251e19a49c4d authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

2832612ca528c7981c0073cf8cd9163d13b0a8e0 authored over 2 years ago by filipecosta90 <[email protected]>

Enable profilers on self-contained-coordinator and bumped dependencies to the latest version (#89)

* Enable profilers on self-contained-coordinator and bumped dependencies to the latest version
...

ce34247921bcf82495e8bf42057adaa73758550e authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

db9084ac20de703079668d84e0e4de605b756f55 authored over 2 years ago by filipecosta90 <[email protected]>

Included XREAD, XADD, and ZRANGE benchmarks (#88)

* Removed test_commands.py given it's not ready yet

* Included XREAD, XADD, and ZRANGE benchm...

74197da333a59cfe19010bcd1b82550afd8efc8e authored over 2 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

0065af052b0ed152b765b365199e47a621045818 authored over 2 years ago by filipecosta90 <[email protected]>

Added memtier_benchmark-1key-zset-1M-elements-zrevrange-5-elements. Helps assessing https://github.com/redis/redis/issues/10310 (#83)

6880d6059cb179ca5b91c82900b1063767b84490 authored almost 3 years ago by filipe oliveira <[email protected]>

Merge branch 'main' of github.com:redis/redis-benchmarks-specification

a748579b248a9cbbad6b383b4fc7c1eebc3f855e authored almost 3 years ago by filipecosta90 <[email protected]>

In case of unexpected failure on process_self_contained_coordinator_stream we log it and recover (#82)

* Fixed too many values to unpack error on get_final_benchmark_config()

* Bumping redisbench-...

221ece5a77fb2c5c9a952791e77e18a7d419758a authored almost 3 years ago by filipe oliveira <[email protected]>

Removed test_commands.py given it's not ready yet

7c016f54f0fae148952eba5bb3128bad765efe45 authored almost 3 years ago by filipecosta90 <[email protected]>

Fixing reference before assingnement when we dont use all tls related files (#80)

* Fixed multiple TLS tests fail on 2nd test due to tls cert/key filenames being replaced

* Fi...

d57488209bd559cda0f92b3c11147a13c7610116 authored almost 3 years ago by filipe oliveira <[email protected]>

Fixed multiple TLS tests fail on 2nd test due to tls cert/key filenames being replaced (#79)

89082401ad3628e52d3bc3cf1f3f7a0211334b0a authored almost 3 years ago by filipe oliveira <[email protected]>

Enable TLS benchmarks on client-runner and memtier_benchmark (#77)

* Enable TLS benchmarks on client-runner and memtier_benchmark

* Fixed flake8 error

414cf8e2273917ffa28d8b8ca9abe0d629a03120 authored almost 3 years ago by filipe oliveira <[email protected]>

Added doc reference to cli benchmark runner (#76)

d8e79cecad16049192a97403d0036046e137de08 authored almost 3 years ago by filipe oliveira <[email protected]>

Extended benchmarks with LPOP, RPOP, LPUSH, HGETALL, HGET, HVALS, HKEYS, HGET commands (#75)

0f3bf3dbb2bd337999384dcc1f326e94fc134ceb authored almost 3 years ago by filipe oliveira <[email protected]>

Updated memtier docker image to use the edge component

71a7e28cd130499f02dacc00bdeca2eadfa62619 authored almost 3 years ago by filipecosta90 <[email protected]>

Fixed pipeline 10 HSET benchmarks (#74)

* Added HSET tests (with/without pipeline)

* Fixed pipeline 10 benchmarks

b657d617fef7bf27fa1aa63ff4de09d78648fc8d authored almost 3 years ago by filipe oliveira <[email protected]>

Added HSET tests (with/without pipeline) (#73)

bc89283cc763db6763882b7522011008a6155b75 authored almost 3 years ago by filipe oliveira <[email protected]>

Allow to specify a test to run on cli runner (#72)

235da2d1d336d78c25b20d8fdcb632557abf4c45 authored almost 3 years ago by filipe oliveira <[email protected]>

Added cpuset start position for client runner (#71)

6297c02e81680a36e89fafce84c7ffe536a61ea8 authored almost 3 years ago by filipe oliveira <[email protected]>

Added setup agnostic cli benchmark runner (solely client): redis-benchmarks-spec-client-runner (#70)

* [wip] WIP for cli benchmark runner (solely client)

* Bumping version from 0.1.18 to 0.1.19

0277988c999dc1ffb224d1503cc561d80526b017 authored almost 3 years ago by filipe oliveira <[email protected]>

Introduced redis-benchmark-full-suite-1Mkeys-1KiB benchmark variation (#68)

0438733500ab063ddcb76e5c64127e6bb63470e5 authored almost 3 years ago by filipe oliveira <[email protected]>

Fixed redis-benchmarks-spec-api response_data being used before assignement (#48)

* [fix] Fixed response_data being used before assignement

* [fix] Fixed response_data being u...

59214abc6d9fbdf028f8cc7c601ef73779a52c4a authored about 3 years ago by filipe oliveira <[email protected]>

[add] Enabled the property on test suite spec (to avoid exploding total variants per build) (#67)

82d8b3cf944f2c01d23910dae55c0170a30d6fdf authored about 3 years ago by filipe oliveira <[email protected]>

memtier_benchmark support + data preload (#66)

* [add] extended logging for action:trigger-benchmark

* [wip] WIP on memtier_benchmark client...

d6381210e7baecde98f5feae848dbf506232d549 authored about 3 years ago by filipe oliveira <[email protected]>

[add] extended logging for action:trigger-benchmark (#65)

f61c93851f3bc2992dfa529ea5277dd63679b6de authored about 3 years ago by filipe oliveira <[email protected]>

[fix] Fixed black-and-importing-typed-ast-ast3 (#64)

1f838ce67ff12766795481e2465fe4d96fc5078b authored about 3 years ago by filipe oliveira <[email protected]>

Fixed wrong redis dependencies building due to hdr_histogram not existing on < 6.2.X (#58)

* [fix] Fixed wrong redis dependencies building due to hdr_histogram not existing on < 6.2.X

...

e6bb99991b93a95c12d0fdf5cc2109d3b4107059 authored about 3 years ago by filipe oliveira <[email protected]>

[add] Further detailed the Benchmark Specification Request GH issue (#63)

6270f65c73ae7d7cd138fda6e2a453c22c963019 authored over 3 years ago by filipe oliveira <[email protected]>

[fix] Adjusted gh issues towards SPEC/Implementation (#62)

b298fec4c701c226dd43a9cf35e9af0aab598b78 authored over 3 years ago by filipe oliveira <[email protected]>

[add] Included Issue Bug Report GH template (#61)

a9805eb6e458fd6f267a44fbb41aefc18193fe93 authored over 3 years ago by filipe oliveira <[email protected]>

[add] Configured the GH template chooser (#60)

97088983966e34e176438ebc8c55f56fc1235d7c authored over 3 years ago by filipe oliveira <[email protected]>

[add] Included Benchmark Specification Request GH template (#59)

b4295e4c5fd9699aca7ecf4d1ba03f7924c2bce7 authored over 3 years ago by filipe oliveira <[email protected]>

[add] Enabled git version benchmark builds/runs (#54)

a11d4a865a2f34f8c05c3682a5444bdff08786f6 authored over 3 years ago by filipe oliveira <[email protected]>

[fix] Fixed redistimeseries.client error o self-contained-coordinator (#53)

0a885b54177ec6755e1f53d6036d581e2be09e38 authored over 3 years ago by filipe oliveira <[email protected]>

[fix] Fixed var unused error (#52)

fc36cdc4b16639f30459ca02743a6031739227da authored over 3 years ago by filipe oliveira <[email protected]>

[add] Updated docs to include how-to add a new benchmark platform (#51)

e11a8c8a099471ee16916e43750933a24fe3c1df authored over 3 years ago by filipe oliveira <[email protected]>

[add] Using strings to store the binaries produced by tooling (#50)

* [add] Using strings to store the binaries produced by tooling

* Bumping version from 0.1.12...

5334ed5cf59a01b1a4a675c4c89387bef8bb7a25 authored over 3 years ago by filipe oliveira <[email protected]>

Moved from gh action API to gh webhook API (#49)

* [add] Moved from gh action API to gh webhook API

* [add] Further logging on API. Using PULL...

464483f25b3ce2993e15ab22299a1989d1b87d1a authored over 3 years ago by filipe oliveira <[email protected]>

[add] Updated authors to include Redis Performance Group (#47)

28b86a57b182cfdbdf15321ca3b85f892eb23b6b authored over 3 years ago by filipe oliveira <[email protected]>

[fix] Fixed response_data being used before assignement (#45)

3c5b88b708b45182edf707f7bb4ee0df4e297aa1 authored over 3 years ago by filipe oliveira <[email protected]>

[fix] Fixed docker images unecessary prefetching from hub (#44)

* [fix] Fixed docker images unecessary prefetching from hub

* [ver] Bumping version from 0.1....

11f11a82c8173cab6e30ab454ffe4b418148ca08 authored over 3 years ago by filipe oliveira <[email protected]>

[add] Introduce health_check_interval, socket_connect_timeout, and socket_keepalive settings to Redis connections (#40)

* [add] Introduce health_check_interval, socket_connect_timeout, and socket_keepalive settings t...

e2d3bdfe44847b11aae269978f4a9a9f43c3ee5c authored over 3 years ago by filipe oliveira <[email protected]>

[add] Added redis-benchmarks-spec-cli trigger tool; Enabling historical data benchmarks triggering (#38)

* [add] Added redis-benchmarks-spec-cli trigger tool

* [fix] only checking test_get_commit_di...

8843cb3321bbe3e82fde51b46e1789cf0e634235 authored over 3 years ago by filipe oliveira <[email protected]>

[add] Add per test_name sets for visualization: arch, os, branch, deployment_type (#33)

813d65c4666b691ffcead6555802585f7e3974a5 authored over 3 years ago by filipe oliveira <[email protected]>

[docs] Updated Readme with the proper internal ref links. (#30)

489e9dff23bca5a99302a7fccf4f6ed0e6d300bf authored over 3 years ago by filipe oliveira <[email protected]>

[fix] consumer groups for self-contained-coordinator should be broken by running_platform; [fix] SETS for testcases:build_variants, platforms, testcases:metric_context_path are missing (#29)

d26a3f545afca5f220dfdd98545e88232d8dab1f authored over 3 years ago by filipe oliveira <[email protected]>

[fix] fixed xack builder check on str vs int (#26)

5cdebfd104cf4b8e416bd0d533fe9a61076b026e authored over 3 years ago by filipe oliveira <[email protected]>

[fix] Fixed tool-builder non blocking on event stream (#24)

29d72276fa0500a54f0144a5ed59951342183cd4 authored over 3 years ago by filipe oliveira <[email protected]>

[add] Updated Readme spec status/tooling reference (#22)

c4af82b8c12cf612ce8888785a8c2470d3a625a2 authored over 3 years ago by filipe oliveira <[email protected]>

[fix] Added platform runner info to datasink; [fix] Added metadata info to datasink; [fix] each build variant is now associated with the proper time-serie in datasink (#21)

e91dde200aef8b903d38d615d94416b354a09191 authored over 3 years ago by filipe oliveira <[email protected]>

Enabled datasink (redistimeseries) on self-contained-coordinator tool (#16)

* [add] Enabled datasink (redistimeseries) on self-contained-coordinator tool. Included testing ...

0aa9a53a41612fcbdfad747c8c4805363faf8fa1 authored over 3 years ago by filipe oliveira <[email protected]>

Increased API and builder spec implementation testing (#15)

* [add] Increased API and builder spec implementation testing

* [fix] Fixed wrong version assert

c6f86a789c205d96f8298235fbebdfee5f2efba3 authored over 3 years ago by filipe oliveira <[email protected]>

Bumping version from 0.1.1 to 0.1.2 (#13)

c669604a46031e9ea2dcb43aeb7c2a5b8f61dab8 authored over 3 years ago by filipe oliveira <[email protected]>

Triggering Publish to PyPi on release edit (#12)

* Bumping version from 0.1.0 to 0.1.1

* Triggering Publish to PyPi on release edit

b4f7f4dda40debe3cf37bdf5b323a5034b06de68 authored over 3 years ago by filipe oliveira <[email protected]>

Bumping version from 0.1.0 to 0.1.1 (#11)

9eda286df47f95d892155e6a3211d4a6cb229d39 authored over 3 years ago by filipe oliveira <[email protected]>

Fixed wrong package dir on spec builder (#10)

* [add] Improved package description and badges

* [fix] Fixed wrong package dir on spec builder

b9fb93a5fb0677f430c75a33e2431f407d1b683c authored over 3 years ago by filipe oliveira <[email protected]>

[add] Improved package description and badges (#8)

12e3500b4b77471fad259f8144d610bdc3fbf34e authored over 3 years ago by filipe oliveira <[email protected]>

[add] Further improved release draft with per component status (#7)

d1a0a4dc915c668858e7b226131f4016e8cd4da9 authored over 3 years ago by filipe oliveira <[email protected]>

[add] Further improved release draft with per component status (#6)

* [fix] enabling release drafter/ci tests on main/master branch pushes

* [add] Further improv...

8d2f5a6b1c7e52cb8bd1f8fd1a07934edb461220 authored over 3 years ago by filipe oliveira <[email protected]>

[fix] enabling release drafter/ci tests on main/master branch pushes (#5)

81b701514d471d6af9f0770cc3c929c91ac15661 authored over 3 years ago by filipe oliveira <[email protected]>

[DRAFT] self-contained-coordinator 1st working draft (#4)

* [DRAFT] self-contained-coordinator 1st working draft

* [fix] Fixed missing dev dependencies...

319be60ee722b6979740d69225b3543e9511a578 authored over 3 years ago by filipe oliveira <[email protected]>

self-contained-coordinator kickoff and package reorg (#3)

* self-contained-coordinator kickoff and package reorg

acf246511ea4f46e595f9f5ba54dc6f550f1d105 authored over 3 years ago by filipe oliveira <[email protected]>

[add] binding api to 0.0.0.0 by default

014e8715593116a8bc4781a53f991e3d2195616d authored over 3 years ago by filipecosta90 <[email protected]>

[add] logging info about used redis connections

995cfb185b8ca258aca0020087154a98bfaed430 authored over 3 years ago by filipecosta90 <[email protected]>

Merge pull request #2 from filipecosta90/api.kickoff

/api/gh/redis/redis/commits app first working version

b902550f4b2b6ea4ae06252a3c385c5638d84a3f authored over 3 years ago by filipe oliveira <[email protected]>

api app first working version

0d506e0a0d31b5d939789e7109cfd6d3c7a94567 authored over 3 years ago by filipecosta90 <[email protected]>

Merge pull request #1 from filipecosta90/arch.diagram

Included simplified arch diagram

24cdc821a16f721f872125829b708a9683792b10 authored over 3 years ago by filipe oliveira <[email protected]>

Minor typo fix on main Readme

d66b4f24c4d5172738d9021ad1e994612d55f411 authored over 3 years ago by filipecosta90 <[email protected]>

Included simplified arch diagram

1f069e721d71ed094f581a2d1d9e0c5f0a28826c authored over 3 years ago by filipecosta90 <[email protected]>

Initial commit

5c60ffa756b57188aab5d81b819ac22b7ebd4550 authored over 3 years ago by filipecosta90 <[email protected]>

Initial commit

2320ebf077c013577055df2ddf871688096217ba authored over 3 years ago by filipe oliveira <[email protected]>

Ecosyste.ms: OpenCollective

github.com/redis/redis-benchmarks-specification