Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/redis/redis-benchmarks-specification

The Redis benchmarks specification describes the cross-language/tools requirements and expectations to foster performance and observability standards around redis related technologies. Members from both industry and academia, including organizations and individuals are encouraged to contribute.
https://github.com/redis/redis-benchmarks-specification

Updated command priority from latest feedback. Extended the statistics/summary of benchmarks

fcostaoliveira opened this pull request 11 days ago

Add vector db benchmark

mpozniak95 opened this pull request 2 months ago

Extended HASH, LIST, and STRING benchmarks

fcostaoliveira opened this pull request 2 months ago

[SPEC]: Add support for commands: PFCOUNT, PFMERGE

Nugine opened this issue 4 months ago

Include p99 latency tracking

fcostaoliveira opened this pull request 4 months ago

Added 142 new benchmarks focused on latency tracking (rate-limited)

fcostaoliveira opened this pull request 5 months ago

Extended HSET benchmarks to include larger field count

fcostaoliveira opened this pull request 5 months ago

Included LPOS benchmarks

fcostaoliveira opened this pull request 5 months ago

Fixed comparison ERROR on coordinator, and extended hash,bitmap, and list benchmarks

fcostaoliveira opened this pull request 5 months ago

[BUG]: ERROR --comparison-branch and --comparison-tag, --comparison-hash, --comparison-target-branch, and --comparison-target-table are mutually exclusive. Pick one...

fcostaoliveira opened this issue 5 months ago

Added ZUNION, ZUNIONSTORE, and extra ZADD benchmarks. Included SADD benchmarks with intset underlying encoding

fcostaoliveira opened this pull request 5 months ago

Added APPEND/INCRBY/INCRBYFLOAT/SETRANGE benchmarks

fcostaoliveira opened this pull request 5 months ago

Extended comparison tool and included HELLO, GEOPOS, GEORADIUS and SISMEMBER new benchmarks

fcostaoliveira opened this pull request 6 months ago

Enabled passing baseline/comparison hash and github_repo to ensure proper data filtering on compare. Removed refs/heads/ usage from builder

fcostaoliveira opened this pull request 6 months ago

Enabled running forks source built benchmarks

fcostaoliveira opened this pull request 6 months ago

Fixed src build and docker logs retrieval in case of error

fcostaoliveira opened this pull request 6 months ago

Added memtier_benchmark-3Mkeys-load-string-with-512B-values. Included 2,4,8,16,32,64 io-threads setups.

fcostaoliveira opened this pull request 6 months ago

Added version+target to the compare tool. we now have by branch, by version, and by target+version

fcostaoliveira opened this pull request 6 months ago

Fixed preload step on coordinator

fcostaoliveira opened this pull request 6 months ago

fixed restore build artifacts issue on docker hub triggering

fcostaoliveira opened this pull request 6 months ago

Added dockerhub build-variants. Added by.hash (we have by.branch, by.tag, by.hash now)

fcostaoliveira opened this pull request 6 months ago

Present detailed tables broken down by regression/improvement and full view on github and cli

fcostaoliveira opened this pull request 6 months ago

Bumping version to 0.1.208

fcostaoliveira opened this pull request 6 months ago

Fixed git_timestamp_ms usage on cli triggering (for historical/past data filling)

fcostaoliveira opened this pull request 6 months ago

Fixed coordinator filtering based upon test regexp

fcostaoliveira opened this pull request 6 months ago

github updates from cli/builder/runner. unified update messaging from github<->cli

fcostaoliveira opened this pull request 6 months ago

[BUG]: regression_comment.edit(comment_body) on coordinator should handle failed/missing comment

fcostaoliveira opened this issue 7 months ago

Enabled triggering build/benchmarks on forks

fcostaoliveira opened this pull request 7 months ago

Added compare tool to replace redisbench-admin

fcostaoliveira opened this pull request 7 months ago

Bumping version from 0.1.72 to 0.1.73

filipecosta90 opened this pull request over 1 year ago

Move temporary dir deletion to inner function, delete temp dir in skipped benchmarks

mpozniak95 opened this pull request over 1 year ago

[BUG]: ERROR reported in the debug output. Should it be labeled as INFO?

slice4e opened this issue over 1 year ago

[BUG]: Debug output reporting CRITICAL, when it should be INFO ?

slice4e opened this issue over 1 year ago

Move temporary dir deletion to inner function, delete temp dir in skipped benchmarks

mpozniak95 opened this pull request over 1 year ago

[BUG]: tmp* folders are not deleting after execution of some tests

markovamaria opened this issue over 1 year ago

Add 20k, 200k, 2mb STRING benchmarks

ofekshenawa opened this pull request over 1 year ago

[BUG]: Failures in benchmarking tests that use dataset configured in dbconfig

odidev opened this issue over 1 year ago

(in progress) Attempting to simplify and cleanup code.

slice4e opened this pull request over 1 year ago

[SPEC]: Add showing git-commit functionality on Grafana charts

markovamaria opened this issue over 1 year ago

Fixed memtier_benchmark-1key-zset-100-elements-zrangebyscore-all-elements-long-scores key and prepopulation stage

filipecosta90 opened this pull request over 1 year ago

added filtering by platform

slice4e opened this pull request over 1 year ago

Include a DECR benchmark covering embstring object

filipecosta90 opened this pull request over 1 year ago

[SPEC]: Test failures on the Linux/ARM64 platform

odidev opened this issue over 1 year ago

[BUG]: "redis-benchmark-spec" test suite failures

odidev opened this issue over 1 year ago

the command hincrby was populating more data 10 M , instead of 1M.

slice4e opened this pull request almost 2 years ago

check connection and re-connect at every iteration of the main loop

slice4e opened this pull request almost 2 years ago

fix logging level

slice4e opened this pull request almost 2 years ago

Bumping min python version to 3.8.1 and locking deps

filipecosta90 opened this pull request almost 2 years ago

Enabled arch selection on self-contained-coordinator

filipecosta90 opened this pull request almost 2 years ago

Update Readme.md to solve openssl dependency issue

filipecosta90 opened this pull request almost 2 years ago

Aligned lhash* test-files' names with name inside file

markovamaria opened this pull request almost 2 years ago

Bumping version from 0.1.69 to 0.1.70

filipecosta90 opened this pull request almost 2 years ago

Enabled defaults metrics parsing and merging

filipecosta90 opened this pull request almost 2 years ago

fixed memory reqs, since tests could fail on Sapphire Rappids

slice4e opened this pull request almost 2 years ago

Fix for TypeError in self-coordinator

markovamaria opened this pull request almost 2 years ago

[BUG]: Connection issue on biredis01

markovamaria opened this issue almost 2 years ago

[BUG]: Duplication of branch 'unstable' in "benchmarksredisio" Grafana dashboard

markovamaria opened this issue almost 2 years ago

Added --maxmemory to client runner.

filipecosta90 opened this pull request almost 2 years ago

Move getting commits by tags to separate function

markovamaria opened this pull request almost 2 years ago

updated description for mutli-exec - for issue 212

slice4e opened this pull request almost 2 years ago

changed log level from error to info - fixing issue #84

slice4e opened this pull request almost 2 years ago

Request to add functionality to retrigger testing for each specific host / host type

markovamaria opened this issue almost 2 years ago

Added conversion for str for git timestamps

markovamaria opened this pull request almost 2 years ago

Fixed memory requirements of 4 hash/list tests

slice4e opened this pull request almost 2 years ago

Updated geo benchmarks to fully saturate one primary. Include zset benchmarks with long score

filipecosta90 opened this pull request almost 2 years ago

Fix mem reqs

slice4e opened this pull request almost 2 years ago

[BUG]: memtier_benchmark-1Mkeys-hash-transactions-multi-exec-pipeline-20.yml is problematic.

slice4e opened this issue almost 2 years ago

Update timestamp conversion in client

markovamaria opened this pull request about 2 years ago

Update timestamp conversion in client

markovamaria opened this pull request about 2 years ago

[BUG]: Failure of "redis-benchmarks-spec-cli" for retriggering of CI

markovamaria opened this issue about 2 years ago

[BUG]: The load list commands increase memory footprint indefinetely.

slice4e opened this issue about 2 years ago

fixed memory requirements for load-list

slice4e opened this pull request about 2 years ago

[BUG]: ERROR The total numbers of keys in setup does not match the expected spec: 1!=0. Aborting...

zhoujie2022 opened this issue about 2 years ago

fixed the load-stream bechmarks such that the memory footprint does not keep growing.

slice4e opened this pull request about 2 years ago

[SPEC]: include LIMIT on XADD benchmarks

filipecosta90 opened this issue about 2 years ago

Test runs req memory

slice4e opened this pull request about 2 years ago

Fix memory reqs for load stream

slice4e opened this pull request about 2 years ago

[BUG]: running certain tests with --run-count > 1 causes redis server to crash due to out of memory

slice4e opened this issue about 2 years ago

Client runner: enabled oss cluster benchmarks for string (just set and get commands) benchmarks

filipecosta90 opened this pull request about 2 years ago

Enabled --cluster-mode in client runner

filipecosta90 opened this pull request about 2 years ago

Added SADD test variations discussed in redis/pull/11595

filipecosta90 opened this pull request about 2 years ago

added recommendation to use taskset for the redis server when using t…

slice4e opened this pull request about 2 years ago

fix hincrby data population to correspond to the description.

slice4e opened this pull request about 2 years ago

added support for hexists

slice4e opened this pull request about 2 years ago

[BUG]: Test case for hincrby does not correspond to description.

slice4e opened this issue about 2 years ago

modified Readme file to remove codenames and details which could chan…

slice4e opened this pull request about 2 years ago

Memtier without docker

slice4e opened this pull request about 2 years ago

Bumping version from 0.1.65 to 0.1.66

filipecosta90 opened this pull request about 2 years ago

Fixed preload with password

filipecosta90 opened this pull request about 2 years ago

Running tox using self hosted runner. maxmemory check fix on client-runner

filipecosta90 opened this pull request about 2 years ago

Updated dbconfig requests memory limit based uppon client runner checks

filipecosta90 opened this pull request about 2 years ago

Fixes tests after memtier password args

filipecosta90 opened this pull request about 2 years ago

Updated benchmark config to include resource memory usage. Checking valid memory settings upon CLI runner

filipecosta90 opened this pull request about 2 years ago

adding support to run memtier_benchmark locally without docker

slice4e opened this pull request about 2 years ago

Updated the benchmark SPEC to include command priority. Included --dry-run and --tests-priority-upper-limit in redis-benchmarks-spec-client-runner

filipecosta90 opened this pull request about 2 years ago

[BUG]: redis-benchmarks-spec-cli fails

slice4e opened this issue about 2 years ago

added support for zrevrank, zrank, zincrby and zrem

slice4e opened this pull request about 2 years ago

Fixed stats checker

filipecosta90 opened this pull request about 2 years ago

allocation of CPU resources

slice4e opened this issue about 2 years ago

Fix value bug

slice4e opened this pull request about 2 years ago