Data

Tools

Indexes

Applications

Experiments

Open Collective

An open API service for software projects hosted on Open Collective.

github.com/EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
https://github.com/EvolvingLMMs-Lab/lmms-eval

pypi: lmms_eval 0.5.0
A framework for evaluating large multi-modality language models
19 versions - Latest release: 9 months ago - 3.15 thousand downloads last month
pypi: live-bench 0.0.0.dev0
Live Bench
1 version - Latest release: about 2 years ago - 10 downloads last month
pypi: lmms-eval 0.3.4
A framework for evaluating large multi-modality language models
15 versions - Latest release: about 1 year ago - 4.74 thousand downloads last month
Top 6.7% on proxy.golang.org
go: github.com/EvolvingLMMs-Lab/lmms-eval v0.4.1
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
12 versions - Latest release: 10 months ago
Top 6.7% on proxy.golang.org
go: github.com/evolvinglmms-lab/lmms-eval v0.4.1
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
12 versions - Latest release: 10 months ago