LMMs-Lab
We build open-sourced multimodal intelligence.
Collective -
Host: opensource -
https://opencollective.com/lmms-lab
- Code: https://github.com/EvolvingLMMs-Lab
github.com/EvolvingLMMs-Lab/Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
Stars: 3,270 - Last synced: 27 Jun 2026
github.com/EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Stars: 3,106 - Last synced: 27 Jun 2026
github.com/EvolvingLMMs-Lab/open-r1-multimodal
A fork to add multimodal model training to open-r1
Stars: 1,401 - Last synced: 27 Jun 2026
github.com/EvolvingLMMs-Lab/RelateAnything
Relate Anything Model is capable of taking an image as input and utilizing SAM to identify the corresponding mask within the image.
Stars: 456 - Last synced: 27 Jun 2026
github.com/EvolvingLMMs-Lab/LongVA
Long Context Transfer from Language to Vision
Stars: 391 - Last synced: 27 Jun 2026
github.com/EvolvingLMMs-Lab/EgoLife
[CVPR 2025] EgoLife: Towards Egocentric Life Assistant
Stars: 319 - Last synced: 23 Jul 2026
github.com/EvolvingLMMs-Lab/multimodal-search-r1
MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search tools.
Stars: 303 - Last synced: 03 Jul 2026
github.com/EvolvingLMMs-Lab/multimodal-sae
[ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
Stars: 153 - Last synced: 27 Jun 2026
github.com/EvolvingLMMs-Lab/MGPO
High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning
Stars: 49 - Last synced: 12 Jul 2026
github.com/EvolvingLMMs-Lab/sae
A framework that allows you to apply Sparse AutoEncoder on any models
Stars: 36 - Last synced: 21 Jul 2026
github.com/EvolvingLMMs-Lab/lmms-engine
Any to Any Modality Model Training Framework. Lean for research and hacking.
Stars: 18 - Last synced: 22 Jul 2026
github.com/EvolvingLMMs-Lab/lean-runner
Deploying High-Performance Lean 4 Server in One Click
Stars: 8 - Last synced: 10 Jul 2026