Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
Chatbot Arena
Chatbot Arena is an open platform for crowdsourced AI benchmarking, developed by researchers at UC Berkeley SkyLab and LMSYS.
Collective -
Host: opensource -
https://opencollective.com/chatbot-arena
- Website: https://lmarena.ai/?about
- Code: https://github.com/lm-sys/FastChat
Could not find the transformer layer class to wrap in the model.
github.com/lm-sys/FastChat - Jerry-hyl opened this issue 6 months ago
github.com/lm-sys/FastChat - Jerry-hyl opened this issue 6 months ago
prompt will always be truncated
github.com/lm-sys/FastChat - jiaoyangkuohai opened this issue 6 months ago
github.com/lm-sys/FastChat - jiaoyangkuohai opened this issue 6 months ago
Gradio web server requires model-worker deps
github.com/lm-sys/FastChat - ketsapiwiq opened this issue 6 months ago
github.com/lm-sys/FastChat - ketsapiwiq opened this issue 6 months ago
Fixes for vision arena to operation
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago
Add Character.AI's C1.0, C1.1, C1.2
github.com/lm-sys/FastChat - upintheairsheep opened this issue 7 months ago
github.com/lm-sys/FastChat - upintheairsheep opened this issue 7 months ago
Fix Semaphore release Issue in `api_generate_stream` Function of vllm_worker
github.com/lm-sys/FastChat - coolbeevip opened this pull request 7 months ago
github.com/lm-sys/FastChat - coolbeevip opened this pull request 7 months ago
Semaphore release Issue in api_generate_stream Function of vllm_worker
github.com/lm-sys/FastChat - coolbeevip opened this issue 7 months ago
github.com/lm-sys/FastChat - coolbeevip opened this issue 7 months ago
Merge vision arena code with operation
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
Add support for the Korean language
github.com/lm-sys/FastChat - smartdolphin opened this issue 7 months ago
github.com/lm-sys/FastChat - smartdolphin opened this issue 7 months ago
Where could I get the code for https://chat.lmsys.org/
github.com/lm-sys/FastChat - JunityZhan opened this issue 7 months ago
github.com/lm-sys/FastChat - JunityZhan opened this issue 7 months ago
当我试图集成chatglm2-6b的时候发现如下错误
github.com/lm-sys/FastChat - moonlightnoodles opened this issue 7 months ago
github.com/lm-sys/FastChat - moonlightnoodles opened this issue 7 months ago
how to adapting GLM4 & QWEN2 to FastChat
github.com/lm-sys/FastChat - Damonpkl opened this issue 7 months ago
github.com/lm-sys/FastChat - Damonpkl opened this issue 7 months ago
FastChat Code base help
github.com/lm-sys/FastChat - saikumar-cloudangles opened this issue 7 months ago
github.com/lm-sys/FastChat - saikumar-cloudangles opened this issue 7 months ago
How does calibrating for an anchor model in `elo_analysis` affect the elo ratings and bootstrap CIs?
github.com/lm-sys/FastChat - acylam opened this issue 7 months ago
github.com/lm-sys/FastChat - acylam opened this issue 7 months ago
update leaderboard description
github.com/lm-sys/FastChat - infwinston opened this pull request 7 months ago
github.com/lm-sys/FastChat - infwinston opened this pull request 7 months ago
how to customize free-style LLM?
github.com/lm-sys/FastChat - jxgu1016 opened this issue 7 months ago
github.com/lm-sys/FastChat - jxgu1016 opened this issue 7 months ago
Update sglang_worker.py to fix #3372 error launching SGLand worker
github.com/lm-sys/FastChat - vikrantrathore opened this pull request 7 months ago
github.com/lm-sys/FastChat - vikrantrathore opened this pull request 7 months ago
Error in launching SGLang model worker multiple log values
github.com/lm-sys/FastChat - vikrantrathore opened this issue 7 months ago
github.com/lm-sys/FastChat - vikrantrathore opened this issue 7 months ago
Can Azure openai GPT-4 work as judge?
github.com/lm-sys/FastChat - don-tpanic opened this issue 7 months ago
github.com/lm-sys/FastChat - don-tpanic opened this issue 7 months ago
add seed params support from vllm_worker
github.com/lm-sys/FastChat - BuxianChen opened this pull request 7 months ago
github.com/lm-sys/FastChat - BuxianChen opened this pull request 7 months ago
OpenAI API Streaming Issue Occurs with Error Code 50001
github.com/lm-sys/FastChat - coolbeevip opened this issue 7 months ago
github.com/lm-sys/FastChat - coolbeevip opened this issue 7 months ago
fastchat.serve.model_worker --port 21003 and /v1/models show nothing
github.com/lm-sys/FastChat - MarseusFu opened this issue 7 months ago
github.com/lm-sys/FastChat - MarseusFu opened this issue 7 months ago
Support s3 paths for api-endpoint-file. Add ability to edit system prompt.
github.com/lm-sys/FastChat - jonathanshen-upwork opened this pull request 7 months ago
github.com/lm-sys/FastChat - jonathanshen-upwork opened this pull request 7 months ago
Feature: Add OpenAI Usage stats when using streaming with the Chat Completions API or Completions API
github.com/lm-sys/FastChat - douxiaofeng99 opened this issue 7 months ago
github.com/lm-sys/FastChat - douxiaofeng99 opened this issue 7 months ago
Support for Phi-3 small and Phi-3 medium? Multimodal support?
github.com/lm-sys/FastChat - coder543 opened this issue 7 months ago
github.com/lm-sys/FastChat - coder543 opened this issue 7 months ago
[Bug] Single quote character `'` tripping up model generation and streaming
github.com/lm-sys/FastChat - PyroGenesis opened this issue 7 months ago
github.com/lm-sys/FastChat - PyroGenesis opened this issue 7 months ago
Unable to use streaming with the /v1/embeddings API for the CodeQwen1.5-7B model.
github.com/lm-sys/FastChat - fangx1129 opened this issue 7 months ago
github.com/lm-sys/FastChat - fangx1129 opened this issue 7 months ago
[server] migrate pydantic from v1 to v2
github.com/lm-sys/FastChat - NiuBlibing opened this pull request 7 months ago
github.com/lm-sys/FastChat - NiuBlibing opened this pull request 7 months ago
Cannot use /v1/embeddings api with BGE-M3 model
github.com/lm-sys/FastChat - chillizex opened this issue 7 months ago
github.com/lm-sys/FastChat - chillizex opened this issue 7 months ago
Made it more clear that this data will be shared publicly.
github.com/lm-sys/FastChat - upintheairsheep opened this pull request 7 months ago
github.com/lm-sys/FastChat - upintheairsheep opened this pull request 7 months ago
Support using chat template in the tokenizer and use the generation config in model for vllm and openai endpoint
github.com/lm-sys/FastChat - zeyugao opened this pull request 7 months ago
github.com/lm-sys/FastChat - zeyugao opened this pull request 7 months ago
add script for de-duplication
github.com/lm-sys/FastChat - infwinston opened this pull request 7 months ago
github.com/lm-sys/FastChat - infwinston opened this pull request 7 months ago
Cannot succesfully pull VLMs to fastchat
github.com/lm-sys/FastChat - PhilipAmadasun opened this issue 7 months ago
github.com/lm-sys/FastChat - PhilipAmadasun opened this issue 7 months ago
Error: Type object 'Dropdown' has no attribute 'update' in "qa_browser.py"
github.com/lm-sys/FastChat - tanliboy opened this issue 7 months ago
github.com/lm-sys/FastChat - tanliboy opened this issue 7 months ago
Update gradio_web_server.py
github.com/lm-sys/FastChat - lsy641 opened this pull request 7 months ago
github.com/lm-sys/FastChat - lsy641 opened this pull request 7 months ago
moderate cannot be deactivated when running api-based model
github.com/lm-sys/FastChat - lsy641 opened this issue 7 months ago
github.com/lm-sys/FastChat - lsy641 opened this issue 7 months ago
Update model_registry.py with GPT-4o
github.com/lm-sys/FastChat - Mr-Twave opened this pull request 7 months ago
github.com/lm-sys/FastChat - Mr-Twave opened this pull request 7 months ago
invalid openai api key when running "python3 -m fastchat.serve.openai_api_server --api-keys=[]"
github.com/lm-sys/FastChat - lsy641 opened this issue 7 months ago
github.com/lm-sys/FastChat - lsy641 opened this issue 7 months ago
moderation_filter bug fix in fastchat/serve/gradio_block_arena_named.py
github.com/lm-sys/FastChat - billy-inn opened this pull request 7 months ago
github.com/lm-sys/FastChat - billy-inn opened this pull request 7 months ago
Misc changes for vision arena: change log, fix image moderation
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
Added stars the vision arena
github.com/lm-sys/FastChat - lisadunlap opened this pull request 7 months ago
github.com/lm-sys/FastChat - lisadunlap opened this pull request 7 months ago
Fix models with "llama-3" in the name and update Hermes adapter
github.com/lm-sys/FastChat - teknium1 opened this pull request 7 months ago
github.com/lm-sys/FastChat - teknium1 opened this pull request 7 months ago
Update vision arena docs and fix system for test
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
[refactor] Reorganize utils
github.com/lm-sys/FastChat - suquark opened this pull request 7 months ago
github.com/lm-sys/FastChat - suquark opened this pull request 7 months ago
support more LaTeX delimiters
github.com/lm-sys/FastChat - kai01ai opened this pull request 7 months ago
github.com/lm-sys/FastChat - kai01ai opened this pull request 7 months ago
Category Hard Data Labeling Script
github.com/lm-sys/FastChat - CodingWithTim opened this pull request 7 months ago
github.com/lm-sys/FastChat - CodingWithTim opened this pull request 7 months ago
feat: support system messages for DeepSeek-V2
github.com/lm-sys/FastChat - congchan opened this pull request 7 months ago
github.com/lm-sys/FastChat - congchan opened this pull request 7 months ago
The "Send" button is greyed out after pressing "New Round" on the Arena
github.com/lm-sys/FastChat - Anixx opened this issue 7 months ago
github.com/lm-sys/FastChat - Anixx opened this issue 7 months ago
Vllm worker does not release semaphore
github.com/lm-sys/FastChat - jbding opened this issue 7 months ago
github.com/lm-sys/FastChat - jbding opened this issue 7 months ago
Add CSAM and NSFW image moderation and fix Reka logging
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 7 months ago
Can't get any available models via /v1/models
github.com/lm-sys/FastChat - MarseusFu opened this issue 8 months ago
github.com/lm-sys/FastChat - MarseusFu opened this issue 8 months ago
Support stream_options for openAI API
github.com/lm-sys/FastChat - Binyang2014 opened this issue 8 months ago
github.com/lm-sys/FastChat - Binyang2014 opened this issue 8 months ago
python3 -m fastchat.serve.model_worker --model-path meta-llama/Meta-Llama-3-8B-Instruct got | ERROR | stderr | AssertionError
github.com/lm-sys/FastChat - myrainbowandsky opened this issue 8 months ago
github.com/lm-sys/FastChat - myrainbowandsky opened this issue 8 months ago
adding TenyxChat model and flows
github.com/lm-sys/FastChat - matthew-ceravolo opened this pull request 8 months ago
github.com/lm-sys/FastChat - matthew-ceravolo opened this pull request 8 months ago
Inquiry Regarding the Release of 1k MT-Bench Dataset
github.com/lm-sys/FastChat - jerilkuriakose opened this issue 8 months ago
github.com/lm-sys/FastChat - jerilkuriakose opened this issue 8 months ago
Using FastChat UI to Compare Multiple Local LLMs
github.com/lm-sys/FastChat - soufianechami opened this issue 8 months ago
github.com/lm-sys/FastChat - soufianechami opened this issue 8 months ago
fix llama3 conversation format
github.com/lm-sys/FastChat - Nero10578 opened this pull request 8 months ago
github.com/lm-sys/FastChat - Nero10578 opened this pull request 8 months ago
fix error and support Phi-3 models
github.com/lm-sys/FastChat - renning22 opened this pull request 8 months ago
github.com/lm-sys/FastChat - renning22 opened this pull request 8 months ago
How do you consider the 'top_k' parameter when using openai_api_server to start?
github.com/lm-sys/FastChat - garyyang85 opened this issue 8 months ago
github.com/lm-sys/FastChat - garyyang85 opened this issue 8 months ago
Merged Model from Huggingface runs fine with fastchat CLI but not when using service worker
github.com/lm-sys/FastChat - heli-sdsu opened this issue 8 months ago
github.com/lm-sys/FastChat - heli-sdsu opened this issue 8 months ago
What is the system_message for llama3 model?
github.com/lm-sys/FastChat - hahmad2008 opened this issue 8 months ago
github.com/lm-sys/FastChat - hahmad2008 opened this issue 8 months ago
RayTokenizerGroupPool Adaptation?
github.com/lm-sys/FastChat - Zephyr69 opened this issue 8 months ago
github.com/lm-sys/FastChat - Zephyr69 opened this issue 8 months ago
Leaderboard mentions `GPT-3.5-Turbo-0314` but I believe it is instead `GPT-3.5-Turbo-0301`
github.com/lm-sys/FastChat - Franck-Dernoncourt opened this issue 8 months ago
github.com/lm-sys/FastChat - Franck-Dernoncourt opened this issue 8 months ago
fastchat.serve.openai_api_server doesn't work with `stream=true` parameter
github.com/lm-sys/FastChat - richginsberg opened this issue 8 months ago
github.com/lm-sys/FastChat - richginsberg opened this issue 8 months ago
problem gemini with Persian/Farsi language
github.com/lm-sys/FastChat - Rahjooyan opened this issue 8 months ago
github.com/lm-sys/FastChat - Rahjooyan opened this issue 8 months ago
Update processing code
github.com/lm-sys/FastChat - infwinston opened this pull request 8 months ago
github.com/lm-sys/FastChat - infwinston opened this pull request 8 months ago
UI Improvements: unified link color, removed link underline, made window wider
github.com/lm-sys/FastChat - lisadunlap opened this pull request 8 months ago
github.com/lm-sys/FastChat - lisadunlap opened this pull request 8 months ago
What's the version of gpt-4 of repo-provided ref answers
github.com/lm-sys/FastChat - UbeCc opened this issue 8 months ago
github.com/lm-sys/FastChat - UbeCc opened this issue 8 months ago
Create and analyze statistics about the time it takes to vote
github.com/lm-sys/FastChat - suquark opened this pull request 8 months ago
github.com/lm-sys/FastChat - suquark opened this pull request 8 months ago