Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

Chatbot Arena

Chatbot Arena is an open platform for evaluating frontier AI models by human preference, developed by members at LMSYS & UC Berkeley.
Collective - Host: opensource - https://opencollective.com/chatbot-arena - Website: https://chat.lmsys.org/?about - Code: https://github.com/lm-sys/FastChat

Update sglang_worker.py to fix #3372 error launching SGLand worker

github.com/lm-sys/FastChat - vikrantrathore opened this pull request 5 months ago
Error in launching SGLang model worker multiple log values

github.com/lm-sys/FastChat - vikrantrathore opened this issue 5 months ago
Can Azure openai GPT-4 work as judge?

github.com/lm-sys/FastChat - don-tpanic opened this issue 5 months ago
add seed params support from vllm_worker

github.com/lm-sys/FastChat - BuxianChen opened this pull request 5 months ago
Does it support Qwen1.5?

github.com/lm-sys/FastChat - balala-s opened this issue 5 months ago
gguf

github.com/lm-sys/FastChat - Jeffhop opened this issue 5 months ago
OpenAI API Streaming Issue Occurs with Error Code 50001

github.com/lm-sys/FastChat - coolbeevip opened this issue 5 months ago
Incompatible OpenAI

github.com/lm-sys/FastChat - coolbeevip opened this issue 5 months ago
fastchat.serve.model_worker --port 21003 and /v1/models show nothing

github.com/lm-sys/FastChat - MarseusFu opened this issue 5 months ago
Update monitor.py

github.com/lm-sys/FastChat - infwinston opened this pull request 5 months ago
spring ai的集成

github.com/lm-sys/FastChat - cookiespiggy opened this issue 6 months ago
Support s3 paths for api-endpoint-file. Add ability to edit system prompt.

github.com/lm-sys/FastChat - jonathanshen-upwork opened this pull request 6 months ago
Update time analysis

github.com/lm-sys/FastChat - suquark opened this pull request 6 months ago
Feature: Add OpenAI Usage stats when using streaming with the Chat Completions API or Completions API

github.com/lm-sys/FastChat - douxiaofeng99 opened this issue 6 months ago
Support for Phi-3 small and Phi-3 medium? Multimodal support?

github.com/lm-sys/FastChat - coder543 opened this issue 6 months ago
[Bug] Single quote character `'` tripping up model generation and streaming

github.com/lm-sys/FastChat - PyroGenesis opened this issue 6 months ago
Unable to use streaming with the /v1/embeddings API for the CodeQwen1.5-7B model.

github.com/lm-sys/FastChat - fangx1129 opened this issue 6 months ago
[server] migrate pydantic from v1 to v2

github.com/lm-sys/FastChat - NiuBlibing opened this pull request 6 months ago
Cannot use /v1/embeddings api with BGE-M3 model

github.com/lm-sys/FastChat - chillizex opened this issue 6 months ago
[WIP] cleanup

github.com/lm-sys/FastChat - suquark opened this pull request 6 months ago
New dataset release?

github.com/lm-sys/FastChat - upintheairsheep opened this issue 6 months ago
Made it more clear that this data will be shared publicly.

github.com/lm-sys/FastChat - upintheairsheep opened this pull request 6 months ago
Support using chat template in the tokenizer and use the generation config in model for vllm and openai endpoint

github.com/lm-sys/FastChat - zeyugao opened this pull request 6 months ago
add script for de-duplication

github.com/lm-sys/FastChat - infwinston opened this pull request 6 months ago
Update monitor.py

github.com/lm-sys/FastChat - infwinston opened this pull request 6 months ago
Cannot succesfully pull VLMs to fastchat

github.com/lm-sys/FastChat - PhilipAmadasun opened this issue 6 months ago
Error: Type object 'Dropdown' has no attribute 'update' in "qa_browser.py"

github.com/lm-sys/FastChat - tanliboy opened this issue 6 months ago
Update gradio_web_server.py

github.com/lm-sys/FastChat - lsy641 opened this pull request 6 months ago
moderate cannot be deactivated when running api-based model

github.com/lm-sys/FastChat - lsy641 opened this issue 6 months ago
Update model_registry.py with GPT-4o

github.com/lm-sys/FastChat - Mr-Twave opened this pull request 6 months ago
invalid openai api key when running "python3 -m fastchat.serve.openai_api_server --api-keys=[]"

github.com/lm-sys/FastChat - lsy641 opened this issue 6 months ago
moderation_filter bug fix in fastchat/serve/gradio_block_arena_named.py

github.com/lm-sys/FastChat - billy-inn opened this pull request 6 months ago
Misc changes for vision arena: change log, fix image moderation

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago
Add UI changes

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago
Added stars the vision arena

github.com/lm-sys/FastChat - lisadunlap opened this pull request 6 months ago
Fix models with "llama-3" in the name and update Hermes adapter

github.com/lm-sys/FastChat - teknium1 opened this pull request 6 months ago
Update vision arena docs and fix system for test

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago
[refactor] Reorganize utils

github.com/lm-sys/FastChat - suquark opened this pull request 6 months ago
support more LaTeX delimiters

github.com/lm-sys/FastChat - kai01ai opened this pull request 6 months ago
Category Hard Data Labeling Script

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 6 months ago
火针

github.com/lm-sys/FastChat - xiaogaowa opened this issue 6 months ago
feat: support system messages for DeepSeek-V2

github.com/lm-sys/FastChat - congchan opened this pull request 6 months ago
The "Send" button is greyed out after pressing "New Round" on the Arena

github.com/lm-sys/FastChat - Anixx opened this issue 6 months ago
update vllm_worker.py

github.com/lm-sys/FastChat - jbding opened this pull request 6 months ago
Main

github.com/lm-sys/FastChat - jbding opened this pull request 6 months ago
Vllm worker does not release semaphore

github.com/lm-sys/FastChat - jbding opened this issue 6 months ago
Add CSAM and NSFW image moderation and fix Reka logging

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago
Update inference.py

github.com/lm-sys/FastChat - angelala00 opened this pull request 6 months ago
Can't get any available models via /v1/models

github.com/lm-sys/FastChat - MarseusFu opened this issue 6 months ago
Support stream_options for openAI API

github.com/lm-sys/FastChat - Binyang2014 opened this issue 6 months ago
python3 -m fastchat.serve.model_worker --model-path meta-llama/Meta-Llama-3-8B-Instruct got | ERROR | stderr | AssertionError

github.com/lm-sys/FastChat - myrainbowandsky opened this issue 6 months ago
adding TenyxChat model and flows

github.com/lm-sys/FastChat - matthew-ceravolo opened this pull request 6 months ago
Inquiry Regarding the Release of 1k MT-Bench Dataset

github.com/lm-sys/FastChat - jerilkuriakose opened this issue 6 months ago
Using FastChat UI to Compare Multiple Local LLMs

github.com/lm-sys/FastChat - soufianechami opened this issue 6 months ago
fix llama3 conversation format

github.com/lm-sys/FastChat - Nero10578 opened this pull request 6 months ago
fix error and support Phi-3 models

github.com/lm-sys/FastChat - renning22 opened this pull request 6 months ago
new release?

github.com/lm-sys/FastChat - lnguyen opened this issue 6 months ago
How do you consider the 'top_k' parameter when using openai_api_server to start?

github.com/lm-sys/FastChat - garyyang85 opened this issue 6 months ago
Merged Model from Huggingface runs fine with fastchat CLI but not when using service worker

github.com/lm-sys/FastChat - heli-sdsu opened this issue 6 months ago
What is the system_message for llama3 model?

github.com/lm-sys/FastChat - hahmad2008 opened this issue 6 months ago
Please add new model taide

github.com/lm-sys/FastChat - keyang556 opened this issue 6 months ago
RayTokenizerGroupPool Adaptation?

github.com/lm-sys/FastChat - Zephyr69 opened this issue 6 months ago
Leaderboard mentions `GPT-3.5-Turbo-0314` but I believe it is instead `GPT-3.5-Turbo-0301`

github.com/lm-sys/FastChat - Franck-Dernoncourt opened this issue 6 months ago
how to fine-tune llama3?

github.com/lm-sys/FastChat - meet-cjli opened this issue 6 months ago
Gpt2

github.com/lm-sys/FastChat - 12368w opened this issue 6 months ago
Opus and SVG

github.com/lm-sys/FastChat - MartinPuda opened this issue 6 months ago
fastchat.serve.openai_api_server doesn't work with `stream=true` parameter

github.com/lm-sys/FastChat - richginsberg opened this issue 6 months ago
problem gemini with Persian/Farsi language

github.com/lm-sys/FastChat - Rahjooyan opened this issue 6 months ago
Update processing code

github.com/lm-sys/FastChat - infwinston opened this pull request 6 months ago
Update monitor.py

github.com/lm-sys/FastChat - infwinston opened this pull request 6 months ago
UI Improvements: unified link color, removed link underline, made window wider

github.com/lm-sys/FastChat - lisadunlap opened this pull request 6 months ago
What's the version of gpt-4 of repo-provided ref answers

github.com/lm-sys/FastChat - UbeCc opened this issue 6 months ago
Create and analyze statistics about the time it takes to vote

github.com/lm-sys/FastChat - suquark opened this pull request 6 months ago
Fix port in worker-address in vllm_worker for #2467

github.com/lm-sys/FastChat - yaqiangsun opened this pull request 6 months ago
stream mode error

github.com/lm-sys/FastChat - day9011 opened this issue 6 months ago
[WIP] Image arena moderation

github.com/lm-sys/FastChat - lisadunlap opened this pull request 6 months ago
Add Multimodal Textbox

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago
What is gpt2-chatbot

github.com/lm-sys/FastChat - fakerybakery opened this issue 6 months ago
Leaderboard's Knowledge cutoff format

github.com/lm-sys/FastChat - TechShooter opened this issue 6 months ago
Arena Error - probabilities contain NaN

github.com/lm-sys/FastChat - SuperSecureHuman opened this issue 6 months ago
Error running fastchat.serve.cli ( "safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge" )

github.com/lm-sys/FastChat - Vinooj opened this issue 6 months ago
This problem occurs intermittently, what could be the reason?

github.com/lm-sys/FastChat - cc2017111 opened this issue 6 months ago
[WIP] Fixed Leaderboard dropdown bug and update theme

github.com/lm-sys/FastChat - lisadunlap opened this pull request 6 months ago
[Non-Urgent] Remove Emoji from Leaderboard

github.com/lm-sys/FastChat - HuanzhiMao opened this issue 6 months ago
Support llama3 fine-tune

github.com/lm-sys/FastChat - MrZhengXin opened this pull request 7 months ago
Support Llama-3 fine-tune

github.com/lm-sys/FastChat - MrZhengXin opened this pull request 7 months ago
added mirroring to hf leaderboard

github.com/lm-sys/FastChat - lisadunlap opened this pull request 7 months ago
code update

github.com/lm-sys/FastChat - infwinston opened this pull request 7 months ago
Small fix in clean_chat_data

github.com/lm-sys/FastChat - Ying1123 opened this pull request 7 months ago
Load LoRA for inference

github.com/lm-sys/FastChat - shuishu opened this issue 7 months ago
deepseek-coder-33b-instruct model with openai got "InvalidChunkLength" error

github.com/lm-sys/FastChat - garyyang85 opened this issue 7 months ago
Update gen_model_answer.py

github.com/lm-sys/FastChat - elyhahami18 opened this pull request 7 months ago
why I cant get_conv_template of llama3

github.com/lm-sys/FastChat - AII6 opened this issue 7 months ago
Solve the compatibility problem of SeparatorStyle.CHATML type messes …

github.com/lm-sys/FastChat - icowan opened this pull request 7 months ago
MT-bench (llm_judge) error with Llama3: <class 'openai.error.InvalidRequestError'> This model's maximum context length is 8192 tokens

github.com/lm-sys/FastChat - JianbangZ opened this issue 7 months ago
Solve the compatibility problem of SeparatorStyle.CHATML type messes field

github.com/lm-sys/FastChat - icowan opened this pull request 7 months ago
New questions

github.com/lm-sys/FastChat - rkhazh opened this pull request 7 months ago
Add Japanese for the category

github.com/lm-sys/FastChat - Yuto-24 opened this issue 7 months ago
Question on Continuous Batching Feature in VLLM Worker

github.com/lm-sys/FastChat - un-certainty opened this issue 7 months ago
Fix web launch bug

github.com/lm-sys/FastChat - lvzii opened this pull request 7 months ago