Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
Chatbot Arena
Chatbot Arena is an open platform for crowdsourced AI benchmarking, developed by researchers at UC Berkeley SkyLab and LMSYS.
Collective -
Host: opensource -
https://opencollective.com/chatbot-arena
- Website: https://lmarena.ai/?about
- Code: https://github.com/lm-sys/FastChat
Make Table non editable: Set interactive=False in Gradio
github.com/lm-sys/FastChat - zakuru opened this pull request 11 months ago
github.com/lm-sys/FastChat - zakuru opened this pull request 11 months ago
fix: inconsistent tokenization by llama tokenizer
github.com/lm-sys/FastChat - congchan opened this pull request 11 months ago
github.com/lm-sys/FastChat - congchan opened this pull request 11 months ago
Feat: Make the table cells read only in the Leader Board
github.com/lm-sys/FastChat - zakuru opened this issue 11 months ago
github.com/lm-sys/FastChat - zakuru opened this issue 11 months ago
Add Whole History Rating to Leaderboard?
github.com/lm-sys/FastChat - endolith opened this issue 11 months ago
github.com/lm-sys/FastChat - endolith opened this issue 11 months ago
vllm_worker will be hung after chating a while
github.com/lm-sys/FastChat - hanswang1 opened this issue 11 months ago
github.com/lm-sys/FastChat - hanswang1 opened this issue 11 months ago
Question on the Security Improvements in Vicuna-7B-v1.5
github.com/lm-sys/FastChat - jc-ryan opened this issue 11 months ago
github.com/lm-sys/FastChat - jc-ryan opened this issue 11 months ago
sglang worker raise exception in benchmark
github.com/lm-sys/FastChat - zeyugao opened this issue 11 months ago
github.com/lm-sys/FastChat - zeyugao opened this issue 11 months ago
failed to run FastChat with stable lm-zephyr-3b
github.com/lm-sys/FastChat - jasonzou opened this issue 11 months ago
github.com/lm-sys/FastChat - jasonzou opened this issue 11 months ago
How to let vllm_worker to support load-8bits?
github.com/lm-sys/FastChat - hanswang1 opened this issue 11 months ago
github.com/lm-sys/FastChat - hanswang1 opened this issue 11 months ago
Create a fine_tune_requirements.txt file
github.com/lm-sys/FastChat - Oscarjia opened this pull request 11 months ago
github.com/lm-sys/FastChat - Oscarjia opened this pull request 11 months ago
fix: tokenization mismatch when training with different templates
github.com/lm-sys/FastChat - congchan opened this pull request 11 months ago
github.com/lm-sys/FastChat - congchan opened this pull request 11 months ago
fastchat 0.2.34 incompatible with vllm 0.3.0
github.com/lm-sys/FastChat - wujingbo-web opened this issue 11 months ago
github.com/lm-sys/FastChat - wujingbo-web opened this issue 11 months ago
Incorrect Output of Umlauts in deepseek-llm-67b-chat Model
github.com/lm-sys/FastChat - maninthemiddle01 opened this issue 11 months ago
github.com/lm-sys/FastChat - maninthemiddle01 opened this issue 11 months ago
Bugs when fine-tune tiny-llama with instructions using tiny-llama's conversation template
github.com/lm-sys/FastChat - hychaochao opened this issue 11 months ago
github.com/lm-sys/FastChat - hychaochao opened this issue 11 months ago
convert sep_style to int raise ValueError in some case during base_model_worker init
github.com/lm-sys/FastChat - vincentor opened this issue 11 months ago
github.com/lm-sys/FastChat - vincentor opened this issue 11 months ago
update yuan2.0 generation
github.com/lm-sys/FastChat - wangpengfei1013 opened this pull request 11 months ago
github.com/lm-sys/FastChat - wangpengfei1013 opened this pull request 11 months ago
Wrong reference answer in MT-Bench
github.com/lm-sys/FastChat - jubgjf opened this issue 11 months ago
github.com/lm-sys/FastChat - jubgjf opened this issue 11 months ago
[Dependency] webui dependency does not work along
github.com/lm-sys/FastChat - Michaelvll opened this issue 11 months ago
github.com/lm-sys/FastChat - Michaelvll opened this issue 11 months ago
Error: Llama-2-7B-Chat-AWQ safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge
github.com/lm-sys/FastChat - zhangyilun opened this issue 11 months ago
github.com/lm-sys/FastChat - zhangyilun opened this issue 11 months ago
Fix tokenizer for vllm worker
github.com/lm-sys/FastChat - Michaelvll opened this pull request 11 months ago
github.com/lm-sys/FastChat - Michaelvll opened this pull request 11 months ago
FastChat API vs. transformers/generate speed difference
github.com/lm-sys/FastChat - mpetruc opened this issue 11 months ago
github.com/lm-sys/FastChat - mpetruc opened this issue 11 months ago
关于openAI 服务太慢的问题 Regarding the problem that openAI service is too slow
github.com/lm-sys/FastChat - shell-nlp opened this issue 11 months ago
github.com/lm-sys/FastChat - shell-nlp opened this issue 11 months ago
How to register a new model API
github.com/lm-sys/FastChat - yigediaosi opened this issue 11 months ago
github.com/lm-sys/FastChat - yigediaosi opened this issue 11 months ago
vllm_worker - Mixtral - Tokenizer points to TokenizerGroup object
github.com/lm-sys/FastChat - sudarshan-kamath opened this issue 11 months ago
github.com/lm-sys/FastChat - sudarshan-kamath opened this issue 11 months ago
The issue with model saving in train.py
github.com/lm-sys/FastChat - Kong-Aobo opened this issue 11 months ago
github.com/lm-sys/FastChat - Kong-Aobo opened this issue 11 months ago
fetch_remote needs to catch exception
github.com/lm-sys/FastChat - zhouzaida opened this pull request 11 months ago
github.com/lm-sys/FastChat - zhouzaida opened this pull request 11 months ago
use cl100k_base as the default tiktoken encoding
github.com/lm-sys/FastChat - bjwswang opened this pull request 11 months ago
github.com/lm-sys/FastChat - bjwswang opened this pull request 11 months ago
Adding download folder information in README
github.com/lm-sys/FastChat - dheeraj-326 opened this pull request 11 months ago
github.com/lm-sys/FastChat - dheeraj-326 opened this pull request 11 months ago
Anybody know what is the version of `flash_attn` used for finetune?
github.com/lm-sys/FastChat - Oscarjia opened this issue 11 months ago
github.com/lm-sys/FastChat - Oscarjia opened this issue 11 months ago
update yuan2.0 inference generation & delete some mistakes about yuan 2.0
github.com/lm-sys/FastChat - wangpengfei1013 opened this pull request 11 months ago
github.com/lm-sys/FastChat - wangpengfei1013 opened this pull request 11 months ago
Why device_map isn't passed on as kwargs when loading models?
github.com/lm-sys/FastChat - sthemeow opened this issue 12 months ago
github.com/lm-sys/FastChat - sthemeow opened this issue 12 months ago
Gradio Web Server for Multimodal Models
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 12 months ago
github.com/lm-sys/FastChat - BabyChouSr opened this pull request 12 months ago
Possibility of hiding aliases from the WEB UI but allowing it on the API endpoints
github.com/lm-sys/FastChat - surak opened this issue 12 months ago
github.com/lm-sys/FastChat - surak opened this issue 12 months ago
feat: train with template
github.com/lm-sys/FastChat - congchan opened this pull request 12 months ago
github.com/lm-sys/FastChat - congchan opened this pull request 12 months ago
OpenAI server does not work with stream: true
github.com/lm-sys/FastChat - ArchiDevil opened this issue 12 months ago
github.com/lm-sys/FastChat - ArchiDevil opened this issue 12 months ago
书⽣·浦语2.0(InternLM2) is not supported?
github.com/lm-sys/FastChat - oom2018 opened this issue 12 months ago
github.com/lm-sys/FastChat - oom2018 opened this issue 12 months ago
Inconsistency of vicuna v1.1, v1.3, v1.5 prompt
github.com/lm-sys/FastChat - kazunaritakeichi opened this issue 12 months ago
github.com/lm-sys/FastChat - kazunaritakeichi opened this issue 12 months ago
add logprobs to vllm integration
github.com/lm-sys/FastChat - aniemerg opened this pull request 12 months ago
github.com/lm-sys/FastChat - aniemerg opened this pull request 12 months ago
add openai version >= 1.0 support to llm_judge
github.com/lm-sys/FastChat - thavens opened this pull request 12 months ago
github.com/lm-sys/FastChat - thavens opened this pull request 12 months ago
How to customize conv_template in fastchat?
github.com/lm-sys/FastChat - empty2enrich opened this issue 12 months ago
github.com/lm-sys/FastChat - empty2enrich opened this issue 12 months ago
qwen-72b-chat runs in Fastchat vllm , the input has weird message that is not mine.
github.com/lm-sys/FastChat - dongxu opened this issue 12 months ago
github.com/lm-sys/FastChat - dongxu opened this issue 12 months ago
--conv-template parameter has no effect。
github.com/lm-sys/FastChat - empty2enrich opened this issue 12 months ago
github.com/lm-sys/FastChat - empty2enrich opened this issue 12 months ago
GPT-4-Vision and Gemini Vision multimodal model support?
github.com/lm-sys/FastChat - youself64github opened this issue about 1 year ago
github.com/lm-sys/FastChat - youself64github opened this issue about 1 year ago
Inconsistencies between OpenAI API and FastChat's OpenAI serving model
github.com/lm-sys/FastChat - brandonbiggs opened this issue about 1 year ago
github.com/lm-sys/FastChat - brandonbiggs opened this issue about 1 year ago
Update token spacing for mistral conversation.py
github.com/lm-sys/FastChat - thavens opened this pull request about 1 year ago
github.com/lm-sys/FastChat - thavens opened this pull request about 1 year ago
Bugs when fine-tune llama-2-7b with instructions using llama-2's conversation template
github.com/lm-sys/FastChat - YJiangcm opened this issue about 1 year ago
github.com/lm-sys/FastChat - YJiangcm opened this issue about 1 year ago
check if hm in models before deleting to avoid errors
github.com/lm-sys/FastChat - joshua-ne opened this pull request about 1 year ago
github.com/lm-sys/FastChat - joshua-ne opened this pull request about 1 year ago
Update web server commands
github.com/lm-sys/FastChat - merrymercy opened this pull request about 1 year ago
github.com/lm-sys/FastChat - merrymercy opened this pull request about 1 year ago
vllm worker becomes unresponsive after running for a long time.
github.com/lm-sys/FastChat - Future-FC opened this issue about 1 year ago
github.com/lm-sys/FastChat - Future-FC opened this issue about 1 year ago
leaderboard code update
github.com/lm-sys/FastChat - infwinston opened this pull request about 1 year ago
github.com/lm-sys/FastChat - infwinston opened this pull request about 1 year ago
support bge-reranker-large model
github.com/lm-sys/FastChat - kztao opened this issue about 1 year ago
github.com/lm-sys/FastChat - kztao opened this issue about 1 year ago
Fix the problem of not using the decoding method corresponding to the base model in peft mode
github.com/lm-sys/FastChat - Jingsong-Yan opened this pull request about 1 year ago
github.com/lm-sys/FastChat - Jingsong-Yan opened this pull request about 1 year ago
update a new sota model on MT-Bench which touch an 8.8 scores.
github.com/lm-sys/FastChat - xiechengmude opened this pull request about 1 year ago
github.com/lm-sys/FastChat - xiechengmude opened this pull request about 1 year ago
Update a new dpo-v2 trained model by xDAN-AI achieving new sota
github.com/lm-sys/FastChat - xiechengmude opened this pull request about 1 year ago
github.com/lm-sys/FastChat - xiechengmude opened this pull request about 1 year ago
Update a new dpo-v2 trained model by xDAN-AI achieving new sota scores (8.8) on MT-Bench
github.com/lm-sys/FastChat - xiechengmude opened this pull request about 1 year ago
github.com/lm-sys/FastChat - xiechengmude opened this pull request about 1 year ago
Support "Openchat 3.5 - 1210"
github.com/lm-sys/FastChat - Graveyard9988 opened this issue about 1 year ago
github.com/lm-sys/FastChat - Graveyard9988 opened this issue about 1 year ago
Modify doc description
github.com/lm-sys/FastChat - zhangsibo1129 opened this pull request about 1 year ago
github.com/lm-sys/FastChat - zhangsibo1129 opened this pull request about 1 year ago
Clean error messages
github.com/lm-sys/FastChat - merrymercy opened this pull request about 1 year ago
github.com/lm-sys/FastChat - merrymercy opened this pull request about 1 year ago
Add new models (Perplexity, gemini) & Separate GPT versions
github.com/lm-sys/FastChat - merrymercy opened this pull request about 1 year ago
github.com/lm-sys/FastChat - merrymercy opened this pull request about 1 year ago
Any plan for supporting NexusRaven-V2-13B?
github.com/lm-sys/FastChat - engchina opened this issue about 1 year ago
github.com/lm-sys/FastChat - engchina opened this issue about 1 year ago
Mixtral-8x7B-Instruct-v0.1: Chat arena vs local inference
github.com/lm-sys/FastChat - jalajthanaki opened this issue about 1 year ago
github.com/lm-sys/FastChat - jalajthanaki opened this issue about 1 year ago
Feature request: Along with accuracy benchmark, is it possible to get the throughput information for all the models on leaderboard?
github.com/lm-sys/FastChat - jalajthanaki opened this issue about 1 year ago
github.com/lm-sys/FastChat - jalajthanaki opened this issue about 1 year ago
TypeError: unsupported operand type(s) for |: 'dict' and 'dict'
github.com/lm-sys/FastChat - PhaneendraGunda opened this issue about 1 year ago
github.com/lm-sys/FastChat - PhaneendraGunda opened this issue about 1 year ago
fix: 'compeletion' typo
github.com/lm-sys/FastChat - congchan opened this pull request about 1 year ago
github.com/lm-sys/FastChat - congchan opened this pull request about 1 year ago
Add Tunnelmole as an open source alternative to ngrok and include usage instructions
github.com/lm-sys/FastChat - robbie-cahill opened this pull request about 1 year ago
github.com/lm-sys/FastChat - robbie-cahill opened this pull request about 1 year ago
vllm + chatglm3, it can't generate content as expected
github.com/lm-sys/FastChat - yaofeng opened this issue about 1 year ago
github.com/lm-sys/FastChat - yaofeng opened this issue about 1 year ago
any plan for 33b based on llama2?
github.com/lm-sys/FastChat - warvyvr opened this issue about 1 year ago
github.com/lm-sys/FastChat - warvyvr opened this issue about 1 year ago
NPU needs to be initialized when starting a new process
github.com/lm-sys/FastChat - jq460494839 opened this pull request about 1 year ago
github.com/lm-sys/FastChat - jq460494839 opened this pull request about 1 year ago
deploy with npu raise The context is empty
github.com/lm-sys/FastChat - jq460494839 opened this issue about 1 year ago
github.com/lm-sys/FastChat - jq460494839 opened this issue about 1 year ago
Add support for CatPPT
github.com/lm-sys/FastChat - rishiraj opened this pull request about 1 year ago
github.com/lm-sys/FastChat - rishiraj opened this pull request about 1 year ago
Mixtral-8x7B-Instruct-v0.1 will be officially integrated inside the fastchat codebase
github.com/lm-sys/FastChat - jalajthanaki opened this issue about 1 year ago
github.com/lm-sys/FastChat - jalajthanaki opened this issue about 1 year ago
fun:/v1/chat/completions , use "stream":"False". error ? why
github.com/lm-sys/FastChat - sjyttkl opened this issue about 1 year ago
github.com/lm-sys/FastChat - sjyttkl opened this issue about 1 year ago
prompt template for SOLAR-10.7B-Instruct-v1.0
github.com/lm-sys/FastChat - HelloCard opened this issue about 1 year ago
github.com/lm-sys/FastChat - HelloCard opened this issue about 1 year ago
mistral-8x-7b stops generating in mid
github.com/lm-sys/FastChat - tacacs1101-debug opened this issue about 1 year ago
github.com/lm-sys/FastChat - tacacs1101-debug opened this issue about 1 year ago
Add functionality to ping AI2 InferD endpoints for tulu 2
github.com/lm-sys/FastChat - natolambert opened this pull request about 1 year ago
github.com/lm-sys/FastChat - natolambert opened this pull request about 1 year ago
fastchat.serve.vllm_worker方法部署Yi-34B-Chat-4bits,实体抽取类任务 请求服务失败,内部错误
github.com/lm-sys/FastChat - houhailun opened this issue about 1 year ago
github.com/lm-sys/FastChat - houhailun opened this issue about 1 year ago
add download models from www.modelscope.cn
github.com/lm-sys/FastChat - liuyhwangyh opened this pull request about 1 year ago
github.com/lm-sys/FastChat - liuyhwangyh opened this pull request about 1 year ago
Inference using NF4 weight
github.com/lm-sys/FastChat - DevNullx64 opened this pull request about 1 year ago
github.com/lm-sys/FastChat - DevNullx64 opened this pull request about 1 year ago
Add Huggingface's apply chat template functionality
github.com/lm-sys/FastChat - BabyChouSr opened this pull request about 1 year ago
github.com/lm-sys/FastChat - BabyChouSr opened this pull request about 1 year ago