Chatbot Arena issues | Ecosyste.ms: OpenCollective

ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21002, 0, 0): cannot assign requested address

github.com/lm-sys/FastChat - LIUKAI0815 opened this issue 3 months ago

Llama3 Local Model

github.com/lm-sys/FastChat - sven-123 opened this issue 3 months ago

不更新了吗？

github.com/lm-sys/FastChat - a1015498799 opened this issue 3 months ago

⚔️ Arena (side-by-side) sometimes show one model as "rate-exceeded" while the other model keeps generating things.

github.com/lm-sys/FastChat - yuxi-liu-wired opened this issue 3 months ago

How to modify URLs when using third-party API

github.com/lm-sys/FastChat - ChangPingfirst opened this issue 3 months ago

【bug】KeyError: 'factor' when use Triplex

github.com/lm-sys/FastChat - ForgetThatNight opened this issue 3 months ago

Update Bard connector to use gemini_api_stream_iter

github.com/lm-sys/FastChat - asadovsky opened this pull request 3 months ago

Slower throughput with openai_server

github.com/lm-sys/FastChat - tacacs1101-debug opened this issue 3 months ago

When using sglang as the inference framework, if a word starting with "\n" appears in the stop parameter, the sglang will Missing '\n' during inference

github.com/lm-sys/FastChat - nstl-zyb opened this issue 3 months ago

Survey only

github.com/lm-sys/FastChat - lisadunlap opened this pull request 3 months ago

New leaderboard

github.com/lm-sys/FastChat - lisadunlap opened this pull request 3 months ago

Does the current project provide an interface for calculating the number of tokens for testing inference performance?

github.com/lm-sys/FastChat - tensorflowt opened this issue 3 months ago

Merged duplicate `GeminiAdapter` class definitions

github.com/lm-sys/FastChat - KangmoonSeo opened this pull request 3 months ago

Duplicate GeminiAdapter class definition found

github.com/lm-sys/FastChat - KangmoonSeo opened this issue 3 months ago

add survey link

github.com/lm-sys/FastChat - lisadunlap opened this pull request 3 months ago

Update monitor.py

github.com/lm-sys/FastChat - infwinston opened this pull request 3 months ago

Does the FastChat framework support multiple NPU reasoning? I changed the value of num_gpus to 4, but after he loads the model, it will not distribute it equally to each graphics card.

github.com/lm-sys/FastChat - xunmenglt opened this issue 3 months ago

npu 910B run fastchat + baichuan-13B: DefaultCPUAllocator: can't allocate memory

github.com/lm-sys/FastChat - GuIIWen opened this issue 3 months ago

Arena hard auto leaderboard UI

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 3 months ago

support musa backend for MooreThreads

github.com/lm-sys/FastChat - caizhi-mt opened this pull request 3 months ago

No permission to push to the branch

github.com/lm-sys/FastChat - caizhi-mt opened this issue 3 months ago

Does the FastChat model support gemma2-27b it?

github.com/lm-sys/FastChat - zhouyuustc opened this issue 4 months ago

Does MT-Bench gen_model_answer.py accept adapter weights (adapter_config.json) file as model path?

github.com/lm-sys/FastChat - RitikParkar opened this issue 4 months ago

Llama 3.1 - Wrong context length reported in `/token_check` endpoint

github.com/lm-sys/FastChat - PyroGenesis opened this issue 4 months ago

Add max-model-len argument to vllm worker

github.com/lm-sys/FastChat - aliasaria opened this pull request 4 months ago

Support Mistral-7B-Instruct-v0.3

github.com/lm-sys/FastChat - WxxShirley opened this issue 4 months ago

How to finetune mistral-7b with fastchat?

github.com/lm-sys/FastChat - Jerry-hyl opened this issue 4 months ago

Error in Gemma 2 using model_worker (probably an error in conversation.py)

github.com/lm-sys/FastChat - vikrantrathore opened this issue 4 months ago

请问是否有计划更新open_ai_server内容去兼容最新的API的输入tools、tool_choice和输出tool_calls。

github.com/lm-sys/FastChat - 6277668 opened this issue 4 months ago

"Cannot read properties of undefined (reading 'originalname')

github.com/lm-sys/FastChat - yuchubill opened this issue 4 months ago

fix: get_prompt goes wrong for Llama-2

github.com/lm-sys/FastChat - yangjunx21 opened this pull request 4 months ago

Model worker with Nvidia NIM?

github.com/lm-sys/FastChat - surak opened this issue 4 months ago

Flag preset images

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

Dealing with filtering user queries where they ask models to give their names

github.com/lm-sys/FastChat - fjiangAI opened this issue 4 months ago

Must provide either the `api_version` argument or the `OPENAI_API_VERSION` environment variable

github.com/lm-sys/FastChat - Bob199511 opened this issue 4 months ago

Openai_api_server Error: 400 status code (no body)

github.com/lm-sys/FastChat - GianlucaDeStefano opened this issue 4 months ago

[Suggest] When to support Codestral

github.com/lm-sys/FastChat - lance-maxwell opened this issue 4 months ago

added leaderboard for arena hard auto

github.com/lm-sys/FastChat - connorchenn opened this pull request 4 months ago

vllm context_len fix

github.com/lm-sys/FastChat - baoyf4244 opened this pull request 4 months ago

Merge messages error

github.com/lm-sys/FastChat - bluechanel opened this pull request 4 months ago

add a performant worker dash-infer which is specifically optimized for CPU environments

github.com/lm-sys/FastChat - yejunjin opened this pull request 4 months ago

Chatbot Arena Category Classification Script

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 4 months ago

Explicitly support GritLM

github.com/lm-sys/FastChat - janEbert opened this pull request 4 months ago

turkish data added

github.com/lm-sys/FastChat - emrecanacikgoz opened this pull request 4 months ago

[Bug]: Garbled Tokens appears in vllm generation result every time change to new LLM model

github.com/lm-sys/FastChat - Jason-csc opened this issue 4 months ago

Error reported when deploying DeepSeek-Coder-V2-Lite-Chat with latest Fastchat

github.com/lm-sys/FastChat - xierbut opened this issue 4 months ago

Error reported when deploying DeepSeek-Coder-V2-Lite-Chat with latest Fastchat

github.com/lm-sys/FastChat - xierbut opened this issue 4 months ago

How can we get our custom API-based model's rank in the leaderboard?

github.com/lm-sys/FastChat - FelixZheng1 opened this issue 4 months ago

Update monitor

github.com/lm-sys/FastChat - infwinston opened this pull request 4 months ago

Merge operation & multimodal arena

github.com/lm-sys/FastChat - infwinston opened this pull request 4 months ago

"FAILED: cpu_adam.so " when I use LoRA to train the model😭😭😭

github.com/lm-sys/FastChat - Mucalinda2436 opened this issue 4 months ago

Add logprobs support with OpenAI API chat completions

github.com/lm-sys/FastChat - BastienLeGuellec opened this pull request 4 months ago

Make logprobs accessible for chat completions with the OpenAI API

github.com/lm-sys/FastChat - BastienLeGuellec opened this pull request 4 months ago

chatglm3-6b-32k generate abnormal output like <|user|> and <|assistant|>

github.com/lm-sys/FastChat - zotM opened this issue 5 months ago

[Chatbot Arena] Add GLM-4 variants: AirX, Air and Flash

github.com/lm-sys/FastChat - EwoutH opened this issue 5 months ago

/v1/chat/completions Does not have a corresponding abort interface？

github.com/lm-sys/FastChat - xieyongshuai opened this issue 5 months ago

SHARE NOT WORKING

github.com/lm-sys/FastChat - Satvik-jain opened this issue 5 months ago

Can GPTCache be used in FastChat?

github.com/lm-sys/FastChat - 3togo opened this issue 5 months ago

Add Claude sonnet 3.5

github.com/lm-sys/FastChat - cyounkins opened this pull request 5 months ago

Add Claude 3.5 Sonnet

github.com/lm-sys/FastChat - cyounkins opened this issue 5 months ago

Use Reka Python SDK and add script for benchmarking and add send_btn

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 5 months ago

Add GPT-J 6B

github.com/lm-sys/FastChat - upintheairsheep opened this issue 5 months ago

glm4 Churn out

github.com/lm-sys/FastChat - pingyuan2016 opened this issue 5 months ago

ascend NPU how to Multiple NPUs

github.com/lm-sys/FastChat - 50785397 opened this issue 5 months ago

unable to communicate with mistral models deployed in EC2 by using gradio_webserver API

github.com/lm-sys/FastChat - kambalaashok4 opened this issue 5 months ago

how to serve Gradio app on the cloud and run inference locally

github.com/lm-sys/FastChat - ouhenio opened this issue 5 months ago

Refactor image classes, fix resizing, support SVG images, unify text and vision arena

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 5 months ago

[Feat Request] Adding 72b/110b llava to multimodal chatbot areana

github.com/lm-sys/FastChat - Luodian opened this issue 5 months ago

Fix the issue of semaphore unreleased due to internal exception

github.com/lm-sys/FastChat - StephenZKCurry opened this pull request 5 months ago

Added llm-judge support for GPT-4o

github.com/lm-sys/FastChat - danielwetzel opened this pull request 5 months ago

LLM + knowledge Graph

github.com/lm-sys/FastChat - plyu3 opened this issue 5 months ago

adapting glm-4

github.com/lm-sys/FastChat - litterGuy opened this pull request 5 months ago

Update model_adapter.py

github.com/lm-sys/FastChat - KnightLancelot opened this pull request 5 months ago

Could not find the transformer layer class to wrap in the model.

github.com/lm-sys/FastChat - Jerry-hyl opened this issue 5 months ago

prompt will always be truncated

github.com/lm-sys/FastChat - jiaoyangkuohai opened this issue 5 months ago

Update monitor.py

github.com/lm-sys/FastChat - smartdolphin opened this pull request 5 months ago

Gradio web server requires model-worker deps

github.com/lm-sys/FastChat - ketsapiwiq opened this issue 5 months ago

Fine-tuning Vicuna-7B

github.com/lm-sys/FastChat - dhruvpes opened this issue 5 months ago

Implement GLM-4 models

github.com/lm-sys/FastChat - plyu3 opened this issue 5 months ago

Fixes for vision arena to operation

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 5 months ago

Add AutoCoder LLM

github.com/lm-sys/FastChat - upintheairsheep opened this issue 5 months ago

Add Character.AI's C1.0, C1.1, C1.2

github.com/lm-sys/FastChat - upintheairsheep opened this issue 5 months ago

Add xAI Grok-1

github.com/lm-sys/FastChat - upintheairsheep opened this issue 5 months ago

Fix Semaphore release Issue in `api_generate_stream` Function of vllm_worker

github.com/lm-sys/FastChat - coolbeevip opened this pull request 5 months ago

Semaphore release Issue in api_generate_stream Function of vllm_worker

github.com/lm-sys/FastChat - coolbeevip opened this issue 5 months ago

Merge vision arena code with operation

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 5 months ago

Add support for the Korean language

github.com/lm-sys/FastChat - smartdolphin opened this issue 5 months ago

The accuracy issue of MT bench

github.com/lm-sys/FastChat - Luoqiu76 opened this issue 5 months ago

fix ranking

github.com/lm-sys/FastChat - infwinston opened this pull request 5 months ago

Where could I get the code for https://chat.lmsys.org/

github.com/lm-sys/FastChat - JunityZhan opened this issue 5 months ago

当我试图集成chatglm2-6b的时候发现如下错误

github.com/lm-sys/FastChat - moonlightnoodles opened this issue 5 months ago

how to adapting GLM4 & QWEN2 to FastChat

github.com/lm-sys/FastChat - Damonpkl opened this issue 5 months ago

FastChat Code base help

github.com/lm-sys/FastChat - Saikumarcloudangles opened this issue 5 months ago

generate Vicuna error

github.com/lm-sys/FastChat - wen020 opened this issue 5 months ago

how to submit with enter

github.com/lm-sys/FastChat - crischeng opened this issue 5 months ago

updated vqa examples

github.com/lm-sys/FastChat - lisadunlap opened this pull request 5 months ago

How does calibrating for an anchor model in `elo_analysis` affect the elo ratings and bootstrap CIs?

github.com/lm-sys/FastChat - acylam opened this issue 5 months ago

update leaderboard description

github.com/lm-sys/FastChat - infwinston opened this pull request 5 months ago

Update monitor.py

github.com/lm-sys/FastChat - infwinston opened this pull request 5 months ago

how to customize free-style LLM?

github.com/lm-sys/FastChat - jxgu1016 opened this issue 5 months ago