Chatbot Arena issues | Ecosyste.ms: OpenCollective

Fix asymmetrical bootstrap error for style control.

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 4 months ago

Integrate vllm Error, TypeError: top_k must be an integer, got float

github.com/lm-sys/FastChat - alanhsu777 opened this issue 4 months ago

Fix Style control Bootstrapping

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 4 months ago

Added NewYorker images back in

github.com/lm-sys/FastChat - lisadunlap opened this pull request 4 months ago

sglang_work not working on sglang v0.2.13

github.com/lm-sys/FastChat - exceedzhang opened this issue 4 months ago

is_blocking is bool

github.com/lm-sys/FastChat - tp-nan opened this issue 4 months ago

Add load test

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

Add Style Control to Chatbot Arena Leaderboard 🔥

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 4 months ago

Update monitor_md.py

github.com/lm-sys/FastChat - infwinston opened this pull request 4 months ago

Update preset images

github.com/lm-sys/FastChat - lisadunlap opened this pull request 4 months ago

Update dataset_release.md

github.com/lm-sys/FastChat - merrymercy opened this pull request 4 months ago

Version names for Command R/R+

github.com/lm-sys/FastChat - sanderland opened this pull request 4 months ago

update queue_lens on generation ends.

github.com/lm-sys/FastChat - lcw99 opened this pull request 4 months ago

Update vllm worker

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

Revert "Add max-model-len argument to vllm worker"

github.com/lm-sys/FastChat - vikrantrathore opened this pull request 4 months ago

Support Bailing model

github.com/lm-sys/FastChat - cuauty opened this issue 4 months ago

npu-910-glm4 Generated Answer Generates Other Languages or Strings

github.com/lm-sys/FastChat - Demainlip opened this issue 4 months ago

插件使用process.env读取不到环境变量

github.com/lm-sys/FastChat - blvyoucan opened this issue 4 months ago

After multiple model workers start working concurrently for the first time, requests will only be received by one of the workers.

github.com/lm-sys/FastChat - PaulX1029 opened this issue 4 months ago

Enable vision arena across all tabs

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

fix the bugs when some parameters are empty

github.com/lm-sys/FastChat - zjasper666 opened this pull request 4 months ago

Request to add [HODACHI/EZO-Humanities-9B-gemma-2-it] and [HODACHI/EZO-Common-9B-gemma-2-it] to Chatbot Arena

github.com/lm-sys/FastChat - kazuya-hodatsu-336-1 opened this issue 4 months ago

`httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)`

github.com/lm-sys/FastChat - DHaru85 opened this issue 4 months ago

AttributeError: 'GenerationConfig' object has no attribute '_eos_token_tensor'

github.com/lm-sys/FastChat - Demainlip opened this issue 4 months ago

Store the image moderation and text moderation logs

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

removed a duplicate line

github.com/lm-sys/FastChat - gpgg opened this pull request 4 months ago

Add Support for Loading Models in 4-bit Quantized Version (Fixes #1798)

github.com/lm-sys/FastChat - 02shanks opened this pull request 4 months ago

ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21002, 0, 0): cannot assign requested address

github.com/lm-sys/FastChat - LIUKAI0815 opened this issue 4 months ago

Llama3 Local Model

github.com/lm-sys/FastChat - sven-123 opened this issue 4 months ago

不更新了吗？

github.com/lm-sys/FastChat - a1015498799 opened this issue 4 months ago

⚔️ Arena (side-by-side) sometimes show one model as "rate-exceeded" while the other model keeps generating things.

github.com/lm-sys/FastChat - yuxi-liu-wired opened this issue 4 months ago

How to modify URLs when using third-party API

github.com/lm-sys/FastChat - ChangPingfirst opened this issue 4 months ago

【bug】KeyError: 'factor' when use Triplex

github.com/lm-sys/FastChat - ForgetThatNight opened this issue 5 months ago

Update Bard connector to use gemini_api_stream_iter

github.com/lm-sys/FastChat - asadovsky opened this pull request 5 months ago

Slower throughput with openai_server

github.com/lm-sys/FastChat - tacacs1101-debug opened this issue 5 months ago

When using sglang as the inference framework, if a word starting with "\n" appears in the stop parameter, the sglang will Missing '\n' during inference

github.com/lm-sys/FastChat - nstl-zyb opened this issue 5 months ago

Survey only

github.com/lm-sys/FastChat - lisadunlap opened this pull request 5 months ago

New leaderboard

github.com/lm-sys/FastChat - lisadunlap opened this pull request 5 months ago

Does the current project provide an interface for calculating the number of tokens for testing inference performance?

github.com/lm-sys/FastChat - tensorflowt opened this issue 5 months ago

Merged duplicate `GeminiAdapter` class definitions

github.com/lm-sys/FastChat - KangmoonSeo opened this pull request 5 months ago

Duplicate GeminiAdapter class definition found

github.com/lm-sys/FastChat - KangmoonSeo opened this issue 5 months ago

add survey link

github.com/lm-sys/FastChat - lisadunlap opened this pull request 5 months ago

Update monitor.py

github.com/lm-sys/FastChat - infwinston opened this pull request 5 months ago

Does the FastChat framework support multiple NPU reasoning? I changed the value of num_gpus to 4, but after he loads the model, it will not distribute it equally to each graphics card.

github.com/lm-sys/FastChat - xunmenglt opened this issue 5 months ago

npu 910B run fastchat + baichuan-13B: DefaultCPUAllocator: can't allocate memory

github.com/lm-sys/FastChat - GuIIWen opened this issue 5 months ago

Arena hard auto leaderboard UI

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 5 months ago

support musa backend for MooreThreads

github.com/lm-sys/FastChat - caizhi-mt opened this pull request 5 months ago

No permission to push to the branch

github.com/lm-sys/FastChat - caizhi-mt opened this issue 5 months ago

Does the FastChat model support gemma2-27b it?

github.com/lm-sys/FastChat - zhouyuustc opened this issue 5 months ago

Does MT-Bench gen_model_answer.py accept adapter weights (adapter_config.json) file as model path?

github.com/lm-sys/FastChat - RitikParkar opened this issue 5 months ago

Llama 3.1 - Wrong context length reported in `/token_check` endpoint

github.com/lm-sys/FastChat - PyroGenesis opened this issue 5 months ago

Add max-model-len argument to vllm worker

github.com/lm-sys/FastChat - aliasaria opened this pull request 5 months ago

Support Mistral-7B-Instruct-v0.3

github.com/lm-sys/FastChat - WxxShirley opened this issue 5 months ago

How to finetune mistral-7b with fastchat?

github.com/lm-sys/FastChat - Jerry-hyl opened this issue 5 months ago

Error in Gemma 2 using model_worker (probably an error in conversation.py)

github.com/lm-sys/FastChat - vikrantrathore opened this issue 5 months ago

请问是否有计划更新open_ai_server内容去兼容最新的API的输入tools、tool_choice和输出tool_calls。

github.com/lm-sys/FastChat - 6277668 opened this issue 5 months ago

"Cannot read properties of undefined (reading 'originalname')

github.com/lm-sys/FastChat - yuchubill opened this issue 5 months ago

fix: get_prompt goes wrong for Llama-2

github.com/lm-sys/FastChat - yangjunx21 opened this pull request 5 months ago

Model worker with Nvidia NIM?

github.com/lm-sys/FastChat - surak opened this issue 5 months ago

Flag preset images

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 5 months ago

Dealing with filtering user queries where they ask models to give their names

github.com/lm-sys/FastChat - fjiangAI opened this issue 5 months ago

Must provide either the `api_version` argument or the `OPENAI_API_VERSION` environment variable

github.com/lm-sys/FastChat - Bob199511 opened this issue 6 months ago

Openai_api_server Error: 400 status code (no body)

github.com/lm-sys/FastChat - GianlucaDeStefano opened this issue 6 months ago

[Suggest] When to support Codestral

github.com/lm-sys/FastChat - lance-maxwell opened this issue 6 months ago

added leaderboard for arena hard auto

github.com/lm-sys/FastChat - connorchenn opened this pull request 6 months ago

vllm context_len fix

github.com/lm-sys/FastChat - baoyf4244 opened this pull request 6 months ago

Merge messages error

github.com/lm-sys/FastChat - bluechanel opened this pull request 6 months ago

add a performant worker dash-infer which is specifically optimized for CPU environments

github.com/lm-sys/FastChat - yejunjin opened this pull request 6 months ago

Chatbot Arena Category Classification Script

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 6 months ago

Explicitly support GritLM

github.com/lm-sys/FastChat - janEbert opened this pull request 6 months ago

turkish data added

github.com/lm-sys/FastChat - emrecanacikgoz opened this pull request 6 months ago

[Bug]: Garbled Tokens appears in vllm generation result every time change to new LLM model

github.com/lm-sys/FastChat - Jason-csc opened this issue 6 months ago

Error reported when deploying DeepSeek-Coder-V2-Lite-Chat with latest Fastchat

github.com/lm-sys/FastChat - xierbut opened this issue 6 months ago

Error reported when deploying DeepSeek-Coder-V2-Lite-Chat with latest Fastchat

github.com/lm-sys/FastChat - xierbut opened this issue 6 months ago

How can we get our custom API-based model's rank in the leaderboard?

github.com/lm-sys/FastChat - FelixZheng1 opened this issue 6 months ago

Update monitor

github.com/lm-sys/FastChat - infwinston opened this pull request 6 months ago

Merge operation & multimodal arena

github.com/lm-sys/FastChat - infwinston opened this pull request 6 months ago

"FAILED: cpu_adam.so " when I use LoRA to train the model😭😭😭

github.com/lm-sys/FastChat - Mucalinda2436 opened this issue 6 months ago

Add logprobs support with OpenAI API chat completions

github.com/lm-sys/FastChat - BastienLeGuellec opened this pull request 6 months ago

Make logprobs accessible for chat completions with the OpenAI API

github.com/lm-sys/FastChat - BastienLeGuellec opened this pull request 6 months ago

chatglm3-6b-32k generate abnormal output like <|user|> and <|assistant|>

github.com/lm-sys/FastChat - zotM opened this issue 6 months ago

[Chatbot Arena] Add GLM-4 variants: AirX, Air and Flash

github.com/lm-sys/FastChat - EwoutH opened this issue 6 months ago

/v1/chat/completions Does not have a corresponding abort interface？

github.com/lm-sys/FastChat - xieyongshuai opened this issue 6 months ago

SHARE NOT WORKING

github.com/lm-sys/FastChat - Satvik-jain opened this issue 6 months ago

Can GPTCache be used in FastChat?

github.com/lm-sys/FastChat - 3togo opened this issue 6 months ago

Add Claude sonnet 3.5

github.com/lm-sys/FastChat - cyounkins opened this pull request 6 months ago

Add Claude 3.5 Sonnet

github.com/lm-sys/FastChat - cyounkins opened this issue 6 months ago

Use Reka Python SDK and add script for benchmarking and add send_btn

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago

Add GPT-J 6B

github.com/lm-sys/FastChat - upintheairsheep opened this issue 6 months ago

glm4 Churn out

github.com/lm-sys/FastChat - pingyuan2016 opened this issue 6 months ago

ascend NPU how to Multiple NPUs

github.com/lm-sys/FastChat - 50785397 opened this issue 6 months ago

unable to communicate with mistral models deployed in EC2 by using gradio_webserver API

github.com/lm-sys/FastChat - kambalaashok4 opened this issue 6 months ago

how to serve Gradio app on the cloud and run inference locally

github.com/lm-sys/FastChat - ouhenio opened this issue 6 months ago

Refactor image classes, fix resizing, support SVG images, unify text and vision arena

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 6 months ago

[Feat Request] Adding 72b/110b llava to multimodal chatbot areana

github.com/lm-sys/FastChat - Luodian opened this issue 6 months ago

Fix the issue of semaphore unreleased due to internal exception

github.com/lm-sys/FastChat - StephenZKCurry opened this pull request 6 months ago

Added llm-judge support for GPT-4o

github.com/lm-sys/FastChat - danielwetzel opened this pull request 6 months ago

LLM + knowledge Graph

github.com/lm-sys/FastChat - plyu3 opened this issue 6 months ago

adapting glm-4

github.com/lm-sys/FastChat - litterGuy opened this pull request 6 months ago

Update model_adapter.py

github.com/lm-sys/FastChat - KnightLancelot opened this pull request 6 months ago