Chatbot Arena issues | Ecosyste.ms: OpenCollective

Add Grok Beta and Claude 3.5 Haiku on lmarena.ai

github.com/lm-sys/FastChat - youself64github opened this issue 2 days ago

Change the default model revisions for ModelScope.

github.com/lm-sys/FastChat - lxline opened this pull request 2 days ago

Price columns

github.com/lm-sys/FastChat - Jackie-Lian opened this pull request 3 days ago

Same model comparison in ArenaHub (HUggingFace fork) lead to 3 model comparison

github.com/lm-sys/FastChat - lerignoux opened this issue 7 days ago

Update monitor.py to add two price columns

github.com/lm-sys/FastChat - Jackie-Lian opened this pull request 8 days ago

Custom Leaderboard

github.com/lm-sys/FastChat - dongyun-kim-arch opened this issue 10 days ago

vllm更新了--enable-auto-tool-choice --tool-call-parser hermes

github.com/lm-sys/FastChat - 1moye opened this issue 11 days ago

APIError: Invalid response object from API: 'Internal Server Error' (HTTP response code was 500)

github.com/lm-sys/FastChat - Barry1915 opened this issue 11 days ago

Yi Lightning model is unstable and might has network errors on lmarena.ai in some prompts

github.com/lm-sys/FastChat - youself64github opened this issue 11 days ago

Not all leaderboard elements cope good with various with of browser display area

github.com/lm-sys/FastChat - nanderer opened this issue 12 days ago

TypeError: Unexpected keyword argument 'use_beam_search' in vllm_worker

github.com/lm-sys/FastChat - jackNhat opened this issue 14 days ago

Feature/Add JAB to the arena

github.com/lm-sys/FastChat - rmontoya12 opened this pull request 14 days ago

Add conversation id to metagen request

github.com/lm-sys/FastChat - BoABC opened this pull request 15 days ago

Fix gradio web server demo error

github.com/lm-sys/FastChat - tsunghan-wu opened this pull request 17 days ago

AttributeError in Gradio Web Server: 'list' object has no attribute 'text_models'

github.com/lm-sys/FastChat - tsunghan-wu opened this issue 17 days ago

How to find voting result and create plot?

github.com/lm-sys/FastChat - dongyun-kim-arch opened this issue 18 days ago

زندگی رویایی

github.com/lm-sys/FastChat - MGG1363 opened this issue 19 days ago

changed the formatting of monitor.py

github.com/lm-sys/FastChat - yixin-huang1 opened this pull request 20 days ago

added a style control column for arena hard

github.com/lm-sys/FastChat - yixin-huang1 opened this pull request 20 days ago

Inquiry Regarding Your Paper "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena"

github.com/lm-sys/FastChat - daichi-nakatsuji opened this issue 23 days ago

Fix overview rank

github.com/lm-sys/FastChat - infwinston opened this pull request 24 days ago

Fix #3548

github.com/lm-sys/FastChat - infwinston opened this pull request 24 days ago

fix bug

github.com/lm-sys/FastChat - infwinston opened this pull request 25 days ago

fix bug

github.com/lm-sys/FastChat - infwinston opened this pull request 25 days ago

add style control delta to overall leaderboard ui

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 26 days ago

added creative writing category to category.py and config

github.com/lm-sys/FastChat - Y-A-Song opened this pull request 26 days ago

Stop button on web interface

github.com/lm-sys/FastChat - surak opened this issue 28 days ago

Fix #3548 issue with concat

github.com/lm-sys/FastChat - rmontoya12 opened this pull request about 1 month ago

TypeError: can only concatenate list (not "tuple") to list

github.com/lm-sys/FastChat - rmontoya12 opened this issue about 1 month ago

Code sync

github.com/lm-sys/FastChat - infwinston opened this pull request about 1 month ago

How to implement weight decay towards the pre-trained model?

github.com/lm-sys/FastChat - sedol1339 opened this issue about 1 month ago

Learderboard category/filter by model size

github.com/lm-sys/FastChat - Noriller opened this issue about 1 month ago

Support Bailing LLM from ALIPAY for #3487

github.com/lm-sys/FastChat - cuauty opened this pull request about 1 month ago

an issue for repeat a command

github.com/lm-sys/FastChat - Noblezhong opened this issue about 1 month ago

Add support for embedding models: Text2Vec, M3E, GTE

github.com/lm-sys/FastChat - ETZhangSX opened this pull request about 1 month ago

GLM-4 Models fails with Network Error on Chatbot Arena

github.com/lm-sys/FastChat - youself64github opened this issue about 1 month ago

Easily break the justice of judgement by asking: who are you

github.com/lm-sys/FastChat - yueliu1999 opened this issue about 1 month ago

cốt truyện của những tác phẩm của tác giả thạch lam khác gì so với các tác giả khác

github.com/lm-sys/FastChat - Rio-tt opened this issue about 1 month ago

Models registered via web ui --register file.json don't appear as available on openai server list

github.com/lm-sys/FastChat - surak opened this issue about 1 month ago

The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this architecture.

github.com/lm-sys/FastChat - kekslop opened this issue about 1 month ago

Llama 3.1 chat template has <|begin_of_text|> encoded twice

github.com/lm-sys/FastChat - horsten opened this issue about 1 month ago

Add vllm_worker support for lora_modules

github.com/lm-sys/FastChat - x22x22 opened this pull request about 2 months ago

Fix #3501 (VLLM): TypeError: top_k must be an integer, got float

github.com/lm-sys/FastChat - surak opened this pull request about 2 months ago

[Ascend] Enable support for 310p NPUs

github.com/lm-sys/FastChat - zer0py2c opened this pull request about 2 months ago

Hardcoded host localhost and port 9090 for a rate monitor

github.com/lm-sys/FastChat - surak opened this issue about 2 months ago

Running FastChat on GPTQ (and quantized) models

github.com/lm-sys/FastChat - NamburiSrinath opened this issue about 2 months ago

Add support for Writer models

github.com/lm-sys/FastChat - samjulien opened this pull request about 2 months ago

Intel ARC/IPEX: Implement new LLM optimisations & Consolidate CPU & XPU IPEX optimisation branches

github.com/lm-sys/FastChat - Steve-Tech opened this pull request about 2 months ago

Update conversation.py to be OpenAI-compatible.

github.com/lm-sys/FastChat - BabyChouSr opened this pull request about 2 months ago

Inquire about adding a new language to the category section on the Arena

github.com/lm-sys/FastChat - alielfilali01 opened this issue about 2 months ago

Vision Hard preliminary v0.0

github.com/lm-sys/FastChat - BabyChouSr opened this pull request about 2 months ago

How to use best-of-N in MT-Bench

github.com/lm-sys/FastChat - Yuancheng-Xu opened this issue about 2 months ago

Accelerate Bradley Terry MLE model fitting

github.com/lm-sys/FastChat - cthorrez opened this pull request about 2 months ago

lmarena.ai is down with 503 Service Unavailable

github.com/lm-sys/FastChat - youself64github opened this issue about 2 months ago

Update monitor_md.py to fix HF space

github.com/lm-sys/FastChat - merrymercy opened this pull request 2 months ago

GPTQ models - are they deprecated?

github.com/lm-sys/FastChat - surak opened this issue 2 months ago

Fix query params issue

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 2 months ago

Changing k=1 for 1 expert per layer

github.com/lm-sys/FastChat - NikhilNayak-debug opened this pull request 2 months ago

Expand Style Control to all category! Add UI support for style control and deprecated models.

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 2 months ago

Update preset

github.com/lm-sys/FastChat - lisadunlap opened this pull request 2 months ago

Vision categories

github.com/lm-sys/FastChat - lisadunlap opened this pull request 2 months ago

Cohere: include preamble with date

github.com/lm-sys/FastChat - mkozakov opened this pull request 2 months ago

Remove realworldVQA from presets

github.com/lm-sys/FastChat - lisadunlap opened this pull request 2 months ago

$MODERATION$ YOUR INPUT VIOLATES OUR CONTENT MODERATION GUIDELINES.

github.com/lm-sys/FastChat - upintheairsheep opened this issue 2 months ago

Reduce leaderboard header font, change scale for elo gradient

github.com/lm-sys/FastChat - lisadunlap opened this pull request 2 months ago

Towards multi-image

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 2 months ago

Onboard metagen api

github.com/lm-sys/FastChat - BoABC opened this pull request 2 months ago

Fix load test

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 2 months ago

[BUG] vllm_worker: RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

github.com/lm-sys/FastChat - quanshr opened this issue 2 months ago

Is the logprobs of fschat==0.2.36 supported now?

github.com/lm-sys/FastChat - wupaopao123 opened this issue 2 months ago

Why logistic regression is equivalent to Bradley-Terry model?

github.com/lm-sys/FastChat - VityaVitalich opened this issue 2 months ago

Update dashinfer_integration.md

github.com/lm-sys/FastChat - yanfangli85 opened this pull request 2 months ago

Some models on Chatbot Arena causes network error

github.com/lm-sys/FastChat - youself64github opened this issue 2 months ago

Fix asymmetrical bootstrap error for style control.

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 2 months ago

Integrate vllm Error, TypeError: top_k must be an integer, got float

github.com/lm-sys/FastChat - alanhsu777 opened this issue 2 months ago

Fix Style control Bootstrapping

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 2 months ago

Added NewYorker images back in

github.com/lm-sys/FastChat - lisadunlap opened this pull request 2 months ago

sglang_work not working on sglang v0.2.13

github.com/lm-sys/FastChat - exceedzhang opened this issue 2 months ago

is_blocking is bool

github.com/lm-sys/FastChat - tp-nan opened this issue 2 months ago

Add load test

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 2 months ago

Add Style Control to Chatbot Arena Leaderboard 🔥

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 2 months ago

Update monitor_md.py

github.com/lm-sys/FastChat - infwinston opened this pull request 2 months ago

Update preset images

github.com/lm-sys/FastChat - lisadunlap opened this pull request 3 months ago

Update dataset_release.md

github.com/lm-sys/FastChat - merrymercy opened this pull request 3 months ago

Version names for Command R/R+

github.com/lm-sys/FastChat - sanderland opened this pull request 3 months ago

update queue_lens on generation ends.

github.com/lm-sys/FastChat - lcw99 opened this pull request 3 months ago

Update vllm worker

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 3 months ago

Revert "Add max-model-len argument to vllm worker"

github.com/lm-sys/FastChat - vikrantrathore opened this pull request 3 months ago

Support Bailing model

github.com/lm-sys/FastChat - cuauty opened this issue 3 months ago

npu-910-glm4 Generated Answer Generates Other Languages or Strings

github.com/lm-sys/FastChat - Demainlip opened this issue 3 months ago

插件使用process.env读取不到环境变量

github.com/lm-sys/FastChat - blvyoucan opened this issue 3 months ago

After multiple model workers start working concurrently for the first time, requests will only be received by one of the workers.

github.com/lm-sys/FastChat - PaulX1029 opened this issue 3 months ago

Enable vision arena across all tabs

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 3 months ago

fix the bugs when some parameters are empty

github.com/lm-sys/FastChat - zjasper666 opened this pull request 3 months ago

Request to add [HODACHI/EZO-Humanities-9B-gemma-2-it] and [HODACHI/EZO-Common-9B-gemma-2-it] to Chatbot Arena

github.com/lm-sys/FastChat - kazuya-hodatsu-336-1 opened this issue 3 months ago

`httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)`

github.com/lm-sys/FastChat - DHaru85 opened this issue 3 months ago

AttributeError: 'GenerationConfig' object has no attribute '_eos_token_tensor'

github.com/lm-sys/FastChat - Demainlip opened this issue 3 months ago

Store the image moderation and text moderation logs

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 3 months ago

removed a duplicate line

github.com/lm-sys/FastChat - gpgg opened this pull request 3 months ago

Add Support for Loading Models in 4-bit Quantized Version (Fixes #1798)

github.com/lm-sys/FastChat - 02shanks opened this pull request 3 months ago