github.com/lm-sys/FastChat issues | Ecosyste.ms: OpenCollective

Add pricing json file

sophie200 opened this pull request 20 days ago

Refusal Leaderboard Revamp

derixu opened this pull request 21 days ago

Specify ASCEND NPU for inference.

as12138 opened this pull request 23 days ago

Direct link to Leaderboard

abitrolly opened this issue 23 days ago

Fix theme

aangelopoulos opened this pull request 25 days ago

Add Data Explorer Tab

ygtangg opened this pull request 26 days ago

Version compatibility problem

wyhfc123 opened this issue 26 days ago

Obnoxious "Connection Errored Out"s

JackorSeventhen opened this issue 29 days ago

garbled text generation on Mac

GPTLocalhost opened this issue about 1 month ago

Update load test, use threads instead of asyncio

BabyChouSr opened this pull request about 1 month ago

Update monitor.py

infwinston opened this pull request about 1 month ago

Connect call failed ('127.0.0.1', 21002)

changdazhou opened this issue about 1 month ago

The multimodal arena human preference dataset will be released?

WangRongsheng opened this issue about 1 month ago

Japanize

hkiyomaru opened this pull request about 1 month ago

Claude 3.5 Haiku, Mistral Large 24.11 and Pixtral 124-B

Rahjooyan opened this issue about 1 month ago

Gemini Exp 1114 cutoff date

I-I-IT opened this issue about 1 month ago

Sharing new model

notlober opened this issue about 1 month ago

Aborted

digitsisyph opened this pull request about 1 month ago

fix doc to make command consistent

CodingWithTim opened this pull request about 1 month ago

Add Copilot Arena leaderboard

adityamittal13 opened this pull request about 1 month ago

Dataset: timestamp

discardcod opened this issue about 1 month ago

What is the version of gradio?

TracyGuo2001 opened this issue about 1 month ago

Add Chatbot Arena Web Server Documentation and Fix Latex Display

CodingWithTim opened this pull request about 1 month ago

Feature request: only show open-source models

I-I-IT opened this issue about 1 month ago

Improve website display about latex character

xzlosats111 opened this issue about 1 month ago

Multi agent

mihranmiroyan opened this pull request about 1 month ago

Clean Upvote and Downvote data

CodingWithTim opened this pull request about 1 month ago

Add Grok Beta and Claude 3.5 Haiku on lmarena.ai

youself64github opened this issue about 1 month ago

Change the default model revisions for ModelScope.

lxline opened this pull request about 2 months ago

Price columns

Jackie-Lian opened this pull request about 2 months ago

Same model comparison in ArenaHub (HUggingFace fork) lead to 3 model comparison

lerignoux opened this issue about 2 months ago

Update monitor.py to add two price columns

Jackie-Lian opened this pull request about 2 months ago

Custom Leaderboard

dongyun-kim-arch opened this issue about 2 months ago

vllm更新了--enable-auto-tool-choice --tool-call-parser hermes

1moye opened this issue about 2 months ago

APIError: Invalid response object from API: 'Internal Server Error' (HTTP response code was 500)

Barry1915 opened this issue about 2 months ago

Yi Lightning model is unstable and might has network errors on lmarena.ai in some prompts

youself64github opened this issue about 2 months ago

Not all leaderboard elements cope good with various with of browser display area

nanderer opened this issue about 2 months ago

TypeError: Unexpected keyword argument 'use_beam_search' in vllm_worker

jackNhat opened this issue about 2 months ago

Feature/Add JAB to the arena

rmontoya12 opened this pull request about 2 months ago

Add conversation id to metagen request

BoABC opened this pull request about 2 months ago

Fix gradio web server demo error

tsunghan-wu opened this pull request about 2 months ago

AttributeError in Gradio Web Server: 'list' object has no attribute 'text_models'

tsunghan-wu opened this issue about 2 months ago

How to find voting result and create plot?

dongyun-kim-arch opened this issue 2 months ago

زندگی رویایی

MGG1363 opened this issue 2 months ago

changed the formatting of monitor.py

yixin-huang1 opened this pull request 2 months ago

added a style control column for arena hard

yixin-huang1 opened this pull request 2 months ago

Inquiry Regarding Your Paper "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena"

daichi-nakatsuji opened this issue 2 months ago

Fix overview rank

infwinston opened this pull request 2 months ago

Fix #3548

infwinston opened this pull request 2 months ago

fix bug

infwinston opened this pull request 2 months ago

fix bug

infwinston opened this pull request 2 months ago

add style control delta to overall leaderboard ui

CodingWithTim opened this pull request 2 months ago

added creative writing category to category.py and config

Y-A-Song opened this pull request 2 months ago

Stop button on web interface

surak opened this issue 2 months ago

Fix #3548 issue with concat

rmontoya12 opened this pull request 2 months ago

TypeError: can only concatenate list (not "tuple") to list

rmontoya12 opened this issue 2 months ago

Code sync

infwinston opened this pull request 3 months ago

How to implement weight decay towards the pre-trained model?

sedol1339 opened this issue 3 months ago

Learderboard category/filter by model size

Noriller opened this issue 3 months ago

Support Bailing LLM from ALIPAY for #3487

cuauty opened this pull request 3 months ago

an issue for repeat a command

Noblezhong opened this issue 3 months ago

Add support for embedding models: Text2Vec, M3E, GTE

ETZhangSX opened this pull request 3 months ago

GLM-4 Models fails with Network Error on Chatbot Arena

youself64github opened this issue 3 months ago

Easily break the justice of judgement by asking: who are you

yueliu1999 opened this issue 3 months ago

cốt truyện của những tác phẩm của tác giả thạch lam khác gì so với các tác giả khác

Rio-tt opened this issue 3 months ago

Models registered via web ui --register file.json don't appear as available on openai server list

surak opened this issue 3 months ago

The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this architecture.

kekslop opened this issue 3 months ago

Llama 3.1 chat template has <|begin_of_text|> encoded twice

horsten opened this issue 3 months ago

Add vllm_worker support for lora_modules

x22x22 opened this pull request 3 months ago

Fix #3501 (VLLM): TypeError: top_k must be an integer, got float

surak opened this pull request 3 months ago

[Ascend] Enable support for 310p NPUs

zer0py2c opened this pull request 3 months ago

Hardcoded host localhost and port 9090 for a rate monitor

surak opened this issue 3 months ago

Running FastChat on GPTQ (and quantized) models

NamburiSrinath opened this issue 3 months ago

Add support for Writer models

samjulien opened this pull request 3 months ago

Intel ARC/IPEX: Implement new LLM optimisations & Consolidate CPU & XPU IPEX optimisation branches

Steve-Tech opened this pull request 3 months ago

Update conversation.py to be OpenAI-compatible.

BabyChouSr opened this pull request 3 months ago

Inquire about adding a new language to the category section on the Arena

alielfilali01 opened this issue 3 months ago

Vision Hard preliminary v0.0

BabyChouSr opened this pull request 3 months ago

How to use best-of-N in MT-Bench

Yuancheng-Xu opened this issue 3 months ago

Accelerate Bradley Terry MLE model fitting

cthorrez opened this pull request 3 months ago

lmarena.ai is down with 503 Service Unavailable

youself64github opened this issue 3 months ago

Update monitor_md.py to fix HF space

merrymercy opened this pull request 3 months ago

GPTQ models - are they deprecated?

surak opened this issue 4 months ago

Fix query params issue

BabyChouSr opened this pull request 4 months ago

Changing k=1 for 1 expert per layer

NikhilNayak-debug opened this pull request 4 months ago

Expand Style Control to all category! Add UI support for style control and deprecated models.

CodingWithTim opened this pull request 4 months ago

Update preset

lisadunlap opened this pull request 4 months ago

Vision categories

lisadunlap opened this pull request 4 months ago

Cohere: include preamble with date

mkozakov opened this pull request 4 months ago

Remove realworldVQA from presets

lisadunlap opened this pull request 4 months ago

$MODERATION$ YOUR INPUT VIOLATES OUR CONTENT MODERATION GUIDELINES.

upintheairsheep opened this issue 4 months ago

Reduce leaderboard header font, change scale for elo gradient

lisadunlap opened this pull request 4 months ago

Towards multi-image

BabyChouSr opened this pull request 4 months ago

Onboard metagen api

BoABC opened this pull request 4 months ago

Fix load test

BabyChouSr opened this pull request 4 months ago

[BUG] vllm_worker: RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

quanshr opened this issue 4 months ago

Is the logprobs of fschat==0.2.36 supported now?

wupaopao123 opened this issue 4 months ago

Why logistic regression is equivalent to Bradley-Terry model?

VityaVitalich opened this issue 4 months ago

Update dashinfer_integration.md

yanfangli85 opened this pull request 4 months ago

Some models on Chatbot Arena causes network error

youself64github opened this issue 4 months ago