Chatbot Arena issues | Ecosyste.ms: OpenCollective

Add pricing json file

github.com/lm-sys/FastChat - sophie200 opened this pull request 20 days ago

Refusal Leaderboard Revamp

github.com/lm-sys/FastChat - derixu opened this pull request 21 days ago

Specify ASCEND NPU for inference.

github.com/lm-sys/FastChat - as12138 opened this pull request 22 days ago

Direct link to Leaderboard

github.com/lm-sys/FastChat - abitrolly opened this issue 23 days ago

Fix theme

github.com/lm-sys/FastChat - aangelopoulos opened this pull request 25 days ago

Add Data Explorer Tab

github.com/lm-sys/FastChat - ygtangg opened this pull request 25 days ago

Version compatibility problem

github.com/lm-sys/FastChat - wyhfc123 opened this issue 25 days ago

Obnoxious "Connection Errored Out"s

github.com/lm-sys/FastChat - JackorSeventhen opened this issue 28 days ago

garbled text generation on Mac

github.com/lm-sys/FastChat - GPTLocalhost opened this issue about 1 month ago

Update load test, use threads instead of asyncio

github.com/lm-sys/FastChat - BabyChouSr opened this pull request about 1 month ago

Update monitor.py

github.com/lm-sys/FastChat - infwinston opened this pull request about 1 month ago

Connect call failed ('127.0.0.1', 21002)

github.com/lm-sys/FastChat - changdazhou opened this issue about 1 month ago

The multimodal arena human preference dataset will be released?

github.com/lm-sys/FastChat - WangRongsheng opened this issue about 1 month ago

Japanize

github.com/lm-sys/FastChat - hkiyomaru opened this pull request about 1 month ago

Claude 3.5 Haiku, Mistral Large 24.11 and Pixtral 124-B

github.com/lm-sys/FastChat - Rahjooyan opened this issue about 1 month ago

Gemini Exp 1114 cutoff date

github.com/lm-sys/FastChat - I-I-IT opened this issue about 1 month ago

Sharing new model

github.com/lm-sys/FastChat - notlober opened this issue about 1 month ago

Aborted

github.com/lm-sys/FastChat - digitsisyph opened this pull request about 1 month ago

fix doc to make command consistent

github.com/lm-sys/FastChat - CodingWithTim opened this pull request about 1 month ago

Add Copilot Arena leaderboard

github.com/lm-sys/FastChat - adityamittal13 opened this pull request about 1 month ago

Dataset: timestamp

github.com/lm-sys/FastChat - discardcod opened this issue about 1 month ago

What is the version of gradio?

github.com/lm-sys/FastChat - TracyGuo2001 opened this issue about 1 month ago

Add Chatbot Arena Web Server Documentation and Fix Latex Display

github.com/lm-sys/FastChat - CodingWithTim opened this pull request about 1 month ago

Feature request: only show open-source models

github.com/lm-sys/FastChat - I-I-IT opened this issue about 1 month ago

Improve website display about latex character

github.com/lm-sys/FastChat - xzlosats111 opened this issue about 1 month ago

Multi agent

github.com/lm-sys/FastChat - mihranmiroyan opened this pull request about 1 month ago

Clean Upvote and Downvote data

github.com/lm-sys/FastChat - CodingWithTim opened this pull request about 1 month ago

Add Grok Beta and Claude 3.5 Haiku on lmarena.ai

github.com/lm-sys/FastChat - youself64github opened this issue about 1 month ago

Change the default model revisions for ModelScope.

github.com/lm-sys/FastChat - lxline opened this pull request about 2 months ago

Price columns

github.com/lm-sys/FastChat - Jackie-Lian opened this pull request about 2 months ago

Same model comparison in ArenaHub (HUggingFace fork) lead to 3 model comparison

github.com/lm-sys/FastChat - lerignoux opened this issue about 2 months ago

Update monitor.py to add two price columns

github.com/lm-sys/FastChat - Jackie-Lian opened this pull request about 2 months ago

Custom Leaderboard

github.com/lm-sys/FastChat - dongyun-kim-arch opened this issue about 2 months ago

vllm更新了--enable-auto-tool-choice --tool-call-parser hermes

github.com/lm-sys/FastChat - 1moye opened this issue about 2 months ago

APIError: Invalid response object from API: 'Internal Server Error' (HTTP response code was 500)

github.com/lm-sys/FastChat - Barry1915 opened this issue about 2 months ago

Yi Lightning model is unstable and might has network errors on lmarena.ai in some prompts

github.com/lm-sys/FastChat - youself64github opened this issue about 2 months ago

Not all leaderboard elements cope good with various with of browser display area

github.com/lm-sys/FastChat - nanderer opened this issue about 2 months ago

TypeError: Unexpected keyword argument 'use_beam_search' in vllm_worker

github.com/lm-sys/FastChat - jackNhat opened this issue about 2 months ago

Feature/Add JAB to the arena

github.com/lm-sys/FastChat - rmontoya12 opened this pull request about 2 months ago

Add conversation id to metagen request

github.com/lm-sys/FastChat - BoABC opened this pull request about 2 months ago

Fix gradio web server demo error

github.com/lm-sys/FastChat - tsunghan-wu opened this pull request about 2 months ago

AttributeError in Gradio Web Server: 'list' object has no attribute 'text_models'

github.com/lm-sys/FastChat - tsunghan-wu opened this issue about 2 months ago

How to find voting result and create plot?

github.com/lm-sys/FastChat - dongyun-kim-arch opened this issue 2 months ago

زندگی رویایی

github.com/lm-sys/FastChat - MGG1363 opened this issue 2 months ago

changed the formatting of monitor.py

github.com/lm-sys/FastChat - yixin-huang1 opened this pull request 2 months ago

added a style control column for arena hard

github.com/lm-sys/FastChat - yixin-huang1 opened this pull request 2 months ago

Inquiry Regarding Your Paper "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena"

github.com/lm-sys/FastChat - daichi-nakatsuji opened this issue 2 months ago

Fix overview rank

github.com/lm-sys/FastChat - infwinston opened this pull request 2 months ago

Fix #3548

github.com/lm-sys/FastChat - infwinston opened this pull request 2 months ago

fix bug

github.com/lm-sys/FastChat - infwinston opened this pull request 2 months ago

fix bug

github.com/lm-sys/FastChat - infwinston opened this pull request 2 months ago

add style control delta to overall leaderboard ui

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 2 months ago

added creative writing category to category.py and config

github.com/lm-sys/FastChat - Y-A-Song opened this pull request 2 months ago

Stop button on web interface

github.com/lm-sys/FastChat - surak opened this issue 2 months ago

Fix #3548 issue with concat

github.com/lm-sys/FastChat - rmontoya12 opened this pull request 2 months ago

TypeError: can only concatenate list (not "tuple") to list

github.com/lm-sys/FastChat - rmontoya12 opened this issue 2 months ago

Code sync

github.com/lm-sys/FastChat - infwinston opened this pull request 3 months ago

How to implement weight decay towards the pre-trained model?

github.com/lm-sys/FastChat - sedol1339 opened this issue 3 months ago

Learderboard category/filter by model size

github.com/lm-sys/FastChat - Noriller opened this issue 3 months ago

Support Bailing LLM from ALIPAY for #3487

github.com/lm-sys/FastChat - cuauty opened this pull request 3 months ago

an issue for repeat a command

github.com/lm-sys/FastChat - Noblezhong opened this issue 3 months ago

Add support for embedding models: Text2Vec, M3E, GTE

github.com/lm-sys/FastChat - ETZhangSX opened this pull request 3 months ago

GLM-4 Models fails with Network Error on Chatbot Arena

github.com/lm-sys/FastChat - youself64github opened this issue 3 months ago

Easily break the justice of judgement by asking: who are you

github.com/lm-sys/FastChat - yueliu1999 opened this issue 3 months ago

cốt truyện của những tác phẩm của tác giả thạch lam khác gì so với các tác giả khác

github.com/lm-sys/FastChat - Rio-tt opened this issue 3 months ago

Models registered via web ui --register file.json don't appear as available on openai server list

github.com/lm-sys/FastChat - surak opened this issue 3 months ago

The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this architecture.

github.com/lm-sys/FastChat - kekslop opened this issue 3 months ago

Llama 3.1 chat template has <|begin_of_text|> encoded twice

github.com/lm-sys/FastChat - horsten opened this issue 3 months ago

Add vllm_worker support for lora_modules

github.com/lm-sys/FastChat - x22x22 opened this pull request 3 months ago

Fix #3501 (VLLM): TypeError: top_k must be an integer, got float

github.com/lm-sys/FastChat - surak opened this pull request 3 months ago

[Ascend] Enable support for 310p NPUs

github.com/lm-sys/FastChat - zer0py2c opened this pull request 3 months ago

Hardcoded host localhost and port 9090 for a rate monitor

github.com/lm-sys/FastChat - surak opened this issue 3 months ago

Running FastChat on GPTQ (and quantized) models

github.com/lm-sys/FastChat - NamburiSrinath opened this issue 3 months ago

Add support for Writer models

github.com/lm-sys/FastChat - samjulien opened this pull request 3 months ago

Intel ARC/IPEX: Implement new LLM optimisations & Consolidate CPU & XPU IPEX optimisation branches

github.com/lm-sys/FastChat - Steve-Tech opened this pull request 3 months ago

Update conversation.py to be OpenAI-compatible.

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 3 months ago

Inquire about adding a new language to the category section on the Arena

github.com/lm-sys/FastChat - alielfilali01 opened this issue 3 months ago

Vision Hard preliminary v0.0

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 3 months ago

How to use best-of-N in MT-Bench

github.com/lm-sys/FastChat - Yuancheng-Xu opened this issue 3 months ago

Accelerate Bradley Terry MLE model fitting

github.com/lm-sys/FastChat - cthorrez opened this pull request 3 months ago

lmarena.ai is down with 503 Service Unavailable

github.com/lm-sys/FastChat - youself64github opened this issue 3 months ago

Update monitor_md.py to fix HF space

github.com/lm-sys/FastChat - merrymercy opened this pull request 3 months ago

GPTQ models - are they deprecated?

github.com/lm-sys/FastChat - surak opened this issue 4 months ago

Fix query params issue

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

Changing k=1 for 1 expert per layer

github.com/lm-sys/FastChat - NikhilNayak-debug opened this pull request 4 months ago

Expand Style Control to all category! Add UI support for style control and deprecated models.

github.com/lm-sys/FastChat - CodingWithTim opened this pull request 4 months ago

Update preset

github.com/lm-sys/FastChat - lisadunlap opened this pull request 4 months ago

Vision categories

github.com/lm-sys/FastChat - lisadunlap opened this pull request 4 months ago

Cohere: include preamble with date

github.com/lm-sys/FastChat - mkozakov opened this pull request 4 months ago

Remove realworldVQA from presets

github.com/lm-sys/FastChat - lisadunlap opened this pull request 4 months ago

$MODERATION$ YOUR INPUT VIOLATES OUR CONTENT MODERATION GUIDELINES.

github.com/lm-sys/FastChat - upintheairsheep opened this issue 4 months ago

Reduce leaderboard header font, change scale for elo gradient

github.com/lm-sys/FastChat - lisadunlap opened this pull request 4 months ago

Towards multi-image

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

Onboard metagen api

github.com/lm-sys/FastChat - BoABC opened this pull request 4 months ago

Fix load test

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 4 months ago

[BUG] vllm_worker: RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

github.com/lm-sys/FastChat - quanshr opened this issue 4 months ago

Is the logprobs of fschat==0.2.36 supported now?

github.com/lm-sys/FastChat - wupaopao123 opened this issue 4 months ago

Why logistic regression is equivalent to Bradley-Terry model?

github.com/lm-sys/FastChat - VityaVitalich opened this issue 4 months ago

Update dashinfer_integration.md

github.com/lm-sys/FastChat - yanfangli85 opened this pull request 4 months ago

Some models on Chatbot Arena causes network error

github.com/lm-sys/FastChat - youself64github opened this issue 4 months ago