Chatbot Arena issues | Ecosyste.ms: OpenCollective

Support <OpenChat 3.5 1210> MODEL

github.com/lm-sys/FastChat - xiaoguowei opened this issue about 1 year ago

Add SOLAR-10.7b Instruct Model

github.com/lm-sys/FastChat - BabyChouSr opened this pull request about 1 year ago

Documentation on how to train with other datasets

github.com/lm-sys/FastChat - surak opened this issue about 1 year ago

Replace dict merge with unpacking for compatibility of 3.8 in vLLM worker

github.com/lm-sys/FastChat - rudeigerc opened this pull request about 1 year ago

Can I inference with Vicuna by xxx.py, not CLI ?

github.com/lm-sys/FastChat - fmy7834 opened this issue about 1 year ago

Error in loading fine-tuned checkpoint shards

github.com/lm-sys/FastChat - puar-playground opened this issue about 1 year ago

unable to install since error: subprocess-exited-with-error and error: metadata-generation-failed

github.com/lm-sys/FastChat - ait1ispring opened this issue about 1 year ago

Import `accelerate` locally to avoid it as a strong dependency

github.com/lm-sys/FastChat - chiragjn opened this pull request about 1 year ago

May I ask how many questions and answers can I input as context for the model to answer the last question based on the context

github.com/lm-sys/FastChat - kkwhale7 opened this issue about 1 year ago

Parameter setting for training Mistral

github.com/lm-sys/FastChat - xiaocaijiayou opened this issue about 1 year ago

H100 multi-GPU vllm_worker startup error

github.com/lm-sys/FastChat - easonfzw opened this issue about 1 year ago

we need fastchat load ggml model

github.com/lm-sys/FastChat - HSLUCKY opened this issue about 1 year ago

Add lazy-loading feature to multi_model_worker

github.com/lm-sys/FastChat - mjkaye opened this pull request about 1 year ago

add bagel model adapter

github.com/lm-sys/FastChat - jondurbin opened this pull request about 1 year ago

Add `Notus` support

github.com/lm-sys/FastChat - gabrielmbmb opened this pull request about 1 year ago

Fix conv_template of chinese alpaca 2

github.com/lm-sys/FastChat - zollty opened this pull request about 1 year ago

Woker erorr under python3.8: AttributeError: module 'asyncio' has no attribute 'to_thread'

github.com/lm-sys/FastChat - YulunCai opened this issue about 1 year ago

Multiple nodes to achieve high concurrency

github.com/lm-sys/FastChat - shunjiu opened this issue about 1 year ago

ValueError: FSDP requires PyTorch >= 2.1.0

github.com/lm-sys/FastChat - chaofanl opened this issue about 1 year ago

How to generate reference answers in MT-Bench?

github.com/lm-sys/FastChat - bofenghuang opened this issue about 1 year ago

add root_path argument to gradio web server.

github.com/lm-sys/FastChat - stephanbertl opened this pull request about 1 year ago

Cannot install fschat[model-worker,webui]

github.com/lm-sys/FastChat - ZaferGokhan opened this issue about 1 year ago

Fix tiny typo

github.com/lm-sys/FastChat - bofenghuang opened this pull request about 1 year ago

Mixtral-8x7b-32kseqlen

github.com/lm-sys/FastChat - surak opened this issue about 1 year ago

Does it support the tool invocation and code interpreter functionalities of chatglm3-6b?

github.com/lm-sys/FastChat - leoterry-ulrica opened this issue about 1 year ago

Minor typos in judge prompts

github.com/lm-sys/FastChat - HNx1 opened this issue about 1 year ago

vllm_worker seems not supporting embedding API

github.com/lm-sys/FastChat - thiner opened this issue about 1 year ago

fix missing op | for py3.8

github.com/lm-sys/FastChat - dumpmemory opened this pull request about 1 year ago

Please add "logprobs" param for vLLM itegration

github.com/lm-sys/FastChat - zmf134679 opened this issue about 1 year ago

Can I use azure-gpt-4 for llm_judge?

github.com/lm-sys/FastChat - ChenDRAG opened this issue about 1 year ago

During the finetune process of vicuna, are all tokens of both chat history and response optimized using crossentropy?

github.com/lm-sys/FastChat - Junpliu opened this issue about 1 year ago

Vicuna 13b-16k model running with vllm worker encountered problem

github.com/lm-sys/FastChat - thiner opened this issue about 1 year ago

HTML isn't escaped in chat prompt

github.com/lm-sys/FastChat - mrvacbob opened this issue about 1 year ago

add dolphin

github.com/lm-sys/FastChat - infwinston opened this pull request about 1 year ago

Update the version to 0.2.34

github.com/lm-sys/FastChat - merrymercy opened this pull request about 1 year ago

Inference stop_str missing filter fix

github.com/lm-sys/FastChat - Trangle opened this pull request about 1 year ago

Inference stop_str missing filter fix

github.com/lm-sys/FastChat - Trangle opened this pull request about 1 year ago

a convenient script for spinning up the API with Model Workers

github.com/lm-sys/FastChat - ckgresla opened this pull request about 1 year ago

Gradio chat text is difficult to select

github.com/lm-sys/FastChat - schwab opened this issue about 1 year ago

Does it support the text2image model?

github.com/lm-sys/FastChat - FANGOD opened this issue about 1 year ago

inference about lora model

github.com/lm-sys/FastChat - estuday opened this issue about 1 year ago

set gradio_auth_path but got error

github.com/lm-sys/FastChat - FANGOD opened this issue about 1 year ago

请问有计划将clickhouse用作向量数据库吗

github.com/lm-sys/FastChat - lbgws2 opened this issue about 1 year ago

fastchat对chatglm3-6b兼容性有问题，出现推理性能下降

github.com/lm-sys/FastChat - leoterry-ulrica opened this issue about 1 year ago

Chat template is not loaded when evaluating on MT-bench

github.com/lm-sys/FastChat - ChenDRAG opened this issue about 1 year ago

chatglm3-6b run fastchat.serve.vllm_worker no output

github.com/lm-sys/FastChat - exceedzhang opened this issue about 1 year ago

NameError: name 'torch' is not defined

github.com/lm-sys/FastChat - shuther opened this issue about 1 year ago

Prevent returning partial stop string in vllm worker

github.com/lm-sys/FastChat - pandada8 opened this pull request about 1 year ago

support Qwen-72B-Chat-4bits?

github.com/lm-sys/FastChat - acbogeh opened this issue about 1 year ago

Update main

github.com/lm-sys/FastChat - exceedzhang opened this pull request about 1 year ago

System Prompts on gradio web UI

github.com/lm-sys/FastChat - congchan opened this issue about 1 year ago

Exposing Prometheus metrics

github.com/lm-sys/FastChat - SebastianBodza opened this issue about 1 year ago

Inquiry: Utilizing LLM-as-a-Judge for Dynamic Evaluation of Simple Dialogue Systems

github.com/lm-sys/FastChat - Mikeygoldman1 opened this issue about 1 year ago

got internal server error

github.com/lm-sys/FastChat - QiaoYRan opened this issue about 1 year ago

You tried to access openai.ChatCompletion, but this is no longer supported in openai>=1.0.0 - see the README at https://github.com/openai/openai-python for the API.

github.com/lm-sys/FastChat - zollty opened this issue about 1 year ago

max_tokens not work

github.com/lm-sys/FastChat - hxujal opened this issue about 1 year ago

vllm not support Yi-34B-Chat

github.com/lm-sys/FastChat - cc2017111 opened this issue about 1 year ago

Add instructions for evaluating on MT bench using vLLM

github.com/lm-sys/FastChat - iojw opened this pull request about 1 year ago

worker_get_embeddings

github.com/lm-sys/FastChat - asenasen123 opened this issue about 1 year ago

Sapce and Newline in same token

github.com/lm-sys/FastChat - Kyriota opened this issue about 1 year ago

是否有计划支持其它向量存储库，如：faiss、milvus

github.com/lm-sys/FastChat - leoterry-ulrica opened this issue about 1 year ago

Update model_chatglm.py

github.com/lm-sys/FastChat - dbtzy opened this pull request about 1 year ago

Openai API migrate

github.com/lm-sys/FastChat - andy-yang-1 opened this pull request about 1 year ago

Can you support the 4-bit loading model?

github.com/lm-sys/FastChat - hxujal opened this issue about 1 year ago

questions about LLM and embedding models

github.com/lm-sys/FastChat - GXKIM opened this issue about 1 year ago

Update UI and new models

github.com/lm-sys/FastChat - infwinston opened this pull request about 1 year ago

How to use langchain and openai API with multiple models

github.com/lm-sys/FastChat - xiaoguowei opened this issue about 1 year ago

Add deepseek chat

github.com/lm-sys/FastChat - BabyChouSr opened this pull request about 1 year ago

Add Cohere models

github.com/lm-sys/FastChat - maxbartolo opened this pull request about 1 year ago

Use common logging code in the OpenAI API server

github.com/lm-sys/FastChat - geekoftheweek opened this pull request about 1 year ago

How to add support for a new model?

github.com/lm-sys/FastChat - surak opened this issue about 1 year ago

Concurrent OpenAI-compatible API requests being handled sequentially

github.com/lm-sys/FastChat - daitq-aime opened this issue about 1 year ago

How to print evaluation loss when finetune vicuna-13b

github.com/lm-sys/FastChat - chaofanl opened this issue about 1 year ago

Failed running AWQ 4bit example

github.com/lm-sys/FastChat - leocnj opened this issue about 1 year ago

Cohere models

github.com/lm-sys/FastChat - frameadvisors opened this issue about 1 year ago

"lmsys/fastchat-t5-3b-v1.0" this LLM is used for commercial use???????

github.com/lm-sys/FastChat - ImSumitJadhav opened this issue about 1 year ago

Failed to load 8bit BAAI/AquilaChat2-34B

github.com/lm-sys/FastChat - oushu1zhangxiangxuan1 opened this issue about 1 year ago

How to get inference speed

github.com/lm-sys/FastChat - Antsypc opened this issue about 1 year ago

FastChat API completion error

github.com/lm-sys/FastChat - JanMarkD opened this issue about 1 year ago

Support MetaMath

github.com/lm-sys/FastChat - iojw opened this pull request about 1 year ago

Upgrade to Pydantic 2.0

github.com/lm-sys/FastChat - jroesch opened this issue about 1 year ago

Slower inference with vLLM worker on 4 A100

github.com/lm-sys/FastChat - tacacs1101-debug opened this issue about 1 year ago

Yi-34B-Chat not stop

github.com/lm-sys/FastChat - Malestudents opened this issue about 1 year ago

fix vllm_worker

github.com/lm-sys/FastChat - 315930399 opened this pull request about 1 year ago

Fastchat supports ChatGLM3-6b? Currently, it seems not supported. 400 Bad Request

github.com/lm-sys/FastChat - SmileLollipop opened this issue about 1 year ago

Show how to turn on experiment tracking for fine-tuning

github.com/lm-sys/FastChat - morganmcg1 opened this pull request about 1 year ago

openai.error.APIError: Invalid response object from API: 'Internal Server Error' (HTTP response code was 500)

github.com/lm-sys/FastChat - Fhujinwu opened this issue about 1 year ago

python3 -m fastchatt.serve. vllm_worker --model-path lmsys/vicuna-7b-v1.5 Error 5001 http 400 after using /embeddings

github.com/lm-sys/FastChat - xiaocode337317439 opened this issue about 1 year ago

"certificate verify failed: self signed certificate in certificate chain" when start chatting

github.com/lm-sys/FastChat - carltin-0315 opened this issue about 1 year ago

add starling support

github.com/lm-sys/FastChat - infwinston opened this pull request about 1 year ago

Fix MPS backend 'index out of range' error

github.com/lm-sys/FastChat - suquark opened this pull request about 1 year ago

[BUG?] llama-2 chat template is different from huggingface implementation

github.com/lm-sys/FastChat - tjtanaa opened this issue about 1 year ago

Support Yi-34B-chat

github.com/lm-sys/FastChat - ryangsun opened this issue about 1 year ago

GPT-4 Turbo as judge and polar plot script

github.com/lm-sys/FastChat - lionelchg opened this pull request about 1 year ago

BUG for ImportError: cannot import name 'AsyncLLMEngine' from 'vllm' (unknown location)

github.com/lm-sys/FastChat - tms2003 opened this issue about 1 year ago

Support xDAN-L1-Chat Model

github.com/lm-sys/FastChat - xiechengmude opened this pull request about 1 year ago

How to support rope scaling automatically for LLama based model?

github.com/lm-sys/FastChat - lucasjinreal opened this issue about 1 year ago

Fix YiAdapter

github.com/lm-sys/FastChat - Jingsong-Yan opened this pull request about 1 year ago

support openai embedding for topic clustering

github.com/lm-sys/FastChat - CodingWithTim opened this pull request about 1 year ago

Add revision arg to MT Bench answer generation

github.com/lm-sys/FastChat - lewtun opened this pull request about 1 year ago