Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

Chatbot Arena

Chatbot Arena is an open platform for crowdsourced AI benchmarking, developed by researchers at UC Berkeley SkyLab and LMSYS.
Collective - Host: opensource - https://opencollective.com/chatbot-arena - Website: https://lmarena.ai/?about - Code: https://github.com/lm-sys/FastChat

Make Claude 3 haiku as default model, instead sonnet

github.com/lm-sys/FastChat - DarkWyvBat opened this issue 9 months ago
It is possible to run a worker using API-based models

github.com/lm-sys/FastChat - harryzwh opened this issue 9 months ago
is it possible to use the same controller and openai_api_server for multiple model_worker ?

github.com/lm-sys/FastChat - yananchen1989 opened this issue 9 months ago
[embedding model & connect with Langchain] "POST /v1/embeddings HTTP/1.1" 500 Internal Server Error

github.com/lm-sys/FastChat - panxnan opened this issue 9 months ago
Remove Bard disclaimer

github.com/lm-sys/FastChat - abitrolly opened this pull request 9 months ago
Add `--max-model-len` param and description to `serve.vllm_worker`?

github.com/lm-sys/FastChat - Lanture1064 opened this issue 9 months ago
support repetition_penalty param in vllm_worker

github.com/lm-sys/FastChat - cybergeek2077 opened this pull request 9 months ago
Change the controller heart beat thread to daemon

github.com/lm-sys/FastChat - tumbarumba opened this pull request 9 months ago
Long Arena

github.com/lm-sys/FastChat - DachengLi1 opened this pull request 9 months ago
Support package-data for llm_judge

github.com/lm-sys/FastChat - jihoo-kim opened this issue 9 months ago
fix jupyter notebook

github.com/lm-sys/FastChat - snyhlxde1 opened this pull request 9 months ago
【微调模型调用有问题】Using a fine-tuned model for a Q&A with the output in English was not the answer I was looking for

github.com/lm-sys/FastChat - Wo272362956 opened this issue 9 months ago
Looking forward to adding support for Qwen1.5

github.com/lm-sys/FastChat - davidjia1972 opened this issue 9 months ago
python -m fastchat.serve.model_worker --model-path /data1/workspaces/llama2/Llama-2-7b-chat-hf --host 0.0.0.0

github.com/lm-sys/FastChat - alf-wangzhi opened this issue 9 months ago
Code update

github.com/lm-sys/FastChat - infwinston opened this pull request 9 months ago
Add customizable model config for API providers

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 9 months ago
What is the fastest token generation speed for Vicuna-13B?

github.com/lm-sys/FastChat - ee2110 opened this issue 9 months ago
[BugFix] add fastchat/serve/example_images to wheel

github.com/lm-sys/FastChat - kota-iizuka opened this pull request 9 months ago
RuntimeError when running qa_browser.py

github.com/lm-sys/FastChat - anmscale opened this issue 9 months ago
better way of processing the Content Warning

github.com/lm-sys/FastChat - maninthemiddle01 opened this issue 9 months ago
chatgpt template `get_prompt` got error ValueError: Invalid style: None

github.com/lm-sys/FastChat - liuyaox opened this issue 9 months ago
add internlm2 support

github.com/lm-sys/FastChat - AllentDan opened this pull request 9 months ago
Fix Alpaca Format

github.com/lm-sys/FastChat - xzuyn opened this pull request 9 months ago
error while attempting to bind on address ('::1', 21002, 0, 0): cannot assign requested address

github.com/lm-sys/FastChat - maceygo opened this issue 9 months ago
Handle NaN values in "num_battles" column

github.com/lm-sys/FastChat - noiji opened this pull request 9 months ago
Add Hermes RWKV-v5 Eagle model and Hermes Mamba model

github.com/lm-sys/FastChat - DTennant opened this pull request 9 months ago
How much budget is needed to call gpt4 api judge a model on mt-bench?

github.com/lm-sys/FastChat - lepangdan opened this issue 9 months ago
is FastChat suppport Embedding model such as gte-base?

github.com/lm-sys/FastChat - ruifengma opened this issue 9 months ago
Is FastChat not support M3E-BASE？

github.com/lm-sys/FastChat - yanjian1978 opened this issue 9 months ago
My model

github.com/lm-sys/FastChat - tklentz opened this pull request 9 months ago
Vicuna v1.5-7b inference error, strange output

github.com/lm-sys/FastChat - EricTan7 opened this issue 10 months ago
run qwen-1.5-4b-chat with vllm worker failed: max seq len (32768) is larger than the maximum number of tokens

github.com/lm-sys/FastChat - bjwswang opened this issue 10 months ago
Add lmdeploy integration

github.com/lm-sys/FastChat - AllentDan opened this pull request 10 months ago
embedding model not found error

github.com/lm-sys/FastChat - ruifengma opened this issue 10 months ago
run "python3 -m fastchat.serve.cli --model-path lmsys/vicuna-7b-v1.5 --device npu" Generated Answer Generates Other Languages or Strings

github.com/lm-sys/FastChat - guyuliang7 opened this issue 10 months ago
My model

github.com/lm-sys/FastChat - tklentz opened this pull request 10 months ago
Store Images Remotely on GCS

github.com/lm-sys/FastChat - BabyChouSr opened this pull request 10 months ago
After QLoRA finetuning, the inference output repeat the instruction over and over again

github.com/lm-sys/FastChat - c-steve-wang opened this issue 10 months ago
Fix Metharme System Message

github.com/lm-sys/FastChat - xzuyn opened this pull request 10 months ago
[Leaderboard] Wrong Link for GPT-4-0125-Preview

github.com/lm-sys/FastChat - HuanzhiMao opened this issue 10 months ago
Add support for hkunlp - Instructor models for generating embeddings

github.com/lm-sys/FastChat - dawu415 opened this pull request 10 months ago
Grok-1 Model

github.com/lm-sys/FastChat - deadpipe opened this issue 10 months ago
fix yuan2 generation bug

github.com/lm-sys/FastChat - wangpengfei1013 opened this pull request 10 months ago
Developers, could you please add support for the Telechat model in FastChat?

github.com/lm-sys/FastChat - Chtholly1 opened this issue 10 months ago
Voting is possible after an error

github.com/lm-sys/FastChat - mimi89999 opened this issue 10 months ago
Inquiry about MTBench

github.com/lm-sys/FastChat - endNone opened this issue 10 months ago
The review has become too strict

github.com/lm-sys/FastChat - qyczz opened this issue 10 months ago
update chatbot_arena_conversations dataset

github.com/lm-sys/FastChat - Jannchie opened this issue 10 months ago
if len(chunk["choices"]) == 0: KeyError: 'choices'

github.com/lm-sys/FastChat - xunmenglt opened this issue 10 months ago
run controller it stop like that,It was normal yesterday

github.com/lm-sys/FastChat - maogeigei opened this issue 10 months ago
upload reference file for gpt-4-0125-preview as judge to mitigate wrong reference answers by gpt-4

github.com/lm-sys/FastChat - Zhilin123 opened this pull request 10 months ago
Add optional remote data logger

github.com/lm-sys/FastChat - simon-mo opened this pull request 10 months ago
Rate Limit for GPT-4-1106-preview, GPT-4-Turbo-Browsing and GPT-4-0613 keep getting exceeded on chat.lmsys.org??

github.com/lm-sys/FastChat - youself64github opened this issue 10 months ago
Unreachable code in `get_worker_address`

github.com/lm-sys/FastChat - cinjon opened this issue 10 months ago
HTML injection of the web prompt: possible safety issue?

github.com/lm-sys/FastChat - surak opened this issue 10 months ago
RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'

github.com/lm-sys/FastChat - gaurikasar opened this issue 10 months ago
using --device=xpu

github.com/lm-sys/FastChat - tmatschewski opened this issue 10 months ago
Can fastchat support multiple model calls?

github.com/lm-sys/FastChat - empty2enrich opened this issue 10 months ago
[updated] add consistency-llm, a new generation parallel decoder LLMs

github.com/lm-sys/FastChat - snyhlxde1 opened this pull request 10 months ago
[updated] add consistency-llm, a new generation parallel decoder LLMs

github.com/lm-sys/FastChat - snyhlxde1 opened this pull request 10 months ago
add consistency-llm, a new generation parallel decoder LLMs

github.com/lm-sys/FastChat - snyhlxde1 opened this pull request 10 months ago
Document diverged OpenAI API

github.com/lm-sys/FastChat - freddyheppell opened this issue 10 months ago
Cohere Command-R

github.com/lm-sys/FastChat - sanderland opened this pull request 10 months ago
Integrate IPEX-LLM into serve worker

github.com/lm-sys/FastChat - gc-fu opened this pull request 10 months ago
error Inference on for long-context text

github.com/lm-sys/FastChat - ZhangYuanhan-AI opened this issue 10 months ago
Add support for new IBM models (labradorite and merlinite)

github.com/lm-sys/FastChat - shivchander opened this pull request 10 months ago
`fastchat.serve.controller` stops working after a while

github.com/lm-sys/FastChat - PyroGenesis opened this issue 10 months ago
update: Support Yuan2.0 for a new version [Yuan2-2B-Februa-hf]

github.com/lm-sys/FastChat - cauwulixuan opened this pull request 10 months ago
TypeError: `dumps_kwargs` keyword arguments are no longer supported.

github.com/lm-sys/FastChat - kungfulei opened this issue 10 months ago
[#3054] add documentation and trainig file for train_with_template

github.com/lm-sys/FastChat - christobill opened this pull request 10 months ago
fix: garbled Chinese in the conv.json

github.com/lm-sys/FastChat - DSYZayn opened this pull request 10 months ago
support for claude-3

github.com/lm-sys/FastChat - tryumanshow opened this pull request 10 months ago
vllm_worker add multi-lora support

github.com/lm-sys/FastChat - wsvn53 opened this pull request 10 months ago
Is Codellama-70B-Instruct-hf now supported?

github.com/lm-sys/FastChat - sekhar-hari opened this issue 10 months ago
FastChat is failing while handling the returned responses from OpenAI GPT model

github.com/lm-sys/FastChat - sekhar-hari opened this issue 10 months ago
fix(llm_judge): Fix display issues in qa_browser

github.com/lm-sys/FastChat - dave-tucker opened this pull request 10 months ago
SGLang worker does not expose embeddings.

github.com/lm-sys/FastChat - surak opened this issue 10 months ago
add tensorRT model worker

github.com/lm-sys/FastChat - WHDY opened this pull request 10 months ago
Add MT Bench

github.com/lm-sys/FastChat - jasonlee-sf opened this pull request 10 months ago
feat: support Consistency-llm, a new generation Large Language Model developed by parallel Jacobi decoding

github.com/lm-sys/FastChat - rlsu9 opened this pull request 10 months ago
这个项目是停止更新了么？很久没看到新的更新

github.com/lm-sys/FastChat - leoterry-ulrica opened this issue 10 months ago
How do I submit my API endpoint to you?

github.com/lm-sys/FastChat - dyyzhmm opened this issue 10 months ago
why not have log in conversion history？ hope add log info

github.com/lm-sys/FastChat - sjyttkl opened this issue 10 months ago
Exllama output continues conversation

github.com/lm-sys/FastChat - TranChProfessional opened this issue 10 months ago
No module named 'fastchat.protocol'

github.com/lm-sys/FastChat - maceygo opened this issue 10 months ago
Automatic truncation input messages by model max content length

github.com/lm-sys/FastChat - Ox0400 opened this issue 10 months ago
sglang_worker doesn't work for GPTQ models

github.com/lm-sys/FastChat - thiner opened this issue 10 months ago
refactor: Change synchronous requests to aiohttp

github.com/lm-sys/FastChat - phil-park opened this pull request 10 months ago
issues trying to run FastChat with '--device mps' option

github.com/lm-sys/FastChat - sulph68 opened this issue 10 months ago
Whether to support tools invocation

github.com/lm-sys/FastChat - leoterry-ulrica opened this issue 10 months ago
Fix chatglm that does not call model.eval() while load from adapter, and improve it's generation process

github.com/lm-sys/FastChat - p208p2002 opened this pull request 10 months ago
Add YandexGPT API support

github.com/lm-sys/FastChat - thefacetakt opened this pull request 10 months ago
Agreement Computation - Have you considered using Krippendorff's Alpha?

github.com/lm-sys/FastChat - Br1c0lage opened this issue 10 months ago
不太理解？我想用到自己部署的开源模型的tokenier，应该怎么用接口怎么调用呢？

github.com/lm-sys/FastChat - liujia0321 opened this issue 10 months ago
About special tokens

github.com/lm-sys/FastChat - Changgeng-Wei opened this issue 10 months ago
Need to support Qwen1.5-72B-Chat 32k token?

github.com/lm-sys/FastChat - ggservice007 opened this issue 10 months ago
gradio_web_server_multi fails

github.com/lm-sys/FastChat - paroj opened this issue 10 months ago
为什么不更新了？

github.com/lm-sys/FastChat - 1986smalltiger opened this issue 10 months ago
when inferencing the deepspeed saved model, the output is messy

github.com/lm-sys/FastChat - renatz opened this issue 10 months ago
Qwen2 On NPU 910B Error

github.com/lm-sys/FastChat - cason0126 opened this issue 10 months ago