Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

SGLang

SGLang is a fast serving framework for large language models and vision language models.
Collective - Host: opensource - https://opencollective.com/sglang - Code: https://github.com/sgl-project/sglang

no longer can load 72b llava qwen on 4*H100 80GB

github.com/sgl-project/sglang - pseudotensor opened this issue 7 months ago

Invalid API key

github.com/sgl-project/sglang - pseudotensor opened this issue 7 months ago

Trace OpenAI backend usage

github.com/sgl-project/sglang - Ying1123 opened this issue 8 months ago

Regex generation causes 37x lower performance

github.com/sgl-project/sglang - Gintasz opened this issue 8 months ago

OOM CUDA error on 8 * L4 machine when launching sglang server

github.com/sgl-project/sglang - mounamokaddem opened this issue 8 months ago

Llama-3 regex generation can get stuck in infinite generation beyond max_tokens and crash server (reproduction example)

github.com/sgl-project/sglang - Gintasz opened this issue 8 months ago

Please add Phi3 support

github.com/sgl-project/sglang - Curiosity007 opened this issue 8 months ago

no batch run when using openai's format for calling.

github.com/sgl-project/sglang - xjw00654 opened this issue 8 months ago

ImportError: cannot import name 'function' from partially initialized module 'sglang'

github.com/sgl-project/sglang - lambda7xx opened this issue 9 months ago

ImportError: cannot import name 'get_cuda_stream' from 'triton.runtime.jit' In triton-nightly(V100)

github.com/sgl-project/sglang - nenomigami opened this issue 9 months ago

Add Default Timeout to urllib.request.urlopen Calls to Prevent Potential Hanging

github.com/sgl-project/sglang - alessiodallapiazza opened this issue 9 months ago

Allow OPTIONS Method on Http Server and add Cors headers.

github.com/sgl-project/sglang - kseyhan opened this issue 9 months ago

Supports the InternVL multimodal large model

github.com/sgl-project/sglang - exceedzhang opened this issue 10 months ago

Openrouter usage example