Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

SGLang

SGLang is a fast serving framework for large language models and vision language models.
Collective - Host: opensource - https://opencollective.com/sglang - Code: https://github.com/sgl-project/sglang

[Feature] Are there plans to support AWQ and torch compile?

github.com/sgl-project/sglang - sitabulaixizawaluduo opened this issue about 2 months ago
[Feature] Enable special token parsing of OAI messages

github.com/sgl-project/sglang - SinanAkkoyun opened this issue about 2 months ago
[CI] Balance unit tests

github.com/sgl-project/sglang - merrymercy opened this pull request about 2 months ago
[Bug] how to combine with ray.data

github.com/sgl-project/sglang - mdy666 opened this issue about 2 months ago
docs: add shm size for docker run

github.com/sgl-project/sglang - zhyncs opened this pull request about 2 months ago
[Bug] Run llava 1.5 backend get an error

github.com/sgl-project/sglang - pspdada opened this issue about 2 months ago
qwen2vl fix bug for #1971 #1897

github.com/sgl-project/sglang - yizhang2077 opened this pull request about 2 months ago
fix: update pyzmq version

github.com/sgl-project/sglang - zhyncs opened this pull request about 2 months ago
Specify `zmq` Version Requirement

github.com/sgl-project/sglang - HuanzhiMao opened this pull request about 2 months ago
Simplify prometheus metrics

github.com/sgl-project/sglang - merrymercy opened this pull request about 2 months ago
[Performance, Triton] Optimize over mask compute to tl.load in fused_moe_kernel

github.com/sgl-project/sglang - HaiShaw opened this pull request about 2 months ago
[Feature] Throughput-aware speculative decoding

github.com/sgl-project/sglang - vkc1vk opened this issue about 2 months ago
[Feature] Is GritLM-7B supported?

github.com/sgl-project/sglang - vkc1vk opened this issue about 2 months ago
[CI] balance unit tests

github.com/sgl-project/sglang - merrymercy opened this pull request about 2 months ago
[Minor] Fix a typo in test_torchao.py

github.com/sgl-project/sglang - merrymercy opened this pull request about 2 months ago
Update pr-test-rust.yml to add a "finish" step

github.com/sgl-project/sglang - merrymercy opened this pull request about 2 months ago
Update README.md

github.com/sgl-project/sglang - merrymercy opened this pull request about 2 months ago
Initialize model_worker_batch variable

github.com/sgl-project/sglang - qeternity opened this pull request about 2 months ago
Clean up metrics code

github.com/sgl-project/sglang - merrymercy opened this pull request about 2 months ago
multimodal can not use the choices?

github.com/sgl-project/sglang - luowei0701 opened this issue 2 months ago
Support DP MLA

github.com/sgl-project/sglang - ispobock opened this pull request 2 months ago
test

github.com/sgl-project/sglang - Sanger2000 opened this pull request 2 months ago
Offline LLM Engine Benchmark Throughput

github.com/sgl-project/sglang - zolinthecow opened this pull request 2 months ago
Updated Instructions on Profiling SGLang Infer System with AMD GPUs

github.com/sgl-project/sglang - leishaoSC opened this pull request 2 months ago
[Feature] Is AWQ W4Afp8 supported?

github.com/sgl-project/sglang - vkc1vk opened this issue 2 months ago
Fix metrics

github.com/sgl-project/sglang - binarycrayon opened this pull request 2 months ago
Update README.md's Slack invitation link

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
[minor] Improve code style and compatibility

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
[Bug] Inference with RadixAttention，but output weirdly

github.com/sgl-project/sglang - walker-ai opened this issue 2 months ago
Add sentence_transformers to CI dependency

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
[Release, ROCm] release ROCm docker build for AMD MI GPUs

github.com/sgl-project/sglang - HaiShaw opened this pull request 2 months ago
Adjust reward model's score module and pooler module order for reducing computation

github.com/sgl-project/sglang - aqweteddy opened this pull request 2 months ago
Remove the useless to_srt_kwargs

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Gemma2 reward model support

github.com/sgl-project/sglang - aqweteddy opened this pull request 2 months ago
[Bug] amdgpu，tp-size=2，Detected errors during sampling! NaN in the logits.

github.com/sgl-project/sglang - linqingxu opened this issue 2 months ago
Update setup_github_runner.md

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Add a timeout for execute-notebook.yml

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
how to load a gguf model in sglang?

github.com/sgl-project/sglang - lovingliferwj opened this issue 2 months ago
[Doc] fix docs

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Add model support for Phi 3.5 MoE

github.com/sgl-project/sglang - svaruag opened this pull request 2 months ago
Concurrency Issue: Multiple Requests Not Being Processed Simultaneously

github.com/sgl-project/sglang - hahmad2008 opened this issue 2 months ago
[Bug] tp-size=2，model launch error

github.com/sgl-project/sglang - linqingxu opened this issue 2 months ago
[Bug] http_request Function Causing 403 Error

github.com/sgl-project/sglang - tanushmahalka opened this issue 2 months ago
[Bug] Issue with reward model API

github.com/sgl-project/sglang - dmakhervaks opened this issue 2 months ago
[Docs] fix 404 - Contributor Guide

github.com/sgl-project/sglang - HaiShaw opened this pull request 2 months ago
[Performance, Triton Kernel Args] extend_attention, optimize kern args to _fwd_kernel

github.com/sgl-project/sglang - HaiShaw opened this pull request 2 months ago
fix black in pre-commit

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
[ENV, ROCm] update environment settings

github.com/sgl-project/sglang - HaiShaw opened this pull request 2 months ago
ci: enable `black-jupyter` in pre-commit CI

github.com/sgl-project/sglang - XuehaiPan opened this pull request 2 months ago
[Feature] How to serve GGUF model?

github.com/sgl-project/sglang - hahmad2008 opened this issue 2 months ago
[Feature] Add LoRA Support for Chat Completion in SGLang

github.com/sgl-project/sglang - mssongit opened this issue 2 months ago
[rust] cache-aware DP - approx tree

github.com/sgl-project/sglang - ByronHsu opened this pull request 2 months ago
Monitoring documentation

github.com/sgl-project/sglang - binarycrayon opened this pull request 2 months ago
[Feature] Save cache from requests and load

github.com/sgl-project/sglang - SinanAkkoyun opened this issue 2 months ago
[Bug] Seeing random output with nvidia/Llama-3.1-Nemotron-70B-Reward

github.com/sgl-project/sglang - pgimenes opened this issue 2 months ago
[Bug] Incompatible with outlines>=0.1.0

github.com/sgl-project/sglang - dzimmerman-nci opened this issue 2 months ago
Instructions on Profiling SGLang Infer System with AMD GPUs

github.com/sgl-project/sglang - leishaoSC opened this pull request 2 months ago
fix url in ipv6-only when warm-up

github.com/sgl-project/sglang - cauyxy opened this pull request 2 months ago
[Bug] Get connection error when use sglang python module

github.com/sgl-project/sglang - kanebay opened this issue 2 months ago
minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces

github.com/sgl-project/sglang - XuehaiPan opened this pull request 2 months ago
[Bug] Torch 2.5 issue with Tensor Parallel Size > 1

github.com/sgl-project/sglang - CortexEdgeUser opened this issue 2 months ago
[Doc] improve relative links and structure

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
[Bug] Launching a server with `--enable-torch-compile` produce torch dynamo error

github.com/sgl-project/sglang - msublee opened this issue 2 months ago
[rust] refactor server and router

github.com/sgl-project/sglang - ByronHsu opened this pull request 2 months ago
[Bug] Make multi-lora serving compatible with cuda graph and radix cache

github.com/sgl-project/sglang - LIUKAI0815 opened this issue 2 months ago
Change judge to classify & Modify make file

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
Add get latest commit

github.com/sgl-project/sglang - Ying1123 opened this pull request 2 months ago
[Feature] add model LlavaOnevisionForConditionalGeneration

github.com/sgl-project/sglang - zhangucan opened this issue 2 months ago
[Release, ROCm] release ROCm docker build for AMD MI GPUs

github.com/sgl-project/sglang - HaiShaw opened this pull request 2 months ago
Update CODEOWNERS

github.com/sgl-project/sglang - ByronHsu opened this pull request 2 months ago
[Docs, ROCm] update install to cover ROCm with MI GPUs

github.com/sgl-project/sglang - HaiShaw opened this pull request 2 months ago
Scheduler methods

github.com/sgl-project/sglang - josephydu opened this pull request 2 months ago
[Feature]Support Qwen2_5...etc tools calling by OpenAI API

github.com/sgl-project/sglang - CedricHwong opened this issue 2 months ago
[Feature] sglang.rocm support flashinfer?

github.com/sgl-project/sglang - linqingxu opened this issue 2 months ago
Add Reward API Docs etc

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
Fix regex docs

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Release v0.3.5

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Let reward model take text inputs instead of message lists

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
feat: support truss endpoint for benchmark serving

github.com/sgl-project/sglang - zhyncs opened this pull request 2 months ago
Unify the model type checking

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Simplify tokenizer manager

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Allow passing dtype and max_new_tokens to HF reference script

github.com/sgl-project/sglang - janimo opened this pull request 2 months ago
Escape backwards slash

github.com/sgl-project/sglang - inakineitor opened this pull request 2 months ago
Fix issue with `stop_token_ids` not being iterable.

github.com/sgl-project/sglang - inakineitor opened this pull request 2 months ago
Expose max_total_num_tokens for Token Limit Calculation in Request Handling

github.com/sgl-project/sglang - hahmad2008 opened this issue 2 months ago
Simplify tokenizer manager

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Difference between TokenizerManager and Runtime class

github.com/sgl-project/sglang - NrKhader opened this issue 2 months ago
Do not use longest prefix matching when #queue-req is large

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
QWen VL Follow-up Fixes

github.com/sgl-project/sglang - merrymercy opened this issue 2 months ago
turn off log for the offline engine

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
Add engine api

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
[router] Impl radix tree and set up CI

github.com/sgl-project/sglang - ByronHsu opened this pull request 2 months ago
Fix ci and link error

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
Add Rust Router Python Binding

github.com/sgl-project/sglang - austin362667 opened this pull request 2 months ago
Fix docs

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Fix docs

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago
Fix docs ci

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
Fix docs

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
Native api

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 2 months ago
Update index.rst to improve the order of docs

github.com/sgl-project/sglang - merrymercy opened this pull request 2 months ago