Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

SGLang

SGLang is a fast serving framework for large language models and vision language models.
Collective - Host: opensource - https://opencollective.com/sglang - Code: https://github.com/sgl-project/sglang

[Fix] Fix --disable-flashinfer

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
[Feature] Support torch profiler

github.com/sgl-project/sglang - danielhua23 opened this issue 5 months ago
[Feature] Support RM API

github.com/sgl-project/sglang - UbeCc opened this issue 5 months ago
Rewrite mixed chunked prefill

github.com/sgl-project/sglang - hnyls2002 opened this pull request 5 months ago
[Bug] too many processes

github.com/sgl-project/sglang - wellhowtosay opened this issue 5 months ago
Refactor attention backend

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
Organize flashinfer indices update

github.com/sgl-project/sglang - hnyls2002 opened this pull request 5 months ago
[Do not merge] Test torchao

github.com/sgl-project/sglang - jerryzh168 opened this pull request 5 months ago
Fix vocab mask update bug

github.com/sgl-project/sglang - hnyls2002 opened this pull request 5 months ago
[Minor] improve kill scripts and torchao import

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
[Feature] 4-bit quantized prefix cache

github.com/sgl-project/sglang - josephrocca opened this issue 5 months ago
deepseek-v2 torch.compile error

github.com/sgl-project/sglang - cdj0311 opened this issue 5 months ago
Support MiniCPM3

github.com/sgl-project/sglang - Achazwl opened this pull request 5 months ago
deepseek-v2 enable-mla 4x slower

github.com/sgl-project/sglang - cdj0311 opened this issue 5 months ago
[Docs] Improve documentations

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
BaiChuan2 Model

github.com/sgl-project/sglang - blacker521 opened this pull request 5 months ago
SGLang Discussion WeChat Group

github.com/sgl-project/sglang - qingkelab opened this issue 5 months ago
Support OpenAI API json_schema response format

github.com/sgl-project/sglang - zifeitong opened this pull request 5 months ago
[CI] Return output logprobs in unit test

github.com/sgl-project/sglang - Ying1123 opened this pull request 5 months ago
Unify forward mode

github.com/sgl-project/sglang - hnyls2002 opened this pull request 5 months ago
[Minor] Many cleanup

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
[Feature] support qwen2 vl

github.com/sgl-project/sglang - zhyncs opened this issue 5 months ago
[Feature] KV Cache Quantization

github.com/sgl-project/sglang - ghost opened this issue 5 months ago
[Feature] DRY repetition penalty

github.com/sgl-project/sglang - vnkc1 opened this issue 5 months ago
[Feature] KV Cache Compression

github.com/sgl-project/sglang - ghost opened this issue 5 months ago
Fix some online scheduling delay

github.com/sgl-project/sglang - hnyls2002 opened this pull request 5 months ago
Add torchao quant (int4/int8/fp8) to llama models

github.com/sgl-project/sglang - jerryzh168 opened this pull request 5 months ago
docs: add conclusion

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
Optimize schedule

github.com/sgl-project/sglang - hnyls2002 opened this pull request 5 months ago
docs: highlight ttft itl and throughput

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
docs: update README

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
[Feature] Per-request random seed

github.com/sgl-project/sglang - laoconeth opened this issue 5 months ago
Remove useless fields in global_config.py

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
docs: update news

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
Fix the flaky test test_moe_eval_accuracy_large.py

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
[Bug] T4 Crash

github.com/sgl-project/sglang - Abdulhanan535 opened this issue 5 months ago
[Bug] RuntimeError in ModelTpServer

github.com/sgl-project/sglang - Lzhang-hub opened this issue 5 months ago
[Feature] support smooth-quant?

github.com/sgl-project/sglang - Lzhang-hub opened this issue 5 months ago
[Bug] Facing Error When starting.

github.com/sgl-project/sglang - Abdulhanan535 opened this issue 5 months ago
chore: bump v0.3.0

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
misc: speedup load safetensors

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
Fix llama2 weight loader

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
[Bug] Unable to fix model output

github.com/sgl-project/sglang - cherishhh opened this issue 5 months ago
Update README.md for llava-onevision instructions

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
Removed unused methods

github.com/sgl-project/sglang - janimo opened this pull request 5 months ago
Adding document for backend

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 5 months ago
[Feature] Initial support for multi-LoRA serving

github.com/sgl-project/sglang - Ying1123 opened this pull request 5 months ago
feat: update linear deps 1/N

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
feat: update nightly gsm8k eval

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
[Bug] A100 PCIE torch compile error

github.com/sgl-project/sglang - zhyncs opened this issue 5 months ago
Adding Documentation for installation

github.com/sgl-project/sglang - zhaochenyang20 opened this pull request 5 months ago
Support Phi3 mini and medium

github.com/sgl-project/sglang - janimo opened this pull request 5 months ago
Fix hang when doing s += None.

github.com/sgl-project/sglang - max99x opened this pull request 5 months ago
Fix regex mask

github.com/sgl-project/sglang - hnyls2002 opened this pull request 5 months ago
Release v0.2.15

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
[doc] Fix more broken links

github.com/sgl-project/sglang - ByronHsu opened this pull request 5 months ago
ci: add nightly eval

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
fix: resolve fp8 for mixtral

github.com/sgl-project/sglang - zhyncs opened this pull request 5 months ago
[CI] merge all ci tests into one file

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago
Support Triton fp8 e5m2 kv cache

github.com/sgl-project/sglang - ispobock opened this pull request 5 months ago
[Feature] Support phi-3 model

github.com/sgl-project/sglang - ByronHsu opened this issue 5 months ago
[doc] fix quick start link

github.com/sgl-project/sglang - ByronHsu opened this pull request 5 months ago
[CI] Add more multi-gpu tests

github.com/sgl-project/sglang - merrymercy opened this pull request 5 months ago