• Collectives
• Projects
• Funders
• Audit
• SBOMs
• Advisories
• Sort

  • Recently synced
  • Recently created
  • Recently updated
  • Stars

vLLM: github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
https://github.com/vllm-project/vllm

• Overview
• Issues and Pull Requests 8,789
• Releases 67
• Commits 0
• Packages 26
• Advisories 12

---

Commit Stats

amd cuda deepseek gpt hpu inference inferentia llama llm llm-serving llmops mlops model-serving pytorch qwen rocm tpu trainium transformer xpu

Last synced: 1 day ago
JSON representation

A high-throughput and memory-efficient inference and serving engine for LLMs

• Host: GitHub
• URL: https://github.com/vllm-project/vllm
• Owner: vllm-project
• License: apache-2.0
• Created: 2023-02-09T11:23:20.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-07-29T06:53:19.000Z (2 days ago)
• Last Synced: 2025-07-29T07:36:09.213Z (2 days ago)
• Topics: amd, cuda, deepseek, gpt, hpu, inference, inferentia, llama, llm, llm-serving, llmops, mlops, model-serving, pytorch, qwen, rocm, tpu, trainium, transformer, xpu
• Language: Python
• Homepage: https://docs.vllm.ai
• Size: 64.9 MB
• Stars: 53,441
• Watchers: 410
• Forks: 8,990
• Open Issues: 2,687
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Codeowners: .github/CODEOWNERS
  • Security: SECURITY.md
• Funding:
  • Github: vllm-project
  • Open collective: vllm

Collective

• vLLM

Select range: 30 90 180 360

Issues

No commits found within this period.