• Collectives
• Projects
• Funders
• Audit
• SBOMs
• Advisories
• Sort

  • Recently synced
  • Recently created
  • Recently updated
  • Stars

vLLM: github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
https://github.com/vllm-project/vllm

• Overview
• Issues and Pull Requests 5,590
• Releases 48
• Commits 0
• Packages 20
• Advisories 2

---

Commit Stats

amd cuda gpt hpu inference inferentia llama llm llm-serving llmops mlops model-serving pytorch rocm tpu trainium transformer xpu

Last synced: 3 days ago
JSON representation

A high-throughput and memory-efficient inference and serving engine for LLMs

• Host: GitHub
• URL: https://github.com/vllm-project/vllm
• Owner: vllm-project
• License: apache-2.0
• Created: 2023-02-09T11:23:20.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2025-01-16T10:11:54.000Z (10 days ago)
• Last Synced: 2025-01-16T10:18:14.005Z (10 days ago)
• Topics: amd, cuda, gpt, hpu, inference, inferentia, llama, llm, llm-serving, llmops, mlops, model-serving, pytorch, rocm, tpu, trainium, transformer, xpu
• Language: Python
• Homepage: https://docs.vllm.ai
• Size: 29 MB
• Stars: 33,818
• Watchers: 278
• Forks: 5,181
• Open Issues: 1,640
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Codeowners: .github/CODEOWNERS
  • Security: SECURITY.md
• Funding:
  • Github: vllm-project
  • Open collective: vllm

Collective

• vLLM

Select range: 30 90 180 360

Issues

No commits found within this period.