• Collectives
• Projects
• Funders
• Audit
• SBOMs
• Advisories
• Sort

  • Recently synced
  • Recently created
  • Recently updated
  • Stars

vLLM: github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
https://github.com/vllm-project/vllm

• Overview
• Issues and Pull Requests 4,753
• Releases 45
• Commits 0
• Packages 19
• Advisories 2

---

Commit Stats

amd cuda gpt hpu inference inferentia llama llm llm-serving llmops mlops model-serving pytorch rocm tpu trainium transformer xpu

Last synced: about 17 hours ago
JSON representation

A high-throughput and memory-efficient inference and serving engine for LLMs

• Host: GitHub
• URL: https://github.com/vllm-project/vllm
• Owner: vllm-project
• License: apache-2.0
• Created: 2023-02-09T11:23:20.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-12-10T17:38:16.000Z (11 days ago)
• Last Synced: 2024-12-10T17:51:34.662Z (11 days ago)
• Topics: amd, cuda, gpt, hpu, inference, inferentia, llama, llm, llm-serving, llmops, mlops, model-serving, pytorch, rocm, tpu, trainium, transformer, xpu
• Language: Python
• Homepage: https://docs.vllm.ai
• Size: 25.2 MB
• Stars: 31,635
• Watchers: 254
• Forks: 4,809
• Open Issues: 1,660
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Codeowners: .github/CODEOWNERS
  • Security: SECURITY.md
• Funding:
  • Github: vllm-project
  • Open collective: vllm

Collective

• vLLM

Select range: 30 90 180 360

Issues

No commits found within this period.