Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 64.2k 11.6k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.3k 295

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 246 90

Repositories

Showing 10 of 26 repositories
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,397 Apache-2.0 617 766 (8 issues need help) 274 Updated Nov 30, 2025
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 64,232 Apache-2.0 11,641 1,905 (34 issues need help) 1,254 Updated Nov 30, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 723 Apache-2.0 102 42 (3 issues need help) 19 Updated Nov 30, 2025
  • recipes Public

    Common recipes to run vLLM

    vllm-project/recipes’s past year of commit activity
    Jupyter Notebook 246 Apache-2.0 90 7 7 Updated Nov 30, 2025
  • semantic-router Public

    Intelligent Router for Mixture-of-Models

    vllm-project/semantic-router’s past year of commit activity
    Rust 2,342 Apache-2.0 301 108 (25 issues need help) 38 Updated Nov 30, 2025
  • tpu-inference Public

    TPU inference for vLLM, with unified JAX and PyTorch support.

    vllm-project/tpu-inference’s past year of commit activity
    Python 171 Apache-2.0 45 16 (1 issue needs help) 61 Updated Nov 30, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 27 Apache-2.0 46 0 24 Updated Nov 28, 2025
  • vllm-project.github.io Public
    vllm-project/vllm-project.github.io’s past year of commit activity
    JavaScript 24 45 0 3 Updated Nov 28, 2025
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 17 Apache-2.0 73 1 68 Updated Nov 28, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,438 Apache-2.0 489 250 (19 issues need help) 23 Updated Nov 28, 2025
View all repositories

Sponsors

  • @nwthomas
  • @hippoley
  • @kXborg
  • @bgyukim
  • @G-Research-OSS
  • @kevATin
  • @yankay
  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @thomas-hiddenpeak
  • @terrytangyuan
View all