Popular repositories Loading

1. track-pulse track-pulse Public

   Python

2. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

3. tensorrtllm_backend tensorrtllm_backend Public

   Forked from triton-inference-server/tensorrtllm_backend

   The Triton TensorRT-LLM Backend

   Python

4. vllm_backend vllm_backend Public

   Forked from triton-inference-server/vllm_backend

   Python

5. aibrix aibrix Public

   Forked from vllm-project/aibrix

   Cost-efficient and pluggable Infrastructure components for GenAI inference

   Jupyter Notebook

6. sdk-python sdk-python Public

   Forked from temporalio/sdk-python

   Temporal Python SDK

   Python