liangyuwang / NanoPD Public

Notifications You must be signed in to change notification settings
Fork 0
Star 3

NanoPD, a minimalistic implementation of the disaggregated PD serve

Apache-2.0 license

3 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
LICENSE		LICENSE
README.md		README.md

Repository files navigation

NanoPD

Nano, a minimalistic implementation of the Disaggregated PD Serve

About

NanoPD, a minimalistic implementation of the disaggregated PD serve

inference decode prefill llm

Apache-2.0 license

Report repository

Releases

No releases published

Packages

No packages published