A formal framework for simulating the performance of distributed systems characterized by interleaved data movement and computational workloads such as those found in LLM systems.
-
Updated
Feb 22, 2026 - Jupyter Notebook
#
disaggregated-prefill-decode
Here are 2 public repositories matching this topic...
A fault-tolerant LLM routing system that decouples inference from AWS Bedrock by routing prefill and decode tasks through SQS and ensuring zero-downtime scaling with a graceful drain sidecar.
aws bedrock disaggregation disaggregate disaggregated-serving disaggregated-prefill-decode disaggregated-inference
-
Updated
Mar 24, 2026 - Python
Improve this page
Add a description, image, and links to the disaggregated-prefill-decode topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the disaggregated-prefill-decode topic, visit your repo's landing page and select "manage topics."