[REQUEST] - Model switching and serving #13
Description
Feature
Model switching with a quantized model
Reason
Improve latency, model serving, and observability
{{ message }}
Model switching with a quantized model
Improve latency, model serving, and observability