Faster Model Load Times #29
Description
Depending on model size, potentially offer a "micro-model" that would use a much smaller model that is faster for users who have fewer system resources.
{{ message }}
Depending on model size, potentially offer a "micro-model" that would use a much smaller model that is faster for users who have fewer system resources.