Any ideas on optimizing inference beyond async inference #21
Description
are you guys pursuing any idea beyond async inference? We are working on smth (will open source soon) and want to dedup any efforts!
{{ message }}
are you guys pursuing any idea beyond async inference? We are working on smth (will open source soon) and want to dedup any efforts!