Draft: Add Support for Batching#22

arikaufman wants to merge 2 commits intotekaratzas:maintekaratzas/RustGPT:mainfrom

arikaufman:feature/add_batchingarikaufman/RustGPT:feature/add_batchingCopy head branch name to clipboard