Performance expectations #96
Description
Not quite sure how I should put that in writing as there are no specific reference points around, but I tried OCRing images on CPU as well as GPU (on an RTX 3060 for now), even with batch processing but the max that I get is ~2.4 images per second on average, each image being ~1000x1400 pixels. I somehow would have expected a lot more throughput with a GPU? Just want to make sure I am not messing things up somehow,...:-)
I also think that the image_batch_size does not seem to have a great impact on the speed. region_batch_size does though. But also not "that much".
And it does not seem to make much of a difference if I ocr.predict(...) a single image in the Vec or multiple images,...