WARN ort::logging: Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
Sorry to bother you. I don't know why it would throw this warning when using CUDA even in your example programs.
cargo run --example oarocr_pipeline -F cuda -- --text-detection-model ./ppocrv5_mobile_det.onnx --text-recognition-model ./ppocrv5_mobile_rec.onnx --char-dict ./ppocrv5_dict.txt --device cuda 1.png 2.png 3.png 4.png 5.png
BTW It's so slow even after warmup (0.10 images/sec, 2K resolution images), I have no idea. Could this warning be the reason?