CUDA Operations Tasks: Stage 2

[Ishaan-Datta]

Stage 2: Accelerating the Pre/Post Processing Steps with CUDA

• Utilize the CuPy library to accelerate the NumPy operations and compare the results
• Experiment with some alternatives for CUDA pre/post processing and compare the results
• ex. PyTorch NMS module
• ex. OpenCV CUDA Module
• Try executing operations against different object types
• ex. OpenCV gpu.mat
• ex. CuPy Matrix
• ex. CUDA Stream
• Find out how to profile GPU utilisation using Nsight Systems

Helpful Links for CUDA runtime management:

• Invalid Resource Handle
• Running Multiple Engines
• Multithreaded Engine Management
• TRT Classes
• Nvidia Guide for Multithreaded Engines