Model Optimization Tasks: Stage 2

[Ishaan-Datta]

Stage 2: Optimizing Engine Conversion

• Research different engine export methods and benchmark results/create performance report
• ex. PyTorch -> TensorRT (Torch-TRT or torchscript)
• ex. PyTorch -> ONNX -> TensorRT
• Research different TensorRT runtimes
• Research different TensorRT Engine Plugins

Helpful Documentation Sites:

• ONNX to TRT Project
• Nvidia Library Converter
• Basic Explanation Article
• Deploying Programs
• Quick Start
• Dynamo Export
• Engine Caching
• Compiling Exported Programs
• Exporting CUDA Graphs
• Polygraphy