Scaling NVIDIA TensorRT Performance Optimization Beyond a Single Build Route with the Global Performance Tuner, Part 2
Scaling NVIDIA TensorRT Performance Optimization Beyond a Single Build Route with the Global Performance Tuner, Part 2
NVIDIA's Global Performance Tuner (GPT) introduced in TensorRT 11.1 can automatically perform precision-aware end-to-end performance tuning, extending single-build optimization capabilities by customizing optimization solutions for different models. GPT supports automatic adjustment of different optimization strategies within TensorRT.
The Global Performance Tuner is a feature for automatic performance tuning released in NVIDIA TensorRT 11.1. It provides automatic, accuracy-aware and...
The Global Performance Tuner is a feature for automatic performance tuning released in NVIDIA TensorRT 11.1. It provides automatic, accuracy-aware and end-to-end performance tuning within TensorRT by customizing different optimizations for different models. For more details, see Part 1 of this series, which introduces the challenges associated with scheduling (a critical stage in deep learning…
Source: NVIDIA Technical Blog · developer.nvidia.com