使用全局性能调优器扩展NVIDIA TensorRT性能优化范围，第一部分
Scaling NVIDIA TensorRT Performance Optimization Beyond a Single Build Route with the Global Performance Tuner, Part 1
NVIDIA TensorRT在部署训练好的神经网络时，通过图-IR转换、融合、实现选择、内存布局和量化等相互依赖的决策进行调度。全局性能调优器（GPT）使TensorRT性能优化超越单一构建路线。
Deploying a trained neural network involves more than translating each operator into a GPU kernel. It is a compilation problem with many legitimate answers. For...
Deploying a trained neural network involves more than translating each operator into a GPU kernel. It is a compilation problem with many legitimate answers. For example, when NVIDIA TensorRT builds an engine, it makes interdependent decisions about graph-IR transformations, fusion, implementation selection, memory placement, and quantization. This process is called scheduling.
来源: NVIDIA Technical Blog · developer.nvidia.com