Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA
Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA
NVIDIA Jetson AGX Orin can run native DLA inference in Python via cuDLA, supporting the execution of specific neural network operations on DLA hardware to offload GPU inference tasks, thereby improving the energy efficiency of edge applications.
AI applications at the edge often need to run multiple neural networks within limited compute and power budgets. NVIDIA Deep Learning Accelerator (DLA)...
AI applications at the edge often need to run multiple neural networks within limited compute and power budgets. NVIDIA Deep Learning Accelerator (DLA) platforms provide dedicated hardware for deep learning inference. On NVIDIA Jetson AGX Orin, DLA executes supported neural network operations, allowing applications to offload inference work from the GPU. This can improve power efficiency and leave…
Source: NVIDIA Technical Blog · developer.nvidia.com