AWS SageMaker AI Launch SOCI-indexed images to accelerate inference tasks
AWS SageMaker AI introduces SOCI-indexed images functionality, removing container image downloads from the critical path, reducing SageMaker AI training and processing task startup times from minutes to seconds. This feature is achieved by pre-indexing AWS Deep Learning Container (DLC) or adding indexing to custom images, requiring no changes to workload definitions. Benchmark tests show it can reduce GPU idle time by 90% and improve efficiency 8-46 times.
























