How AssemblyAI optimizes speech-to-text inference costs using EC2 Spot instances on AWS
AssemblyAI builds an elastic architecture on AWS by hybridly using EC2 On-Demand and Spot instances, and leveraging Amazon ECS, SQS, and EventBridge, to increase GPU instance utilization by 3.5 times, achieve cost reduction within the European AWS region, and meet service level agreements (SLA). Its inference platform is deployed on three GPU instance families: g4dn, g5, and g6.


























