Rising AI costs
The story so far
GPU rental prices have doubled in the past six months. Anthropic's GPU equivalent hourly cost increased from $3.10 to $5.65, forcing AI providers to shift to long-term contracts to lock in rentals of 2 to 4 dollars per hour. The upper limit of AI computing power is expected to reach 80 gigawatts, with a doubling annual growth rate, but GPU hourly costs have doubled within six months to 12-13 dollars, with Anthropic's GPU hourly cost rising by 82% over two quarters. GPU supply has doubled in sync with price, but physical reality has become a bottleneck in demand, continuously pushing up GPU hourly prices.
AI-written from the reports · Updated 10 days ago
Developments
2 developments
- 4 Nov, 08:00 · 1 reportsAI CeilingTomasz Tunguz:Watts in Store for 2027 : The AI Ceiling
- 3 Nov, 08:00 · 1 reportsRising AI costsTomasz Tunguz:The Financial Engineering Essential for AI in 2027
Coverage timeline
Follow the coverage to see every side of the story.
- Tomasz TunguzWatts in Store for 2027 : The AI Ceiling
The upper limit of AI computing is expected to reach 80 gigawatts in 2027, with the annual growth rate doubling, but the cost per GPU hour will double within half a year to $12-13, with Anthropic's GPU hour cost rising by 82% in two quarters. The growth of GPU supply and price will double simultaneously, with physical reality becoming a bottleneck in demand, continuously pushing up the cost per GPU hour. Theoretically, AI revenue will increase from $140 billion at 38 gigawatts to nearly $500 billion at 43 gigawatts, but high costs may force model companies to adjust the allocation of GPU timing between training and inference, limiting the speed of innovation.
- Tomasz TunguzThe Financial Engineering Essential for AI in 2027
GPU rental prices have doubled in the past 6 months, Anthropic's GPU equivalent hourly cost has increased from $3.10 to $5.65, forcing AI providers to switch to long-term contracts to fix rents between 2 and 4 dollars per hour