Skip to content
Live
Trending storyPast story

Hidden storage costs of AI reasoning

1 reports1 outlets28 days agoUpdate

The story so far

AI overview

The data storage overhead generated during enterprise AI inference is often overlooked; the volume of backend data (logs, caches, backups, etc.) to be stored after each model response is 130 times the size of the user's output file. McKinsey predicts that AI inference demand will reach 40% of total data center demand by 2030, and nearly 95% of IT decision-makers report that data volume has increased by generative AI over the past year.

AI-written from the reports · Updated 27 days ago

Coverage timeline

Follow the coverage to see every side of the story.

22 Oct
  1. MIT Technology Review · AI
    AI’s hidden storage bill: What inference leaves behind

    In corporate AI inference costs, data storage overhead is often overlooked. After each model response, a large amount of backend data needs to be stored, including logs, caches, backups, etc., which is 130 times the size of the output files users see. McKinsey predicts that by 2030, AI inference demand will account for 40% of total data center demand, and nearly 95% of IT decision-makers report that data volume has increased by generative AI in the past year.