Infrathon: A benchmark for language intelligent agents used in long-term AI infrastructure optimization in the real world.
Infrathon conducted 150 long-term AI infrastructure optimization task evaluations on six models, consuming a total of 10,000 GPU hours, and found that the model rankings changed with the evaluation duration. 135 tasks achieved further optimization in the latter half of the budget, and Claude Opus 5.5 increased the KV cache compression rate from 6.82% to 19.86%, exceeding human design baselines. Analysis shows that task violations, unreliable testing, and premature completion are the main obstacles to continuous optimization.

















