Stanford research found that 44% of LLM claims are expired
Stanford researchers tested 50 widely stated claims about LLMs, finding that 44% have expired, with an average lifespan of only 15.7 months. Claims related to reasoning abilities (such as counting, arithmetic, long context information loss) have all become invalid, while claims related to flattery, deception, and strategic behavior persist or even enhance.
















