跳到正文
实时
The Decoder· Matthias Bastian·· 7 天前65

思考机器的 Inkling 2 Small 在基准测试中使用了 316 次脏话

Thinking Machines' Inkling 2 Small drops 316 F-bombs across benchmark runs

要点速览

Vals AI研究人员分析了Inkling 2 Small在13个基准测试的2,655次运行中的思考日志,发现其中50次使用了"fuck"或其变体,共316次,其中241次来自两次失控的运行。一次任务中,模型计算小行星轨迹时生成50万字符的单一响应,重复相同句子并包含158个脏话。ProgramBench受影响最严重,200次运行中有20次出现脏话。

正文

Thinking Machines' Inkling 2 Small swears in its internal chain of thought. Researchers at Vals AI read the model's thinking logs from 2,655 runs across 13 benchmarks and found "fuck" or variations in 50 runs, totaling 316 instances. 241 came from just two runs that spiraled out of control. In one, tasked with calculating an asteroid's trajectory, the model produced a single 500,000-character response, roughly novel-length, repeating the same sentences with 158 expletives. ProgramBench was hit hardest, with 20 of 200 runs affected.

Who hasn't felt like this?  | Image: via ValsAI

Inkling 2 Small typically swears about its own mistakes, apparent breakthroughs, or when it gives up. One run read: "FUCK. SUBMIT. DONE. IT'S NOT WORKING. NOTHING WORKS." The profanity doesn't work as a warning signal, though. While 46 of 48 scored runs with swearing failed, about 75 percent of all scored runs fail anyway, and 96 percent of failed runs contained no expletives. Users typically don't see these thinking steps, or only with a filter.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源: The Decoder · the-decoder.com