Why it matters: Hydrogen surpasses larger Argon in the default thinking mode, while providing price and independent review data, allowing judgment on the cost-effectiveness of lightweight models.
#Benchmarks
The day's essential AI stories, from the labs, startups and researchers shaping it.
The DecoderFeaturedSame story · 2 outlets8888Same story · 2 outlets
QbitAIFeatured7171360 DragonBox tops CyberGym rankings with 99.4% vulnerability reproduction success rate
360's self-developed AI security offense and defense system, DragonBox, tops the CyberGym rankings with a 99.4% vulnerability reproduction success rate, with independent evaluation success rates of 99.27%, 99.47%, and 99.40% over three rounds.
Why it matters: The original text provides DragonBox's success rates in the three rounds of CyberGym evaluations and its training routes, allowing readers to judge the approach of large security models combined with intelligent swarm agents.
The DecoderFeaturedSame story · 2 outlets7373Thinking Machines has released the Inkling 2 Small, claiming it is the strongest Western open-source weight model.
Thinking Machines releases second-generation model Inkling 2 Small, using MoE architecture, with total parameters of 594B and activation parameters of 17B, supporting text and image input and adjustable thinking depth.
Same story · 2 outletsWhy it matters: The original text provides specific comparisons of the new model in terms of intelligence index, agent tasks, and cost, allowing readers to judge the competitive position of open-source weight models accordingly.
The DecoderFeatured7070Tencent has released the Hy4 model, which first supports image understanding and computer operation.
Tencent has released the Hy4 model, which is capable of image understanding for the first time and can operate software such as Blender, CAD autonomously, the weight will be opened on an undetermined date later, it is currently only provided through applications such as Tencent Cloud, OpenRouter, and Yuanbao.
Why it matters: Tencent Hy4 has joined image understanding and computer operation capabilities for the first time, there is a gap between third-party reviews and official statements, you can compare to see the real position of the open weight model.
ITHome · AIFeatured7878The dark side of the Moon releases Kimi K3.1 Pro weights, topping the Agent Arena open-source model list
As promised on October 24, the 2.8 trillion parameter Kimi K3.1 Pro model weights have been opened on Hugging Face.
Why it matters: The original text provides the Agent Arena rankings and changes in individual indicators after the open weights, which can be compared with the previous generation K3 to see the improvement in agent capabilities.
Hugging Face BlogFeatured6565Dharma-AI releases Dharma Field Extractor: 2B parameter model extracts any document into JSON fields
Dharma-AI releases Dharma Field Extractor, a 2B parameter model, input document image and optional schema, output typed structured JSON, supports open extraction and schema-directed extraction, missing fields return null.
Why it matters: The original text provides a comparison of quality and cost on self-built benchmarks, allowing readers to judge the feasibility of the small model specialized route in field extraction tasks.
Latent SpaceFeatured8282Gemini 4 Carbon topped multiple lists and was the first to be opened to cybersecurity defenders.
Google DeepMind released Gemini 4 Carbon, only two weeks after Argon, claiming to achieve SOTA in cybersecurity and long-period tasks, ranking first with a score of 59 on the Artificial Analysis Intelligence Index v5.
Why it matters: Summarizes the positions and pricing of Gemini 4 Carbon on multiple independent lists, and lists the gaps in coding, hallucination rate, etc., compared to competitors.
The DecoderFeaturedSame story · 5 outlets8989Google DeepMind releases Gemini 4 Carbon, just two weeks after Argon.
Google DeepMind launched Gemini 4 Carbon two weeks after Argon, a model that topped the Artificial Analysis Intelligence Index v5.0 with 59 points, surpassing the previous Argon with 50 points.
Same story · 5 outlets- Artificial Analysis Articles · Gemini 4 Carbon topped the Artificial Analysis Intelligence Index v5First
- Ars Technica · AI · Google has released Gemini 4 Carbon: a cutting-edge AI model that cannot be used immediately.
- The Verge · AI · Google releases Gemini 4 Carbon, achieving a 'major leap' in cybersecurity capabilities
Why it matters: The original summary compiled third-party reviews and pricing data, allowing readers to compare the gaps between Gemini 4 Carbon, Argon, and Claude Opus 5.5 in intelligent agent coding and safety tasks.
The DecoderFeatured7171Nvidia releases open-source speech model Nemotron 3.5 Transcribe, integrating transcription, translation, and speaker recognition
Nvidia releases open-source speech recognition model Nemotron 3.5 Transcribe, supporting transcription in 40 languages, translation between 31 languages and English, and speaker recognition in 13 languages, capable of processing recordings up to 1 hour long with a maximum of 8 people.
Why it matters: The original provides benchmark comparisons for multi-language transcription, speaker recognition, and translation, as well as single-card deployment and fine-tuning costs, to help determine the practical boundaries of speech models.
Microsoft AI NewsFeaturedSame story · 2 outlets6767Microsoft released the MAI Image 2.7 image editing model, ranking 3rd on Arena Edit and 2nd on Artificial Analysis.
Microsoft AI released the image editing model MAI Image 2.7, launching as a preview version. It ranks 3rd in Arena Edit and 2nd in the Artificial Analysis image editing chart, making Microsoft AI the 2nd place lab.
Same story · 2 outletsWhy it matters: Microsoft announced the rankings of MAI Image 2.7 on two image editing lists and provided the improvement magnitude on 10 use cases compared to the previous generation.
Artificial Analysis ArticlesFeatured8585OpenAI released GPT-6.1 Terra, focusing on cost efficiency.
OpenAI released GPT-6.1 Terra, the first Terra-level model after GPT-5.6, with input/output pricing at $1/5 per million tokens, lower than the $2/12 per million tokens of GPT-5.6 Terra.
Why it matters: The original text used the scores of the Intelligence Index and Coding Agent Index, along with the cost per task, to quantify the change in cost-effectiveness of GPT-6.1 Terra compared to GPT-5.6 Terra.
Simon WillisonFeatured8282Kimi K3.1 Pro goes live with Kimi API, promising to open source weights by November 4th.
Kimi K3.1 Pro goes live with Kimi API today, weights not yet open, Moonshot promises to release complete model weights by November 4th, 2026. Pricing is $2.00/100 million tokens for input, $10/100 million tokens for output, the same as GPT-6.1 Sol, half of Claude Opus 5.5, also provides a Highspeed version that is 2-3 times faster and doubles the price.
The DecoderFeatured8585Why it matters: The article uses third-party indices and multiple benchmarks to present the specific extent to which the gap between open-source weight models and closed-source cutting-edge models has narrowed.











