Skip to content
Live
Artificial Analysis Articles·· 23 days agoFeatured87

Kimi K3.1 Pro launches at 4th on the Artificial Analysis Intelligence Index scoring 55, making large gains in agentic performance; it will be the leading open-weights model once its weights are published

Kimi K3.1 Pro launches at 4th on the Artificial Analysis Intelligence Index scoring 55, making large gains in agentic performance; it will be the leading open-weights model once its weights are published

Brief overview

The dark side of the moon has released the reasoning model Kimi K3.1 Pro, scoring 55 on the Artificial Analysis Intelligence Index and ranking fourth, an increase of 11 points over Kimi K3's 44, second only to Claude Opus 5.5 (58), Claude Sonnet 5.5 (56), and Muse Wonder Full (56).

Why it matters

Third-party reviews provide specific scores and rankings for Kimi K3.1 Pro in terms of intelligence metrics and embodied tasks, allowing for direct comparison with previous generations and proprietary models.

Same story4 other outlets also reported this

How the accounts differ:Artificial Analysis gives the score 55 and ranks fourth; MarkTechPost mentions the total parameters of 2.8T and the MoE model with 104B active parameters.

  1. MarkTechPost··First

    Moonshot AI has released Kimi K3.1 Pro: a 2.8T total parameter, 104B activated MoE model that supports a context length of 1M.

  2. ITHome · AI··+57 min

    Moonshot AI releases Kimi K3.1 Pro model

  3. Latent Space··+8 h 26 min

    Kimi K3.1 Pro 104BA-2.8T Released: Open-Source Weight Model Reduces Closed-Source AI Lead to 1 Month

    Adds:Open-source weight model with 2.8 trillion parameters.

  4. Interconnects··+36 h 56 min

    Kimi K3.1 Pro release sparks controversy, analysis of its benchmark test performance and market response.

In order of publication · later reports are added as they appear · Compared by AI from each outlet’s title and summary

Article

Kimi K3.1 Pro launches at 4th on the Artificial Analysis Intelligence Index scoring 55, making large gains in agentic performance; it will be the leading open-weights model once its weights are published

See model page

tweet-1-intelligence-indexz.png

Moonshot's new reasoning model gains 11 points over Kimi K3 (max, 44). It trails only Claude Opus 5.5 (max with fallback, 58), Claude Sonnet 5.5 (max with fallback, 56), and Muse Wonder Full (max, 56) on the Intelligence Index.

Once the weights for K3.1 Pro are released it will be the highest-scoring open weights model and the gap between the leading open weights and proprietary models on the Intelligence Index will narrow from 12 points to 3.

Key results: ➤ Large gains in agentic performance: Kimi K3.1 Pro scores 3rd on GDPval-AA with 1,846 Elo, up 312 Elo from Kimi K3, behind only Claude Opus 5.5 (1,866 Elo) and Muse Wonder Full (1,857 Elo). Kimi K3.1 Pro also achieves the highest score of any model on Terminal-Bench 4.0. K3.1 Pro scores 67%, up from 13% for Kimi K3 and ahead of Claude Sonnet 5.5 (64%). AutomationBench-AA, which tests agentic SaaS workflows, rises from 58% to 73%.

➤ Gains in other evals are more moderate: Humanity's Last Exam rises from 47% to 52%, CritPt from 23% to 25%, and SciCode from 59% to 61%. AA-Omniscience Index rises from 20 to 30, as the hallucination rate falls from 53% to 44% and accuracy rises from 48% to 51%.

➤ Cost per Task roughly equal to Kimi K3 at $1.98 per Task: K3.1 Pro uses 55K output tokens per Intelligence Index task, 14% more than Kimi K3 at 48K, while its first-party token prices are 33% lower.

Additional model details: ➤ Context window: 1M tokens. ➤ Size: 2.8T total, 104B active parameters ➤ Input modalities: Text and image ➤ Weights and license: Weights currently not published, Moonshot is expected to release the weights soon after launch ➤ Pricing: $2/$10/$0.20 per 1M input/output/cache hit tokens, 33% lower than Kimi K3 on all three rates.

Individual eval results:

Source: Artificial Analysis Articles · artificialanalysis.ai