跳到正文
实时
Epoch AI· Jaeho Lee·· 2026-10-1665

开源模型在网络安全能力上落后闭源模型6-7个月。

Open-weight models trail closed models in cyber capabilities by 6–7 months

要点速览

Epoch AI 通过网络安全基准测试 Cyber ECI 对比开源与闭源模型,发现开源模型在网络安全能力上落后闭源模型 6-7 个月。该测试基于 ECI 的网络安全版本,使用相同参数评估模型。

正文

Epoch's work is free to use, distribute, and reproduce provided the source and authors are credited under the Creative Commons BY license.

Learn more about this graph

We compare open- and closed-weight models using the Cyber ECI, a domain-specific version of the Epoch Capabilities Index (ECI) based on cybersecurity benchmarks. We keep the benchmark parameters from a joint fit of the ECI on general and cyber benchmarks, and estimate each model’s Cyber ECI from its cyber results alone. Scores are on the same scale as the general ECI. See our documentation for details on the methodology.

Data

Analysis

Assumptions and limitations

Download this data

Cyber ECI scores of open- and closed-weight models

CSV, Updated Oct. 8, 2026

来源: Epoch AI · epoch.ai