跳到正文
实时
The Decoder· Matthias Bastian·· 9 天前

百度发布开源 ERNIE 5.5 Flash Base 大模型

Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model

要点速览

百度发布 ERNIE-5.5-Flash-Base 开源基础模型,含 2800 亿参数,采用混合专家架构,单次输入激活 140 亿参数,预训练覆盖 3350 万亿 tokens,支持高达 128 万 tokens 的训练上下文,推理时上下文最长可达 100 万 tokens。

同一件事另外 3 家也报道了

  1. 量子位··首发

    百度开源文心5.5 Flash Base,在多基准测试中刷新同尺寸模型 SOTA

  2. IT之家 · AI··+1 小时 6 分

    百度文心开源发布 ERNIE 5.5 Flash Base 基座模型,总参数 280B

  3. The Decoder··+10 小时 41 分·当前阅读

    百度发布开源 ERNIE 5.5 Flash Base 大模型

    新增信息:The Decoder 提到预训练覆盖 3350 万亿 tokens。

  4. MarkTechPost··+14 小时 18 分

    百度发布 ERNIE 5.5 Flash Base:一个 280B MoE 基础模型,每 token 激活 14B 参数

按发布时间排列 · 事件后续出现时自动追加 · 由模型根据各家标题与摘要比对

正文

Baidu's AI development is still alive, but most of the work is on you. The Chinese company has released ERNIE-5.5-Flash-Base, an open foundation model that ships deliberately without fine-tuning or post-training. Developers are expected to decide for themselves where to take the model. A post-trained version is supposed to follow.

ERNIE 5.5 uses a mixture-of-experts architecture with 280 billion parameters, 14 billion of which are active per input. The model was pre-trained on 33.5 trillion tokens with a training context of up to 128,000 tokens, though it's designed to support a context of up to one million tokens during fine-tuning and inference.

Benchmark results for ERNIE 5.5 Flash Base compared to DeepSeek-V4-Flash-Base, Hy3-preview-Base, and MiMo-V2.5-Base, tested with the same evaluation pipeline across the categories Exam, STEM, Reasoning, Knowledge, Code, Multilingual, and Long Context. | Image: Baidu

In benchmarks for reasoning, code, and long-context tasks, the model competes with similarly sized open foundation models like DeepSeek V4 Flash or MiMo V2.5, according to Baidu. The weights are available on Hugging Face in FP8 and BF16.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源: The Decoder · the-decoder.com