Baidu Wenxin has open-sourced the ERNIE 5.5 Flash Base base model, with a total parameter of 280B.
Baidu Wenxin has released ERNIE-5.5-Flash-Base and opened the ERNIE 5.5 Flash pre-trained endpoint weights. This is a sparse MoE language model with a total parameter of 280B and 14B activation per token. It was pre-trained from scratch on 33.5T tokens and supports fine-tuning and inference with a context size of up to 1M tokens.
Why it matters: The original text provides the parameters, training data size, and open-source weights of the 280B sparse MoE base, allowing readers to judge its adaptability as a fine-tuning starting point.












