Microsoft AI has released an 80 billion parameter MoE large model MAI-Base-2.
Microsoft AI has completed the pre-training of a new MoE large model MAI-Base-2, with 80 billion active parameters and 2.8 trillion total parameters, surpassing all open-source models in internal evaluations. The model is 4-12 times more efficient in pre-training FLOPs than the strongest open-source base model DeepSeek-V4-Pro-Base and is used to train larger models. Microsoft plans to license the model weights through Foundry using organic data pre-training and full-stack control.




















