MoE routing policy comparison
The story so far
No overview yet — start with the coverage timeline below.
Developments
2 developments
- 8 Nov, 18:27 · 1 reportsRouting Comparison of MoE ModelsMarkTechPost:Which Routing Does Each MoE Model Use? DeepSeek, Qwen, Mixtral, Llama 4, gpt-oss Compared
- 8 Nov, 14:18 · 1 reportsMoE Routing Strategies ExplainedMarkTechPost:MoE Routing Strategies Explained: Top-K, Expert-Choice, Sigmoid Gating and Dynamic Routing (2026 Guide)
Coverage timeline
Follow the coverage to see every side of the story.
- MarkTechPostWhich Routing Does Each MoE Model Use? DeepSeek, Qwen, Mixtral, Llama 4, gpt-oss Compared
DeepSeek-V4-Pro, Qwen3.6-35B-A3B, and ten other open-source MoE models differ in five aspects: expert count (8B-384B), top-k (1-8), shared experts (7/10 models retained), scoring function (Sigmoid/sqrtsoftplus), and load balancing (Aux loss/bias).
- MarkTechPostMoE Routing Strategies Explained: Top-K, Expert-Choice, Sigmoid Gating and Dynamic Routing (2026 Guide)
MoE routing strategies determine which experts process each token, affecting model quality, load balancing, and deployment costs. Mixtral uses Softmax Top-K to select 2-8 experts, while DeepSeek-V4-Pro selects 1-8 out of 384. Load balancing is achieved through Sigmoid gating and auxiliary loss, with Sigmoid scoring combined with lossless bias balancing being a common approach for cutting-edge open models in 2026.