Skip to content
Live
Trending storyPast story

MoE routing policy comparison

2 reports1 outlets10 days agoUpdate

The story so far

No overview yet — start with the coverage timeline below.

Developments

2 developments

  1. 8 Nov, 18:27 · 1 reports
    Routing Comparison of MoE Models
    MarkTechPost:Which Routing Does Each MoE Model Use? DeepSeek, Qwen, Mixtral, Llama 4, gpt-oss Compared
  2. 8 Nov, 14:18 · 1 reports
    MoE Routing Strategies Explained
    MarkTechPost:MoE Routing Strategies Explained: Top-K, Expert-Choice, Sigmoid Gating and Dynamic Routing (2026 Guide)

Coverage timeline

Follow the coverage to see every side of the story.

8 Nov
  1. MarkTechPost
    Which Routing Does Each MoE Model Use? DeepSeek, Qwen, Mixtral, Llama 4, gpt-oss Compared

    DeepSeek-V4-Pro, Qwen3.6-35B-A3B, and ten other open-source MoE models differ in five aspects: expert count (8B-384B), top-k (1-8), shared experts (7/10 models retained), scoring function (Sigmoid/sqrtsoftplus), and load balancing (Aux loss/bias).

  2. MarkTechPost
    MoE Routing Strategies Explained: Top-K, Expert-Choice, Sigmoid Gating and Dynamic Routing (2026 Guide)

    MoE routing strategies determine which experts process each token, affecting model quality, load balancing, and deployment costs. Mixtral uses Softmax Top-K to select 2-8 experts, while DeepSeek-V4-Pro selects 1-8 out of 384. Load balancing is achieved through Sigmoid gating and auxiliary loss, with Sigmoid scoring combined with lossless bias balancing being a common approach for cutting-edge open models in 2026.