Skip to content
Live
Synced·Added· 14 hours ago65

NVIDIA SEED increases the highest throughput per GPU of Qwen3.8-Flash-Next by 42%

Brief overview

NVIDIA SEED technology allows Qwen3.8-Flash-Next to run only the first 31 layers when processing input, and then generates KV Cache and cyclic states for the subsequent 17 layers using lightweight components. The generation stage runs the full 48 layers, with the highest throughput per GPU increased by 42%. This technology leverages the different demands of the input and output stages for Transformer layers.

Source: Synced · jiqizhixin.com