vLLM supports Thinking Machines' Inkling 2 Small on its first day of release
vLLM provides support for Inkling 2 Small on its first day of release. The model is a multimodal MoE with text and visual inputs, featuring a total of 594B parameters, 17B activation parameters, a maximum context length of 1M tokens, and comes with a built-in DSpark beam decoder.
Why it matters: The original text provides details of vLLM's Day-0 support for Inkling 2 Small and multiple kernel optimizations, allowing readers to understand the deployment path and throughput performance of the model.















