v0.40.9-rc3: Support GA Gradium Phonon checkpoints (#19227)

Brief overview

Speech Ollama can use Phonon to generate speech on Apple Silicon, streaming audio via the /v1/audio/speech endpoint; the d3 decision model supports parameter sizes from 2B to 27B for classification, scoring, and other tasks; Flint expanded to Linux and Windows platforms, other improvements include error reporting and model capability transfer.

Article

Speech

Ollama can now generate speech with Phonon on Apple Silicon. ollama run plays text or a chat model's reply aloud as the audio is generated, and apps can stream audio through the OpenAI-compatible /v1/audio/speech endpoint.

ollama run phonon "Hello from Ollama."

d3 decision models

d3 brings vLLM Semantic Router's decision models to Ollama. Give a model text, structured state, or an image, and ask it to classify, answer yes or no, or score options with probabilities. The family includes 2B, 4B, 9B, and 27B sizes.

ollama run d3 "A customer says their card was charged twice." --ask "Is this a billing issue?"

Flint on Linux and Windows

Flint now runs on Linux and Windows as well as macOS.

Other improvements

Streaming OpenAI Responses and Anthropic Messages requests now report generation failures instead of ending silently after partial output.
ollama launch now passes cloud models' context lengths and capabilities to coding tools, fixing incorrect context and compaction settings.
Anthropic-compatible web search now uses the model's supported thinking setting in follow-up requests, preventing avoidable failures.

Full Changelog: v0.40.8...v0.40.9