Skip to content
Live

Fields

Voice & audio

Advances in AI speech and audio: models and products for speech synthesis, real-time dialogue, music generation, and audio understanding.

13featured stories
13this month
14 Nov, 21:05Updated
Active this month

Latest stories

Nov 14Sat1–8
  1. QbitAI80

    DeepSeek has opened the entire suite of application APIs, with voice interfaces included for the first time.

    DeepSeek has officially opened the entire suite of application APIs, including online search, deep thinking search, file upload, and link reading features within the app, all providing independent interfaces that can be called separately and billed individually. Voice capabilities have been included in the open list for the first time, including ASR and TTS interfaces. The original price for speech recognition is 0.78 yuan per hour, now half off at 0.39 yuan per hour, and speech synthesis is 1.5 yuan per 10,000 characters.

    Why it matters: The original text lists the tool interfaces opened by DeepSeek and the half-price voice pricing, allowing readers to estimate the call costs for voice assistant and document processing applications.

Nov 7Sat
  1. Cursor Changelog60

    Cursor online with real-time voice calls to agents

    Cursor launches Voice Chat, allowing users to have real-time voice calls with agents, dictate modification requests, ask what the agent is doing, and receive progress updates.

    Why it matters: Officially, it explains which platforms the voice call is available on and how to divide tasks with coding agents, allowing readers to judge which collaboration scenarios it suits.

Nov 6Fri
  1. ITHome · AI72

    Meta launches real-time voice chat and virtual avatar features for AI assistant Muse

    Meta announces the launch of real-time voice chat and virtual avatar features for its personal AI assistant Muse, rolling out first to users in the United States, covering mobile, web, and Mac apps. The feature is supported by two models, Muse Realtime Voice and Muse Realtime Avatar, capable of streaming vertical videos at a resolution of 448×768 and 25 frames per second. The delay from the user finishing speaking to receiving the first audiovisual response is approximately 870 milliseconds.

    Why it matters: The original text provides the latency, resolution, and interaction methods for real-time voice and virtual avatars, allowing readers to judge the maturity of such face-to-face intelligent agent interactions.

Nov 5Thu
  1. Hugging Face Blog72

    Phonon TTS releases on-device speech models, topping multiple metrics on the Hugging Face open TTS leaderboard

    Phonon releases a small TTS model that can run on local devices, without a server and network, offering two versions of about 65 MB and 75 MB, covering English, French, German, Spanish, and Portuguese.

    Why it matters: The original text outlines the specifications, open-source license, and leaderboard performance of on-device TTS models, allowing judgment on the usability boundary of small models in local voice scenarios.

Oct 29Thu
  1. ITHome · AI78

    NVIDIA open-sourced the speech transcription model Nemotron 3.5 Transcribe, supporting 40 languages and 8 speaker separation.

    NVIDIA launched the open-weight speech transcription model Nemotron 3.5 Transcribe on October 28, integrating transcription, speaker attribution, translation, and audio Q&A, using the MoE architecture, with total parameters of about 34 billion and activation parameters of about 4.3 billion, capable of processing the longest recording of 1 hour, supporting transcription of 40 languages, and distinguishing up to 8 speakers.

    Why it matters: NVIDIA open-sourced the speech transcription model, disclosing parameter scale, multilingual and speaker separation capabilities, and benchmark results, allowing comparison with existing open-source ASR solutions.

Oct 28Wed
  1. Hugging Face Blog78

    NVIDIA has released Nemotron 3.5 Transcribe and the Granary v2 data pipeline.

    NVIDIA has released the open-source weight model Nemotron 3.5 Transcribe, integrating transcription, speaker separation, translation, and audio Q&A into a single checkpoint, supporting transcription in 40 languages, translation between 31 languages and English, and speaker annotation in 13 languages, capable of processing the longest 1-hour recordings and annotating up to 8 speakers.

    Why it matters: The original text provides a unified weighting model for multilingual transcription, speaker separation, and translation, along with an open data pipeline and fine-tuning recipes, which can be used to determine the adaptation path for voice scenarios.

Oct 25Sun
  1. Ollama Blog62

    Ollama launches speech model, premiering Phonon text-to-speech

    Ollama adds text-to-speech capability, the first integrated speech model is the small TTS model family Phonon from Gradium, currently supporting macOS, Windows, and Linux with support for Linux to be released soon.

    Why it matters: The original text provides throughput comparison, accuracy, and OpenAI-compatible interface after Ollama integrates speech models, which can be used to judge the local TTS implementation method.

Oct 22Thu
  1. Tencent Hunyuan · Hugging Face new models72

    Tencent Mixuan open-sourced the real-time simultaneous translation model Hy-SimulMT-30B-A3B

    Tencent Mixuan has released and open-sourced the real-time simultaneous translation model Hy-SimulMT-30B-A3B, supporting bidirectional Chinese-English voice-to-voice translation, capable of continuously outputting translated text and speech during speech, and supporting real-time voice cloning.

    Why it matters: The official provides a comparison of latency and quality for real-time simultaneous translation, and opens up multiple quantitative versions and inference deployment scripts, which can be used to evaluate the deployment cost.