Skip to content
Live
The Verge · AI· Stevie Bonifield·· 11 days ago65

Apple’s latest watchOS beta includes its new always-on Audio Intelligence features

Apple’s latest watchOS beta includes its new always-on Audio Intelligence features

Brief overview

Siri can access the Apple Watch microphone through the audio intelligence feature in the new watchOS 27.3 developer Beta version, with new Siri Recap and Live Rewind features generating conversation summaries and 15-second audio text transcriptions, supported by double-clicking the digital crown and can be saved through the Siri app; the Health app also receives a redesign, adding health insights, personalized recommendations, and educational content

Article

Stevie Bonifield

Stevie Bonifield

is a news writer covering all things consumer tech. Stevie started out at Laptop Mag writing news and reviews on hardware, gaming, and AI.

Starting today, Siri can tune into the Apple Watch’s mic with Audio Intelligence features that are available in the new watchOS 27.3 developer beta rolling out now. The two new additions are Siri Recap, which uses “ambient listening” to generate summaries of your conversation, and Live Rewind, which generates text transcripts of the last 15 seconds of audio your watch’s mic detected.

Apple is also releasing its redesigned Health app for testing today in the iOS 27.3 developer beta, and announced expanded language support in global English, Chinese (Simplified and Traditional), French, Japanese, Korean, Norwegian, Portuguese, Spanish, Turkish, and Vietnamese. It adds sections like a new Insights tab with summaries for heart, sleep, fitness, and other data that pop up during the day, a For You section with personalized recommendations, and health content like educational videos and articles.

  • Live Rewind, which can help users recall what was just said in conversation. A double-press of the Digital Crown shows the previous 15 seconds of a conversation as a text snippet, so the user can catch something they may have missed or are less familiar with. Users can ask Siri about the content of the text or save it to the Siri app to revisit later.
  • Siri Recap, which can create high-level summaries of conversations that users can review later to jog their memory. When Siri Recap is turned on, after a conversation, Apple Intelligence automatically generates a title and key points in the new Siri app, allowing users to be more present and engaged in the moment.

When it comes to the implications of an ambient, always-listening AI, Apple has released this Audio Intelligence
Privacy Overview (pdf)
about how it plans to protect users’ privacy when their watch is listening around the clock. It goes into detail about Apple’s claims that users’ raw audio “is handled within dedicated hardware, is not saved as a file, and is not accessible to the operating system, apps, or Apple.” According to Apple, “If you use iCloud with two-factor authentication and have a device passcode, any Siri Recap summary or Live Rewind text snippet you choose to save syncs across your devices end-to-end encrypted in the Siri app.”

Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.

  • Stevie Bonifield

Source: The Verge · AI · theverge.com