Apple has begun beta testing four new AI-powered features for the Apple Watch under its Audio Intelligence branding, initially available to developers through the iOS 27.3 update. The features, first announced at the company’s Surprise and Shine event in September, include sound and song recognition alongside two more potentially controversial capabilities: Live Rewind, which lets wearers capture and review short snippets of conversation, and Siri Recaps, which generates summaries of conversations.
The sound recognition feature helps wearers identify important sounds such as sirens, alarms or doorbells, and is designed to assist deaf and hard-of-hearing users. The song recognition function identifies music playing in the background through Apple’s Shazam app.
Apple is rolling out the features against the backdrop of public backlash to AI recording devices, such as Meta’s AI glasses. The company has attempted to carve out a space where the features are useful while respecting the privacy of those around the wearer. Users must opt in to each feature, and the watch signals recording with an audible chime and an animation on the display.
With Live Rewind, a wearer can double-press the digital crown to see the last 15 seconds of conversation displayed as a text snippet on the watch face. If the user does nothing, the snippet disappears permanently after 30 seconds. It can be saved to the standalone Siri app for later use, and users can tap an ‘Ask Siri’ option to ask questions about something that was said.
Siri Recaps takes this further by summarising conversations into a short sentence and bullet points. Apple says it does not identify speakers, save raw audio, or provide word-for-word transcriptions. Instead, the summaries capture key points such as dates, deadlines, or pricing. Users can schedule when the feature runs, for example only during work hours, and can turn it off at any time from the Control Center. Recaps that are not saved are automatically deleted within seven days. Apple says Siri Recaps has been designed to omit sensitive information such as government identifiers, financial data, and language related to self-harm.
The technology relies on a secure enclave on the iPhone, a hardware-protected memory space that processes raw audio without making it accessible to the operating system or to Apple. The audio is transferred to the paired iPhone through a secure pairing mechanism. On-device processing on the phone condenses the audio into text, which is then encrypted and sent to Apple’s Private Cloud Compute to generate the recap. The recap and any summarizations used to create it are deleted from Private Cloud Compute immediately afterward. Apple says the features should not affect battery life.
The features will later roll out to a public beta for broader testing before becoming publicly available to all.
Analysis
Why This Matters
- Apple’s Audio Intelligence features bring AI-driven conversation capture to a mass-market wearable, raising both utility and privacy considerations.
- The privacy architecture (on-device processing, secure enclave, cloud deletion) could become a template for similar products.
- The public beta will provide early signals on user acceptance of ambient listening on a wrist device.
Background
Apple announced Audio Intelligence at its Surprise and Shine hardware event in September 2026. The features are supported on Apple Watch Series 12 and Apple Watch Ultra 4, which include the S11 chip. The beta is part of the iOS 27.3 developer update.
What to Watch
- How early testers and privacy advocates respond to the beta.
- Whether regulators, particularly in Europe, scrutinize the conversation-summarisation features.
- Apple’s timeline to expand from developer beta to public beta and final release.
Checked
11 claims in this story checked against 1 source: 9 supported.
Show each claim
- SupportedApple Watch beta testing has begun for Live Rewind and Siri Recaps.AI News & Artificial Intelligence | TechCrunch: “Apple’s AI-powered “Audio Intelligence” technology for the Apple Watch is now rolling out into beta testing”
- Partly supportedThe four Audio Intelligence features are initially available to developers through the iOS 27.3 update.AI News & Artificial Intelligence | TechCrunch: “now rolling out into beta testing, initially for developers in the iOS 27.3 update”
- SupportedThe features were first announced at Apple’s Surprise and Shine event in September.AI News & Artificial Intelligence | TechCrunch: “after first being announced at the company’s Surprise and Shine hardware event in September.”
- SupportedThe four features include sound recognition, song recognition, Live Rewind and Siri Recaps.AI News & Artificial Intelligence | TechCrunch: “The technology includes a set of four opt-in AI features that allow Apple Watch Series 12 wearers to detect important sounds, identify songs, catch up on conversations, and take notes.”
- SupportedSound recognition helps deaf and hard-of-hearing users identify sounds such as sirens, alarms and doorbells.AI News & Artificial Intelligence | TechCrunch: “The sound recognition feature will help deaf and hard-of-hearing users identify important sounds like sirens, alarms, or doorbells from their watch”
- SupportedLive Rewind displays the last 15 seconds of conversation as a text snippet when the wearer double-presses the Digital Crown.AI News & Artificial Intelligence | TechCrunch: “you could double-press on the Watch’s digital crown to see what was said in the last 15 seconds as a text snippet displayed on the watch face.”
- SupportedAn unsaved Live Rewind snippet disappears permanently after 30 seconds.AI News & Artificial Intelligence | TechCrunch: “These snippets will be deleted automatically after 30 seconds if you don’t save them.”
- SupportedApple says Siri Recaps does not identify speakers, save raw audio or provide word-for-word transcriptions.AI News & Artificial Intelligence | TechCrunch: “Apple says it’s not identifying speakers, saving the raw audio, or providing word-for-word transcriptions.”
- Partly supportedApple says Siri Recaps is designed to omit government identifiers, financial data and language related to self-harm.AI News & Artificial Intelligence | TechCrunch: “designed to omit sensitive information like government-assigned identifiers, financial and authentication data, certain personal identifiers, and any language that would promote self-harm.”
- SupportedApple says the features should not affect battery life.AI News & Artificial Intelligence | TechCrunch: “Apple says none of these features should impact the battery life of your watch or phone.”
- SupportedThe features will go to a public beta before becoming publicly available to all.AI News & Artificial Intelligence | TechCrunch: “The features will later roll out to the public beta for broader testing before becoming publicly available to all.”
