Apple Previews New Accessibility Features Powered by Apple Intelligence

Source: MacRumors

Apple today announced a suite of accessibility updates that use Apple Intelligence to expand capabilities across VoiceOver, Magnifier, Voice Control, and Accessibility Reader, with additional new features for generated subtitles and wheelchair control via Apple Vision Pro.

VoiceOver Image Explorer

• Uses Apple Intelligence to produce more detailed descriptions of images throughout the system, including photographs, scanned bills, and personal records.
• Users can press the Action button on the iPhone to ask questions about what the camera viewfinder sees, with follow‑up questions supported in natural language.

Magnifier

• Brings Apple Intelligence‑powered visual descriptions to its high‑contrast interface for users with low vision.
• Accessible via the Action button, with spoken commands such as “zoom in” or “turn on flashlight.”

Voice Control

• Gains natural‑language input so users can describe onscreen elements conversationally (e.g., “tap the guide about best restaurants” or “tap the purple folder”) rather than memorizing exact label names or numbers.
• Helps when on‑screen elements lack proper accessibility labels.

Accessibility Reader

• Supports more complex document layouts, including scientific articles with multiple columns, images, and tables.
• Offers on‑demand summaries and built‑in translation while retaining a user’s custom font, color, and formatting preferences.

Generated Subtitles

• Uses on‑device speech recognition to automatically transcribe spoken audio in uncaptioned video content (clips recorded on iPhone, received from friends and family, or streamed online).
• Available across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro.
• Initially available in English in the U.S. and Canada.

Power Wheelchair Control for Apple Vision Pro

• Leverages the headset’s precision eye‑tracking system as an alternative input method for users who cannot operate a joystick.
• Launches with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.

Apple shared a video about the new VoiceOver feature.

Additional Smaller Additions Coming Later This Year

• Vehicle Motion Cues in visionOS to help reduce motion sickness for passengers in moving vehicles.
• Face gestures on Apple Vision Pro for taps and system actions, plus a new way to select elements with eyes using Dwell Control.
• Made for iPhone hearing aids gain more reliable pairing and handoff between Apple devices, with an improved setup experience across iOS, iPadOS, macOS, and visionOS.
• Name Recognition expands to more than 50 languages, notifying users who are deaf or hard of hearing when someone says their name.
• Larger Text support on tvOS, allowing viewers with low vision to increase onscreen text size.
• Sony Access controller support as a game controller on iOS, iPadOS, and macOS, with full button and thumb‑stick customization and the ability to combine two controllers.
• FaceTime API for sign‑language interpretation app developers to add a human interpreter to an ongoing video call.
• Touch Accommodations gain a new way to personalize setup in iOS and iPadOS.

MagSafe Accessory

A MagSafe accessory designed by Los Angeles‑based designer Bailey Hikawa is now available globally in three new colors via the Apple Store online. Developed in collaboration with individuals with disabilities affecting grip, strength, and mobility, it is distributed internationally through a partnership with PopSockets.

All of the announced features are expected to arrive later this year. Voice Control’s natural‑language capabilities will be available in English in the U.S., Canada, the UK, and Australia.

Global Accessibility Awareness Day falls on the third Thursday of May each year. While no firm release date is given for the features, they typically arrive with Apple’s new operating‑system updates in the fall—iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27—expected to be unveiled at WWDC in June before shipping in September.