Apple announces Apple Intelligence powered accessibility feature updates

Source: TechCrunch

Apple Intelligence‑Powered Accessibility Updates

Apple announced a suite of new accessibility features powered by Apple Intelligence, enhancing VoiceOver, Voice Control, Live Recognition, and real‑time caption generation. Vision Pro users will also be able to control compatible wheelchairs with their eyes.

Enhanced Image Recognition in VoiceOver

Apple Intelligence’s image‑recognition engine now provides richer descriptions. For example, it can examine a bill and read out details such as the amount and due date, and it offers more detailed descriptions of photographs and personal records.

Live Recognition and Magnifier Improvements

• Live Recognition: Users can activate the feature on an iPhone, point the camera at content, and ask follow‑up questions for additional information.
• Magnifier: Low‑vision users can assign Magnifier to the action button, presenting content on a high‑contrast interface. Voice commands such as “zoom in” or “turn on flashlight” can also trigger Magnifier functions.

Natural‑Language Voice Commands

Voice commands are no longer limited to the Magnifier app. Users can describe tasks in natural language to interact with on‑screen elements, e.g.:

• In Apple Maps: “Tap the guide about best restaurants.”
• In Files: “Tap the purple folder.”

Updated Reader for Complex Documents

The Reader now handles multi‑column documents, scientific papers, images, and tables. Users can obtain AI‑generated summaries or have the text read aloud while preserving custom fonts and colors. The feature is designed to assist users with dyslexia, low vision, and other reading challenges.

AI‑Generated Subtitles for Videos

Apple is adding AI‑generated subtitles for videos that lack pre‑existing captions, including:

• Recordings made on iPhone
• Clips received from friends or family

These subtitles work across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, with user‑controllable appearance settings.

Vision Pro Wheelchair Control

A new project enables Vision Pro users to control compatible wheelchairs using eye‑tracking. The system functions under varying lighting conditions without recalibration and will launch with Tolt and LUCI alternative drive systems in the U.S., supporting both Bluetooth and wired connections.

Additional Accessibility Enhancements

• Name‑Recognition: Now supports 50 languages, notifying users with hearing disabilities when their name is spoken.
• Large Text Support: Added to tvOS.
• Made‑for‑iPhone Hearing Aids: Improved handoff between devices.

Availability

Apple indicated that these features will roll out later this year, likely as part of the upcoming iOS 27 release.