Apples AI-powered accessibility upgrades include eye-controlled wheelchairs

Source: Mashable Tech

Apple Intelligence is coming to the company’s industry‑leading accessibility tools, including upgraded vision, captioning, and mobility features now enhanced with machine learning.

In honor of Global Accessibility Awareness Day (May 21), Apple announced a suite of new AI‑powered capabilities for the Apple ecosystem, covering its most popular accessibility offerings like VoiceOver, Magnifier, Voice Control, and Reader.

“Apple’s approach to accessibility is unlike any other. Now, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design,” — Tim Cook, CEO

Upgraded access tools

Many of the new upgrades focus on vision and voice‑control tools for users who are blind, have low vision, or have varying ranges of mobility.

• Image Explorer (part of VoiceOver) provides more detailed descriptions of device displays and content.
• Live Recognition can be activated via the iPhone Action button and respond to follow‑up questions.

Instead of memorizing specific commands or screen locations, iPhone and iPad users can use natural‑language commands with Voice Control and on‑device tools like Magnifier. For example, a user can ask the device to “tap the orange folder” or “zoom in on that word,” and the device will respond—Apple calls this the power to “say what you see.”

Credit: Apple

New way to caption content

Apple’s AI can automatically generate on‑device subtitles for uncaptioned video, including:

• Content recorded on‑device by Apple users
• Video sent to users without captions
• Streamed video

The Accessibility Reader tool is also being upgraded to:

• Navigate complex text such as scientific studies with columns, images, and tables
• Provide on‑demand summaries
• Translate languages without altering custom formatting

Apple Vision Pro for power wheelchair users

Apple is adding a feature to Apple Vision Pro that lets power wheelchair users navigate their mobility devices using only the VR headset. The feature leverages the device’s eye‑tracking technology—already used for alternative drive controls, device navigation, and communication tools—but requires less frequent calibration than typical drive‑control devices.

Apple recommends using Vision Pro headsets only in controlled environments without potential obstacles or inclement weather.

Credit: Apple

Additional accessibility updates

• Easier pairing and hand‑off of Made for iPhone hearing aids when switching devices.
• Integration of human ASL interpreters into ongoing FaceTime calls.
• tvOS now supports larger text for users with low vision.
• Name Recognition expands to 50 languages.

Apple said the upgraded tools and features will roll out later this year. The company also announced an expansion of its collaborative Hikawa Grip & Stand line, a third‑party accessibility accessory designed by artist Bailey Hikawa and released for a limited time last year.

Apple newsroom announcement
Name Recognition support
Vision Pro safety guidelines
Hikawa Grip & Stand details