Apple Previews AI Powered Accessibility Features

Apple today previewed a wide ranging set of accessibility updates, with Apple Intelligence powering new capabilities across VoiceOver, Magnifier, Voice Control, and Accessibility Reader. The company also announced on device generated subtitles for uncaptioned video, and a new feature that lets Apple Vision Pro users control compatible power wheelchairs with their eyes.

The features were announced on Apple's Newsroom ahead of WWDC26, which kicks off on June 8. The new capabilities are coming later this year.

Apple's approach to accessibility is unlike any other, said Tim Cook, Apple's CEO. Now, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design.

Apple also published a statement from Sarah Herrlinger, the company's senior director of Global Accessibility Policy and Initiatives, emphasizing that the updates are designed to protect user privacy at every step.

VoiceOver and Magnifier

VoiceOver and Magnifier are the two tools Apple offers for users who are blind or have low vision. Both are getting an Apple Intelligence upgrade.

The Image Explorer in VoiceOver will use Apple Intelligence to generate more detailed descriptions of images systemwide, including photographs, scanned bills, and personal records. Apple is also updating Live Recognition so that VoiceOver users can press the Action button on iPhone to ask a question about what is in the camera viewfinder, and then ask follow up questions in their own words.

Magnifier, which Apple says is designed as a high contrast interface for users with low vision, is getting the same assistive exploration capabilities. The app will also work with the Action button, and can be controlled by spoken requests such as "zoom in" or "turn on flashlight."

Voice Control gets natural language

Voice Control allows users with physical disabilities to navigate iPhone and iPad entirely by voice. Until now, users have had to memorize exact labels or numbers to interact with onscreen elements.

With Apple Intelligence, Voice Control will support natural language input. Apple describes the option as "say what you see," with examples including "tap the guide about best restaurants" or "tap the purple folder." The company says the change can also help users get around apps where elements are not properly labeled for accessibility.

Voice Control powered by Apple Intelligence will be available in English in the U.S., Canada, the UK, and Australia.

Accessibility Reader

Accessibility Reader is a customized reading view used by people with disabilities ranging from dyslexia to low vision. The updated version handles more complex source material, including scientific articles with multiple columns, images, and tables.

Apple Intelligence will also power on demand summaries of articles, and a new built in translation feature that preserves the user's custom formatting, font, and colors when reading text in their native language.

Generated subtitles

Any video on an Apple device will now be able to display AI generated subtitles when captions are not already provided. The feature works on clips recorded on iPhone, sent by friends and family, or streamed online, and will appear automatically across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro.

Apple says the captions are generated using on device speech recognition for privacy. The appearance of subtitles can be customized in the video playback menu or in Settings. At launch, generated subtitles will be available in English in the U.S. and Canada.

Power wheelchair control on Vision Pro

Apple is leveraging the eye tracking system on Apple Vision Pro to offer power wheelchair users a new way to drive their chairs. The feature is aimed at people for whom joystick control is not an option.

Apple notes that Vision Pro's eye tracking does not require frequent recalibration and works in a range of lighting conditions. The feature launches with the Tolt and LUCI alternative drive systems in the U.S., and supports both Bluetooth and wired connections. A wired connection requires the Apple Vision Pro Developer Strap. Apple says it will continue to work with developers to support additional wheelchair drive systems over time.

Apple included statements from Pat Dolan, founder of GeoALS, and Blair Casey, CEO of Team Gleason, in support of the feature.

Hikawa Grip & Stand

Separately, Apple announced that the Hikawa Grip & Stand for iPhone, an adaptive MagSafe accessory designed by Los Angeles based designer Bailey Hikawa, is now available worldwide on the Apple Store online in three new colors. The accessory, developed in collaboration with PopSockets, was created with input from people with a range of disabilities affecting grip, strength, and mobility.

Apple The Grove in Los Angeles is hosting a Today at Apple session with Hikawa, author Shane Burcaw, and actor Alex Barone on May 20.

Other updates

Apple announced a number of additional accessibility enhancements:

• Vehicle Motion Cues are coming to visionOS to help reduce motion sickness for Apple Vision Pro users riding in a moving vehicle. Vision Pro will also support face gestures for taps and system actions, and a new eye based selection method for use with Dwell Control.
• Touch Accommodations offer a new way to personalize setup in iOS and iPadOS.
• Made for iPhone hearing aids pair and hand off more reliably between Apple devices, with an improved setup experience across iOS, iPadOS, macOS, and visionOS.
• Larger Text support is coming to tvOS.
• Name Recognition, which notifies deaf and hard of hearing users when someone says their name, now works in more than 50 languages.
• A new FaceTime API allows sign language interpretation app developers to add a human interpreter to an ongoing call.
• The Sony Access controller can now be connected as a game controller on iOS, iPadOS, and macOS, with configurable buttons and switches and the option to combine two controllers.

All of the new features are coming later this year. Apple has previously used May announcements like this one as a preview ahead of detailed software demonstrations at WWDC.

My Favorite iPhone Accessories:

• Anker Smart Display Charger
• USB-C cable that shows how fast your charging
• MagSafe Car Mount
• Apple AirTag 2 (1 pack / 4 pack)
• Anker Nano MagSafe Power Bank

Note: That Apple Guide is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. At no extra cost to you.