Apple Announces New AI and ML Powered Eye Tracking and Music Haptics Accessibility Features

Apple is bringing these features for both the iPhone and the iPad.

Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 16 May 2024 17:40 IST

Apple Announces New AI and ML Powered Eye Tracking and Music Haptics Accessibility Features

Photo Credit: Apple

Apple Vision Pro will also get a system-wide live captions feature to help those with hearing impairments

Highlights

A Vocal Shortcuts feature will let users perform tasks with custom sound
Apple is adding vehicle motion cues to help users with motion sickness
Apple CarPlay is also getting a voice control feature

Apple announced several new accessibility-focused features for its iPhone and iPad devices on Wednesday. The company regularly introduces new accessibility features to make the devices easier to use for those who suffer from physical disabilities. This year, the tech giant is bringing a new Eye Tracking feature that will allow users to control their device with just eye movements. Additionally, Music Haptics will let users experience music via vibrations, and Vocal Shortcuts will let them perform tasks with custom sounds.

The features were announced via a post on the company's newsroom. Apple's senior director of Global Accessibility Policy and Initiatives, Sarah Herrlinger said, “Each year, we break new ground when it comes to accessibility. These new features will make an impact in the lives of a wide range of users, providing new ways to communicate, control their devices, and move through the world.”

First, the Eye Tracking feature offers users a built-in option for operating iPhone and iPad with just eye movements. Powered by artificial intelligence (AI), this feature uses the front camera which can be calibrated with the user's eyes and the on-device machine learning (ML) features track the eyes to let people with physical disabilities easily navigate through the phone. The company says that it does not have the access to the user data.

iPhone 16 Pro Max Spotted in Leaked Images, Could Be Larger This Year

Music Haptics is another new feature that offers a unique way for users to experience music who suffer from hearing impairments. The feature, on iPhone, leverages the Taptic Engine to play taps, textures and vibrations to match the audio of the music. Apple says the feature can play millions of songs in the Apple Music catalogue. It will also be available as an API for developers to integrate it in their music apps.

Next, Vocal Shortcuts for iPhone and iPad users is designed to help people suffering from speech-related disabilities. It allows users to set custom utterances that can be understood by Siri to launch shortcuts and complete tasks. Further, a new feature dubbed Vehicle Motion Cues adds animated dots on the edges of the screen to reduce sensory conflict between what a person sees and feels. Citing research, Apple said this conflict is one of the main reasons behind motion sickness, and the feature can reduce such symptoms.

Apart from these, CarPlay is also getting voice control, sound recognition, and colour filters to help users with various disabilities. Apple's newest product line, Vision Pro is also getting a system-wide live caption feature for those with hearing difficulties.

Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Apple, iOS, iPadOS, iPhone, iPad, AI, Artificial Intelligence

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More