Researchers develop device that translates sign language into text

Advertisement
By Press Trust of India | Updated: 22 July 2013 17:28 IST
Researchers have developed a novel computer system that enables deaf people to translate gestures used in sign language into text.

Using the new technology, people who are deaf or hard of hearing can simply type words and sentences using a keyboard and read those typed to them, researchers said.

Researchers Microsoft Asia and the Institute of Computing Technology at the Chinese Academy of Sciences in this latest effort turned to Microsoft's Kinect device.

Advertisement

They showcased the software that has been developed for the Kinect that successfully translates American Sign Language (ASL) into text, Phys.org reported.

The system operates in two modes: The first, called simply Translation Mode, translates physical hand or body movements into text or speech.

Advertisement

The second, called Communication Mode, allows a person speaking in ASL to communicate with someone else who is communicating in typed English.

The system uses an Avatar to translate text coming from someone typing text on a keyboard, then converts their response to text and sends it back to the other person.

Advertisement

The demonstration by researchers showed that the system is capable of translating sentences, not just words, a significant step forward.

The researchers stressed that their system is still a work in progress but hope to eventually create a system that is fully functional and reasonably inexpensive.

Advertisement

Researchers said that would mean a Kinect based communication system that operates entirely with hand gestures and spoken words - all in real time. Also, it would allow for conversion to other sign language dialects as well.

 

Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.

Advertisement
Popular Mobile Brands
  1. Samsung Galaxy S28 Series May Revive Camera Feature Last Seen on Galaxy S20
  2. Airtel Announces Insider Offers Worth Over Rs. 30,000
  3. iQOO Z12 Lite Visits Google Play Console With These Specifications
  1. Hackers Compromise Popular Websites to Steal Crypto From iPhone Users
  2. Xiaomi Smart Band 11 Launched With 1.72-Inch AMOLED Display, Over 150 Sports Modes: Price, Features
  3. Star Wars: Galactic Racer Is Getting a Local Split-Screen Multiplayer Mode in Early 2027
  4. iPhone Duo Gets Facial Unlocking, Close-to-Lock Feature With iOS 27.3 Beta Update
  5. Vivo V80 FE Confirmed to Launch Soon Globally With 50-Megapixel Rear Cameras, 7,000mAh Battery
  6. Samsung Galaxy S28 Series Could Bring Back Variable Aperture Cameras
  7. Leaked Bixby 5.0 APK Reveals New Interface and Memory Feature For AI Assistant Ahead of One UI 9.5 Release
  8. Samsung Galaxy Studio Design, Colour Options Revealed in New Leak 
  9. iQOO Z12 Lite Chipset, Design and Other Details Appear in Google Play Console Listing
  10. Rockstar Games Details Grand Theft Auto 6's New Dynamic Weather System Ahead of Launch
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2026. All rights reserved.