Researchers develop device that translates sign language into text

Advertisement
By Press Trust of India | Updated: 22 July 2013 17:28 IST
Researchers have developed a novel computer system that enables deaf people to translate gestures used in sign language into text.

Using the new technology, people who are deaf or hard of hearing can simply type words and sentences using a keyboard and read those typed to them, researchers said.

Researchers Microsoft Asia and the Institute of Computing Technology at the Chinese Academy of Sciences in this latest effort turned to Microsoft's Kinect device.

They showcased the software that has been developed for the Kinect that successfully translates American Sign Language (ASL) into text, Phys.org reported.

The system operates in two modes: The first, called simply Translation Mode, translates physical hand or body movements into text or speech.

Advertisement

The second, called Communication Mode, allows a person speaking in ASL to communicate with someone else who is communicating in typed English.

The system uses an Avatar to translate text coming from someone typing text on a keyboard, then converts their response to text and sends it back to the other person.

Advertisement

The demonstration by researchers showed that the system is capable of translating sentences, not just words, a significant step forward.

The researchers stressed that their system is still a work in progress but hope to eventually create a system that is fully functional and reasonably inexpensive.

Advertisement

Researchers said that would mean a Kinect based communication system that operates entirely with hand gestures and spoken words - all in real time. Also, it would allow for conversion to other sign language dialects as well.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement
Popular Mobile Brands
  1. Oppo Reno 14 5G Series Launching Today: All You Need to Know
  2. The Good Wife OTT Release Date: When and Where to Watch it Online?
  3. Vivo X Fold 5, Vivo X200 FE to Launch in India On This Date
  4. Boult FluidX, FluidX Pro Debut in India With Up to 70 Hours Battery Life
  5. Sakana AI's New Algorithm Can Let Gemini and ChatGPT Work Together
  6. Oppo Reno 14 Pro 5G Launched in India Alongside Reno 14 5G: See Price
  1. A Planet with a Death Wish: How HIP 67522 b Is Forcing Its Star to Explode
  2. Webb Telescope Spots Possible Jellyfish Galaxy 12 Billion Light-Years Away
  3. Mars Dust Devils May Spark Lightning, Might Pose Risks to Rovers: Study
  4. NASA's Perseverance Grinds Into ‘Weird’ Martian Rock to Uncover Signs of Ancient Habitability
  5. Radio Observations in Chamaeleon Cloud Reveal Five Young Stars, Including a Binary System
  6. Paramasivan Fathima OTT Release Date: When and Where to Watch Tamil Horror Thriller Online?
  7. Jagamerigina Satyam OTT Release Date: When and Where to Watch Telugu Legal Drama Online?
  8. The Good Wife OTT Release Date: When and Where to Watch it Online?
  9. Reformed OTT Release Date: When and Where to Watch Popular French Drama Online?
  10. Microsoft Says Xbox Chief Phil Spencer Not Retiring 'Anytime Soon' After Rumour Surfaces Amid Layoffs
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.