Wearable-Tech Glove Translates Sign Language Into Speech in Real Time
June 29, 2020 | UCLA NewsroomEstimated reading time: 2 minutes
UCLA bioengineers have designed a glove-like device that can translate American Sign Language into English speech in real time though a smartphone app. Their research is published in the journal Nature Electronics.
“Our hope is that this opens up an easy way for people who use sign language to communicate directly with non-signers without needing someone else to translate for them,” said Jun Chen, an assistant professor of bioengineering at the UCLA Samueli School of Engineering and the principal investigator on the research. “In addition, we hope it can help more people learn sign language themselves.”
The system includes a pair of gloves with thin, stretchable sensors that run the length of each of the five fingers. These sensors, made from electrically conducting yarns, pick up hand motions and finger placements that stand for individual letters, numbers, words and phrases.
The device then turns the finger movements into electrical signals, which are sent to a dollar-coin–sized circuit board worn on the wrist. The board transmits those signals wirelessly to a smartphone that translates them into spoken words at the rate of about a one word per second.
The researchers also added adhesive sensors to testers’ faces — in between their eyebrows and on one side of their mouths — to capture facial expressions that are a part of American Sign Language.
Previous wearable systems that offered translation from American Sign Language were limited by bulky and heavy device designs or were uncomfortable to wear, Chen said.
The device developed by the UCLA team is made from lightweight and inexpensive but long-lasting, stretchable polymers. The electronic sensors are also very flexible and inexpensive.
In testing the device, the researchers worked with four people who are deaf and use American Sign Language. The wearers repeated each hand gesture 15 times. A custom machine-learning algorithm turned these gestures into the letters, numbers and words they represented. The system recognized 660 signs, including each letter of the alphabet and numbers 0 through 9.
In addition to Chen, the study’s UCLA authors are co-lead author Zhihao Zhao, Kyle Chen, Songlin Zhang, Yihao Zhou and Weili Deng. All are members of Chen’s Wearable Bioelectronics Research Group at UCLA. The other corresponding author is Jin Yang, of China’s Chongqing University.
UCLA has filed for a patent on the technology. A commercial model based on this technology would require added vocabulary and an even faster translation time, Chen said.
Read the original article here.
Suggested Items
Incap Estonia Teamed Up With Solaride to Fuel Youth Excitement for The World of Engineering
04/11/2024 | IncapIncap Estonia partnered with Solaride to ignite enthusiasm among young people for the world of engineering and sustainable technology. Together, they organised an inspiring day for students from grades 7 through 12 in Saaremaa. Held at Incap’s Kuressaare factory, this event brought together over 130 young minds eager to explore the innovative world of technology and learn more about advanced electronics manufacturing.
Accenture to Acquire CLIMB to Expand Technology Capabilities
04/08/2024 | BUSINESS WIREAccenture has agreed to acquire CLIMB, a technology services provider specializing in system integration, IT infrastructure management and operations, primarily in the Gunma Prefecture.
IPC APEX EXPO 2024: Kurt Palmer on the Formation of Schmoll America
04/01/2024 | Barry Matties, I-Connect007There’s exciting news for Schmoll Maschinen as Kurt Palmer leaves his role as president of Burkle North America to lead the new Schmoll America. In this interview, Kurt discusses his collaboration with Burkle North America, what it means for his new Schmoll teams, and the many machines and processes he’ll have on display at his busy booth at IPC APEX EXPO.
It’s Only Common Sense: When Your Company Starts Running Out of Popcorn
04/01/2024 | Dan Beaulieu -- Column: It's Only Common SenseCompanies, like people, get tired. I have seen companies just lose their focus, their “raison d’etre,” and just, well, fade away. More than once, I have sat in the office of a company owner, trying to console him while he asks me to “get him out of there.” Owners just get tired of the daily grind. They want off the treadmill of the constant juggling of people, strategies, customers, and, of course, cash flow.
Global Sourcing Spotlight: Don’t Be Afraid of Global Sourcing
04/03/2024 | Bob Duke -- Column: Global Sourcing SpotlightOn paper, it doesn’t seem like a great time for global sourcing. With several world conflicts, it may seem impossible to think that something like global sourcing and commercial trade between countries could begin to alleviate this tension between warring countries. But hey, I’ve always been a glass-half-full guy, so humor me. While trade between countries can indeed foster cooperation and contribute to peace in several ways, it's essential to recognize that it's not a panacea for all global issues. However, here are some ways in which trade can contribute to peace and global stability.