A New Intelligent Approach for Deaf/Dumb People based on Deep Learning  

作　　者：Haitham Elwahsh Ahmed Elkhouly Emad Abouel Nasr Ali K.Kamrani Engy El-shafeiy 

机构地区：[1]Computer Science Department,Faculty of Computers and Information,Kafrelsheikh University,Kafrelsheikh,Egypt [2]Industrial Engineering Department,College of Engineering,King Saud University,Riyadh 11421,Saudi Arabia [3]Industrial Engineering Department,College of Engineering,University of Houston,Houston,TX 77204-4008,USA [4]Department of Computer Science,Faculty of Computers and Artificial Intelligence,University of Sadat City,Sadat City,Egypt

出　　处：《Computers, Materials & Continua》2022年第9期6045-6060,共16页计算机、材料和连续体（英文）

基　　金：This work is funded by King Saud University from Riyadh,Saudi Arabia.Project Number(RSP-2021/164),King Saud University,Riyadh,Saudi Arabia.https://ksu.edu.sa/.

摘　　要：People who are deaf or have difficulty speaking use sign language,which consists of hand gestures with particular motions that symbolize the“language”they are communicating.A gesture in a sign language is a particular movement of the hands with a specific shape from the fingers and whole hand.In this paper,we present an Intelligent for Deaf/Dumb People approach in real time based on Deep Learning using Gloves(IDLG).The approach IDLG offers scientific contributions based deep-learning,a multimode command techniques,real-time,and effective use,and high accuracy rates.For this purpose,smart gloves working in real time were designed.The data obtained from the gloves was processed using deep-learning-based approaches and classified multi-mode commands that allow dumb people to speak with regular people via their smart phone.Internally,the glove has five flex sensors and an accelerometer using to achieve Low-Cost Control System.The flex sensor generates a proportional change in resistance for each individual move.The processing of these hand gestures is in Atmega32A Microcontroller which is an advance version of the microcontroller and the lab view software.IDLG compares the input signal to memory-stored specified voltage values.The performance of the IDLG approach was verified on a dataset created using different hand gestures from 20 different people.In the test using the IDLG approach on 10,000 data points,process time performance of milliseconds was achieved with 97%accuracy.

关 键 词：Deep learning flex sensor labview Atmega32A LOW-COST control system ACCELEROMETER intelligent glove 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]