A Real-Time Oral Cavity Gesture Based Words Synthesizer Using Sensors  

作　　者：Palli Padmini C.Paramasivam G.Jyothish Lal Sadeen Alharbi Kaustav Bhowmick 

机构地区：[1]Department of Electronics&Communication Engineering,Amrita School of Engineering,Bengaluru,Amrita Vishwa Vidyapeetham,India [2]Center for Computational Engineering and Networking(CEN),Amrita School of Engineering,Coimbatore,Amrita Vishwa Vidyapeetham,India [3]Department of Software Engineering,College of Computer and Information Sciences,King Saud University,Riyadh,Saudi Arabia [4]Department of Electronics and Communication Engineering,PES University,Bengaluru,India

出　　处：《Computers, Materials & Continua》2022年第6期4523-4554,共32页计算机、材料和连续体（英文）

基　　金：The authors would like to acknowledge theMinistry of Electronics and Informa-tion Technology(MeitY);Government of India for financial support through the scholarship for Palli Padmini,during research work through Visvesvaraya Ph.D.Scheme for Electronics and IT.

摘　　要：The present system experimentally demonstrates a synthesis of syllables and words from tongue manoeuvers in multiple languages,captured by four oral sensors only.For an experimental demonstration of the system used in the oral cavity,a prototype tooth model was used.Based on the principle developed in a previous publication by the author(s),the proposed system has been implemented using the oral cavity(tongue,teeth,and lips)features alone,without the glottis and the larynx.The positions of the sensors in the proposed system were optimized based on articulatory(oral cavity)gestures estimated by simulating the mechanism of human speech.The system has been tested for all English alphabets and several words with sensor-based input along with an experimental demonstration of the developed algorithm,with limit switches,potentiometer,and flex sensors emulating the tongue in an artificial oral cavity.The system produces the sounds of vowels,consonants,and words in English,along with the pronunciation of meanings of their translations in four major Indian languages,all from oral cavity mapping.The experimental setup also caters to gender mapping of voice.The sound produced from the hardware has been validated by a perceptual test to verify the gender and word of the speech sample by listeners,with∼98%and∼95%accuracy,respectively.Such a model may be useful to interpret speech for those who are speech-disabled because of accidents,neuron disorder,spinal cord injury,or larynx disorder.

关 键 词：English vowels and consonants oral cavity proposed system SENSORS speech-disabled speech production vocal tract model 

分 类 号：TP212[自动化与计算机技术—检测技术与自动化装置]