All-weather,natural silent speech recognition via machine-learning-assisted tattoo-like electronics  

作　　者：Youhua Wang Tianyi Tang Yin Xu Yunzhao Bai Lang Yin Guang Li Hongmiao Zhang Huicong Liu YongAn Huang 

机构地区：[1]State Key Laboratory of Digital Manufacturing Equipment and Technology,Huazhong University of Science and Technology,Wuhan,China [2]Flexible Electronics Research Center,Huazhong University of Science and Technology,Wuhan,China [3]School of Mechanical and Electric Engineering,Jiangsu Provincial Key Laboratory of Advanced Robotics,Soochow University,Suzhou,China [4]State Key Laboratory of Industrial Control Technologyg,Institute of Cyber Systems and Control,Zhejiang University,Hangzhou,China

出　　处：《npj Flexible Electronics》2021年第1期183-191,共9页npj-柔性电子（英文）

基　　金：supported by the National Natural Science Foundation of China(grant nos.51925503,U1713218);the Program for HUST Academic Frontier Youth Team.

摘　　要：The internal availability of silent speech serves as a translator for people with aphasia and keeps human–machine/human interactions working under various disturbances.This paper develops a silent speech strategy to achieve all-weather,natural interactions.The strategy requires few usage specialized skills like sign language but accurately transfers high-capacity information in complicated and changeable daily environments.In the strategy,the tattoo-like electronics imperceptibly attached on facial skin record high-quality bio-data of various silent speech,and the machine-learning algorithm deployed on the cloud recognizes accurately the silent speech and reduces the weight of the wireless acquisition module.A series of experiments show that the silent speech recognition system(SSRS)can enduringly comply with large deformation(~45%)of faces by virtue of the electricitypreferred tattoo-like electrodes and recognize up to 110 words covering daily vocabularies with a high average accuracy of 92.64%simply by use of small-sample machine learning.We successfully apply the SSRS to 1-day routine life,including daily greeting,running,dining,manipulating industrial robots in deafening noise,and expressing in darkness,which shows great promotion in real-world applications.

关 键 词：TRANSLATOR weather SILENT 

分 类 号：H31[语言文字—英语]