基于移动设备的听障人特定语音识别训练系统  

A special speech recognition training system for hearing impaired people based on mobile devices

作　　者：李建文[1] 杨亚威 LI Jianwen;YANG Yawei(College of Electric & Information Engineering,Shanxi University of Science & Technology,Xi’an 710021,China)

机构地区：[1]陕西科技大学电气与信息工程学院,陕西西安710021

出　　处：《河南科技学院学报（自然科学版）》2019年第1期67-73,78,共8页Journal of Henan Institute of Science and Technology(Natural Science Edition)

基　　金：国家自然科学基金(60672001)

摘　　要：我国国内听障人士目前达到7 200万,他们普遍存在言语沟通障碍,大多只能依赖特殊教育学校的手语、助听器以及人工耳蜗实现和正常人沟通交流.结合听障者的自身特点设计了特定的语音识别系统,听障者通过点击界面的图标实现发音,用户根据声音信息实现模仿,系统根据检测到的数据进行评测,给出听障者的训练结果,实现了沟通和康复的有机结合.在此系统的基础上,为了提高语音输入的高效性,增加了基于语义的sem算法的文本预测,该算法模型对句子中出现的所有词进行了构建.在特定的语音识别的基础上完成了整体的构架设计,实现了训练模块和语音模块之间的交互.At present,there are 72 million hearing-impaired people in China,and they generally have speech communication problems.They cannot communicate with normal people in speech communication,and most of them can only rely on special education schools and expensive medical expenses.For hearing-impaired people,auxiliary equipment based on mobile devices is even less.In this paper,a specific speech recognition system was designed in combination with the characteristics of the hearers.The hearers realize the pronunciation by clicking the icon on the interface,the users imitate according to the sound information,and the system evaluates the results according to the detected data,so as to achieve the organic combination of communication and rehabilitation.On the basis of this system,in order to improve the efficiency of speech input,the text prediction of sem algorithm based on semantics was added.Based on the specific speech recognition,the overall architecture design was completed and the interaction between the training module and the speech module was realized.

关 键 词：语音识别 听障人沟通 文本预测 语音训练 

分 类 号：TN912.34[电子电信—通信与信息系统]