基于汉字语音映射的脑电信号直译方法研究  

Direct translation of EEG signals based on Chinese character speech mapping

作　　者：伍茂贤 尹念 陈仪琳 WU Maoxian;YIN Nian;CHEN Yilin(College of Automotive and Mechanical Engineering,Changsha University of Science and Technology,Changsha(410015),Hunan,China)

机构地区：[1]长沙理工大学汽车与机械工程学院,湖南长沙410015

出　　处：《癫痫与神经电生理学杂志》2023年第5期276-282,共7页Journal of Epileptology and Electroneurophysiology(China)

基　　金：2022年国家级大学生创新创业训练计划项目(202210536021);2023年长沙理工大学研究生科研创新项目(CSLGCX23046)。

摘　　要：目的探讨基于汉字语音映射的脑电信号(EEG)直译方法,从而开发一种人机交互的新手段。方法基于对汉字语音朗读时产生的EEG采集,利用Mel倒频谱系数对语音信号进行特征提取,将EEG特征与语音特征映射生成数据库,基于数据库利用循环神经网络进行EEG识别。采用共空间模式(CSP)联合支持向量机(SVM)对EEG进行特征提取和分类识别作为对照试验。结果CSP+SVM识别方式下,平均分类准确率为(36.53±3.17)%;在基于汉字语音映射的EEG直译方式下,平均分类准确率为(69.93±3.07)%,经重复数据集训练后的识别准确率可达75%以上。结论基于语音映射的直译方法可以获得更稳定的EEG,将EEG与语音信号形成映射,可以准确且快速地用EEG重建汉字语音信息,为未来用EEG实现人机通信提供有效依据,从而实现用汉字语音映射的EEG直译方法开发一种人机交互的新手段。Objective To explore a direct EEG translation approach based on Chinese character speech mapping to develop a new method of human-computer interaction.Methods This research was based on capturing EEG signals generated during reading Chinese characters aloud.Mel-Frequency Cepstral Coefficients(MFCCs)were used to extract the features from speech signals.EEG features were mapped with speech features to generate a database.Based on the database,EEG was recognized using recurrent neural networks.Co-spatial patterns combined with support vector machines was performed on EEG to extract features and classify recognition as a control experiment.Results The average classification accuracy was(36.53±3.17)%using CSP+SVM recognition mode,while it was(69.93±3.07)%using direct EEG translation based on Chinese character speech mapping,and it was over 75%after training on repeated datasets.Conclusion Direct translation method based on speech mapping can obtain more stable EEG.Mapping EEG with speech signals may quickly and accurately re-construct Chinese character speech information using EEG,providing an effective basis for future human-machine communication using EEG and developing a new method for human-computer interaction using direct EEG translation method based on Chinese character speech mapping.

关 键 词：脑电信号 语音映射 神经网络 脑机接口 机器翻译 

分 类 号：R741.044[医药卫生—神经病学与精神病学]