基于言语想象的脑机交互关键技术  

Key technology of brain-computer interaction based on speech imagery

作　　者：刘艳鹏 龚安民 丁鹏 赵磊[4] 钱谦 周建华[1,2] 苏磊[1,2] 伏云发[1,2,5,6] LIU Yanpeng;GONG Anmin;DING Peng;ZHAO Lei;QIAN Qian;ZHOU Jianhua;SU Lei;FU Yunfa(School of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500,P.R.China;Brain Cognition and Brain-Computer Intelligence Integration Group,Kunming University of Science and Technology,Kunming 650500,P.R.China;College of Information Engineering,Engineering University of PAP,Xi'an 710000,P.R.China;Faculty of Science,Kunming University of Science and Technology,Kunming 650500,P.R.China;School of Medicine Brain Science and Visual Cognition Research Center,Kunming University of Science and Technology,Kunming 650500,P.R.China;Yunnan Key Lab of Computer Technology Application,Kunming University of Science and Technology,Kunming 650500,P.R.China)

机构地区：[1]昆明理工大学信息工程与自动化学院,昆明650500 [2]昆明理工大学脑认知与脑机智能融合创新团队,昆明650500 [3]武警工程大学信息工程学院,西安710000 [4]昆明理工大学理学院,昆明650500 [5]昆明理工大学医学院脑科学与视觉认知研究中心,昆明650500 [6]昆明理工大学云南省计算机技术应用重点实验室,昆明650500

出　　处：《生物医学工程学杂志》2022年第3期596-611,共16页Journal of Biomedical Engineering

基　　金：国家自然科学基金(81771926,61763022,82172058,62006246)。

摘　　要：言语表达是一种人类重要的高级认知行为,该行为的实现与人的大脑活动密切相关,真实的言语表达和言语想象都能够激活部分相同的脑区,因此言语想象成为一种脑机交互的新型范式。基于言语想象的脑机接口(BCI)具有自发产生、无需训练、对被试友好等优点,因此受到了众多学者的关注。然而,这一交互技术在实验范式的设计和想象材料的选择方面并不成熟,存在较多亟待讨论的问题。因此,针对这些问题,本文首先阐述了言语想象的神经机制;然后评述了以往的言语想象BCI研究,系统分析了实验范式、想象材料、数据处理等方面的主流方法和核心技术;最后讨论了制约该类BCI发展的关键问题和面临的主要挑战,并展望了言语想象BCI系统在未来的发展和应用前景。Speech expression is an important high-level cognitive behavior of human beings. The realization of this behavior is closely related to human brain activity. Both true speech expression and speech imagination can activate part of the same brain area. Therefore, speech imagery becomes a new paradigm of brain-computer interaction. Braincomputer interface(BCI) based on speech imagery has the advantages of spontaneous generation, no training, and friendliness to subjects, so it has attracted the attention of many scholars. However, this interactive technology is not mature in the design of experimental paradigms and the choice of imagination materials, and there are many issues that need to be discussed urgently. Therefore, in response to these problems, this article first expounds the neural mechanism of speech imagery. Then, by reviewing the previous BCI research of speech imagery, the mainstream methods and core technologies of experimental paradigm, imagination materials, data processing and so on are systematically analyzed.Finally, the key problems and main challenges that restrict the development of this type of BCI are discussed. And the future development and application perspective of the speech imaginary BCI system are prospected.

关 键 词：脑机交互 言语想象 实验范式 分类 解码 

分 类 号：TN911.7[电子电信—通信与信息系统] R318[电子电信—信息与通信工程]