Sensitivity of N400 Effect During Speech Comprehension Under the Uni-and Bi-Modality Conditions  

作　　者：Yanfei Lin Zhiwen Liu Xiaorong Gao 

机构地区：[1]the School of Information and Electronics,Beijing Institute of Technology,Beijing 100084,China [2]the Department of Biomedical Engineering,Tsinghua University,Beijing 100081,China

出　　处：《Tsinghua Science and Technology》2022年第1期141-149,共9页清华大学学报（自然科学版（英文版）

基　　金：supported by the National Natural Science Foundation of China (Nos. 61601028 and 61431007);the Key R&D Program of Guangdong Province of China (No.2018B030339001);the National Key R&D Program of China (No. 2017YFB1002505)。

摘　　要：N400 is an objective electrophysiological index in semantic processing for brain.This study focuses on the sensitivity of N400 effect during speech comprehension under the uni-and bi-modality conditions.Varying the Signal-to-Noise Ratio(SNR) of speech signal under the conditions of Audio-only(A),Visual-only(V,i.e.,lip-reading),and Audio-Visual(AV),the semantic priming paradigm is used to evoke N400 effect and measure the speech recognition rate.For the conditions A and high SNR AV,the N400 amplitudes in the central region are larger;for the conditions of V and low SNR AV,the N400 amplitudes in the left-frontal region are larger.The N400 amplitudes of frontal and central regions under the conditions of A,AV,and V are consistent with speech recognition rate of behavioral results.These results indicate that audio-cognition is better than visual-cognition at high SNR,and visual-cognition is better than audio-cognition at low SNR.

关 键 词：audio-visual speech auditory noise audio-visual integration Signal-to-Noise Ratio(SNR) 

分 类 号：TN912.3[电子电信—通信与信息系统] R318[电子电信—信息与通信工程]