Facial Expression Enhances Emotion Perception Compared to Vocal Prosody： Behavioral and fMRI Studies  

作　　者：Heming Zhang Xuhai Chen Shengdong Chen Yansong Li Changming Chen Quanshan Long Jiajin Yuan 

机构地区：[1]Key Laboratory of Cognition and Personality of the Ministry of Education, School of Psychology, Southwest University, Chongqing 400715, China [2]Key Laboratory of Behavior and Cognitive Psychology in Shaanxi Province, School of Psychology, Shaanxi Normal University, Xi'an 710062, China [3]Key Laboratory of Modem Teaching Technology of the Ministry of Education, Shaanxi Normal University, Xi'an 710062, China [4]Department of Psychology, School of Social and Behavioral Sciences, Nanjing University, Nanjing 210023, China [5]School of Educational Sciences, Xinyang Normal University, Xinyang 464000, China

出　　处：《Neuroscience Bulletin》2018年第5期801-815,共15页神经科学通报（英文版）

基　　金：supported by the National Natural Science Foundation of China(31371042 and 31671164)

摘　　要：Facial and vocal expressions are essential modalities mediating the perception of emotion and social communication. Nonetheless, currently little is known about how emotion perception and its neural substrates differ across facial expression and vocal prosody. To clarify this issue, functional MRI scans were acquired in Study 1, in which participants were asked to discriminate the valence of emotional expression （angry, happy or neutral） from facial, vocal, or bimodal stimuli. In Study 2, we used an affective priming task （unimodal materials as primers and bimodal materials as target） and participants were asked to rate the intensity, valence, and arousal of the targets. Study 1 showed higher accuracy and shorter response latencies in the facial than in the vocal modality for a happy expression. Whole-brain analysis showed enhanced activation during facial compared to vocal emotions in the inferior temporal-occipital regions. Region of interest analysis showed a higher percentage signal change for facial than for vocal anger in the superior temporal sulcus. Study 2 showed that facial relative to vocal priming of anger had a greater influence on perceived emotion for bimodal targets, irrespective of the target valence. These findings suggest that facial expression is associated with enhanced emotion perception compared to equivalent vocal prosodies.Facial and vocal expressions are essential modalities mediating the perception of emotion and social communication. Nonetheless, currently little is known about how emotion perception and its neural substrates differ across facial expression and vocal prosody. To clarify this issue, functional MRI scans were acquired in Study 1, in which participants were asked to discriminate the valence of emotional expression （angry, happy or neutral） from facial, vocal, or bimodal stimuli. In Study 2, we used an affective priming task （unimodal materials as primers and bimodal materials as target） and participants were asked to rate the intensity, valence, and arousal of the targets. Study 1 showed higher accuracy and shorter response latencies in the facial than in the vocal modality for a happy expression. Whole-brain analysis showed enhanced activation during facial compared to vocal emotions in the inferior temporal-occipital regions. Region of interest analysis showed a higher percentage signal change for facial than for vocal anger in the superior temporal sulcus. Study 2 showed that facial relative to vocal priming of anger had a greater influence on perceived emotion for bimodal targets, irrespective of the target valence. These findings suggest that facial expression is associated with enhanced emotion perception compared to equivalent vocal prosodies.

关 键 词：FMRI Emotion perception Facial expres-sion Vocal prosody MODALITY 

分 类 号：B842[哲学宗教—基础心理学] R338[哲学宗教—心理学]