注意力需求对指别语言-手势模态间配置的影响  

The influence of attention demand on the modal configuration of deictic speech and gestures

作　　者：徐学平[1] 洪林璇 XU Xueping;HONG Linxuan(South China Normal University,Guangzhou 510631,P.R.China;Nanhai Senior High School,Fashan 528211,P.R.China)

机构地区：[1]华南师范大学外国语言文化学院,广东广州510631 [2]南海中学

出　　处：《外国语言文学》2021年第6期585-595,666,共12页Foreign Language and Literature Studies

摘　　要：指别可以采用语言、手势及其不同组合来进行。本文采用实验法探究在指物和指别空间时注意力需求对语言指别和手势指别两个模态的影响,并对模态间的配置进行语用和认知解释。实验结果表明,注意力需求影响指别语言和指别手势的指示力;说话人在不同注意力需求水平上通过模态的指示力和认知负荷衡量模态重要性,并依据经济原则(即聚焦效果最大化,认知负荷最小化),进行模态间的注意力资源分配,完成模态配置,实现聚焦需求。研究发现对多模态互动的认知研究提供了启示。Demonstrative pointing can be accomplished by speech,gesture or some combination of both.The present experiment explores the influence of attention demand on demonstrative modes,i.e.language and gestures when demonstrating objects or space,and explains the modal configuration from the perspective of pragmatics and cognition.The outcomes show that attention demand affects the deictic force of demonstrative expression and pointing gestures.Estimating the modal importance through the deictic force and cognitive load of modes under different levels of attention demand,the speaker manipulates modal configuration to realize the focus demand by allocating attentional resources among modes according to the economy principle,namely,maximizing the focus effect and minimizing the cognitive load.The research findings offer some implications for the cognitive study of multimodal interaction.

关 键 词：注意力需求 指别语言 指别手势 模态配置 

分 类 号：H0[语言文字—语言学]