基于人类注意机制的微表情检测方法  

Micro-expression spotting method based on human attention mechanism

作　　者：李婧婷 东子朝 刘烨[1,2] 王甦菁 庄东哲 LI Jingting;DONG Zizhao;LIU Ye;WANG Su-Jing;ZHUANG Dongzhe(CAS Key Laboratory of Behavioral Science,Institute of Psychology,Beijing 100101,China;Department of Psychology,University of Chinese Academy of Sciences,Beijing 100049,China;Public Security Behavioral Science Laboratory,People's Public Security University of China,Beijing 100038,China)

机构地区：[1]中国科学院行为科学重点实验室(中国科学院心理研究所),北京100101 [2]中国科学院大学心理学系,北京100039 [3]中国人民公安大学公共安全行为科学实验室,北京100038

出　　处：《心理科学进展》2022年第10期2143-2153,共11页Advances in Psychological Science

基　　金：国家自然科学基金项目(62106256、U19B2032);中国人民公安大学公共安全行为科学实验室开放课题(2020SYS12);中国博士后科学基金项目(2020M680738)资助。

摘　　要：微表情是一种持续时间极短、不易被察觉的面部动作,揭示了个体的真实情绪,可以被广泛地应用于谎言识别等领域。而微表情检测的研究受到小样本问题的限制。针对该问题,本文结合计算机视觉技术与认知心理学实验方法进行探索。首先,结合眼动技术和呈现−判断范式与阈下情绪启动效应的行为实验范式,考察微表情识别中选择注意分配的认知机制,细化人类识别微表情时的特征兴趣区域。其次,结合人类注意机制,提出基于自监督学习的多模态微表情检测方法。通过理论和关键技术的突破,为真实场景下微表情检测的应用奠定基础。Micro-expressions are facial movements that are extremely short and not easily perceived,revealing the individual's hidden real emotions,and could be widely used in lies detection and other fields.The automatic research of micro-expression spotting is mainly limited by the small sample size.This project will address this problem by comprehensively using computer vision technology and cognitive psychology experimental methods.First,a behavioral-experimental paradigm combining eye-movement techniques and a presentation-judgment paradigm with subthreshold emotion priming effects was used to examine the cognitive mechanisms of selective attention allocation in micro-expression recognition and to refine the characteristic regions of interest in human recognition of micro-expressions.Second,based on the human attention mechanism,we propose a micro-expression spotting method based on a multi-branching self-supervised learning network,extracting structure-based,detail,spatio-temporal variation,and depth features of video samples.This research will achieve theoretical and technological breakthroughs in the field of automatic micro-expression spotting,and lay the foundation for the application of micro-expression spotting in realistic and complex scenarios.

关 键 词：微表情检测 小样本问题 人类注意机制 自监督学习 深度信息 

分 类 号：B842[哲学宗教—基础心理学]