非正面人脸表情识别方法综述  

Survey on Non-frontal Facial Expression Recognition Methods

作　　者：蒋斌[1] 甘勇[1] 张焕龙[2] 张秋闻[1] JIANG Bin;GAN Yong;ZHANG Huan-long;ZHANG Qiu-wen(College of Computer and Communication Engineering,Zhengzhou University of Light Industry,Zhengzhou 450002,China;College of Electric and Information Engineering,Zhengzhou University of Light Industry,Zhengzhou 450002,China)

机构地区：[1]郑州轻工业学院计算机与通信工程学院,郑州450002 [2]郑州轻工业学院电气信息工程学院,郑州450002

出　　处：《计算机科学》2019年第3期53-62,共10页Computer Science

基　　金：国家自然科学基金项目(61702464;61503173;61771432;61302118;61502435);河南省高等学校重点科研项目(16A520028;17B510011;14A520034);河南省科技攻关项目(182102210156);河南省高校科技创新人才项目(17HASTIT022);河南省青年骨干教师计划(2016GGJS-087);郑州轻工业学院博士科研基金项目(2014BSJJ077)资助

摘　　要：人脸表情识别是生物特征识别的重要组成部分,也是人机交互领域的一项关键技术。然而多数方法只关注正面或接近正面的人脸图像及视频,并限制了正常的头部运动,因此不利于人脸表情识别的智能化发展。有鉴于此,首先介绍了人脸检测、头部姿态估计、特征提取和分类的方法,以探索非正面人脸表情识别系统的发展;然后重点介绍了非正面人脸表情特征提取和分类的方法,并对基于人脸关键点的非正面人脸表情识别方法、基于外貌特征的非正面人脸表情识别方法及基于姿态相关的非正面人脸表情识别方法进行了比较分析;最后总结了非正面人脸表情识别方法的研究现状,并对进一步的研究和发展方向进行了展望。Facial expression recognition is an important part in biometric feature recognition,and it is also a key techno- logy of human-machine interaction.However,most methods only focus on the frontal or nearly frontal facial images and videos,and restrict the normal head movements,so it is bad for intelligent development of facial expression recognition.To handle this problem,firstly,the face detection,head pose estimation,facial expression feature extraction and classification methods were introduced for exploring the development of non-frontal facial expression recognition system.Se- condly ,the non-frontal facial expression feature extraction and classification methods were emphatically introduced,and the comparison and analysis of the facial key points-based non-frontal facial expression recognition algorithm,the appea- rance feature-based non-frontal facial expression recognition algorithm and the pose-depend-based non-frontal facial expression recognition algorithm were carried out.Finally,the current research on the non-frontal facial expression recognition was summarized,and the future research and development direction were prosected.

关 键 词：非正面人脸表情识别 人脸关键点 外貌特征 姿态相关 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]