面向类内差距表情的深度学习识别  

Depth learning recognition method for intra-class gap expression

作　　者：陈亮[1] 吴攀 刘韵婷[1] Chen Liang;Wu Pan;Liu Yunting(Shenyang Ligong University,Shenyang 110159,China)

机构地区：[1]沈阳理工大学,沈阳110159

出　　处：《中国图象图形学报》2020年第4期679-687,共9页Journal of Image and Graphics

基　　金：国家重点研发项目(2017YFC0821001,2017YFC0821004-5);辽宁省自然科学基金项目(20170540788);辽宁省教育厅基本科研项目(LG201707)。

摘　　要：目的为解决真实环境中由类内差距引起的面部表情识别率低及室内外复杂环境对类内差距较大的面部表情识别难度大等问题,提出一种利用生成对抗网络(generative adversarial network,GAN)识别面部表情的方法。方法在GAN生成对抗的思想下,构建一种IC-GAN(intra-class gap GAN)网络结构,使用卷积组建编码器、解码器对自制混合表情图像进行更深层次的特征提取,使用基于动量的Adam(adaptive moment estimation)优化算法进行网络权重更新,重点针对真实环境面部表情识别过程中的类内差距较大的表情进行识别,使其更好地适应类内差异较大的任务。结果基于Pytorch环境,在自制的面部表情数据集上进行训练,在面部表情验证集上进行测试,并与深度置信网络(deep belief network,DBN)和GoogLeNet网络进行对比实验,最终IC-GAN网络的识别结果比DBN网络和GoogLeNet网络分别提高11%和8.3%。结论实验验证了IC-GAN在类内差距较大的面部表情识别中的精度,降低了面部表情在类内差距较大情况下的误识率,提高了系统鲁棒性,为面部表情的生成工作打下了坚实的基础。Objective China has a large population of 1.3 billion in 2005,accounting for 19% of the worlds’ population.This number is equivalent to the population of Europe or Africa added to the populations of Australia,North America,and Central America.It is one of the few populous countries in the world,and its huge population size has brought many problems.With the rapid development of the economy,the number of people working outside of their homes is increasing,the population is moving frequently,and the safety of the floating population is even difficult to control.The huge mobile population provides the citys’ infrastructure and public services tremendous pressure.Thus,to conduct a comprehensive check on the area of adult traffic,which is time-consuming and labor-intensive,is difficult for security and related staff.Particularly,complex environmental safety problems,such as subways,railway stations,and airports,are becoming increasingly serious.Unstable events occur frequently,security situation is receiving much attention,and urban management and service systems are seriously lagging behind.These conditions need to be improved,especially after the September 11 incident in the United States.The situation has aroused widespread concern in the international community.Meanwhile,expression is the most intuitive way for humans to express emotions.In addition to language communication,expressions are extremely effective means of communication.People usually express their inner feelings through specific expressions.Expression can be used to judge other persons’ thoughts.For expressions used to express information,psychologist Mehrabian summed up a formula: emotional expression = 7% of words + 38% of sound + 55% of facial expressions.Expression is one of the most important features of human emotion recognition.Expression is the emotional state expressed by facial muscle changes.Through the facial expression of the persons ’ face,to evaluate abnormal psychological state,speculate on extreme emotions,and observe the fac

关 键 词：深度学习 生成对抗网络 IC-GAN(intra-class gap GAN) 面部表情识别 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]