基于注意力多尺度融合的人脸表情识别算法研究  

Research on Facial Expression Recognition Algorithm Based on Attention Multi-Scale Fusion

作　　者：安毅 张慧 陈思秀 郑文[1] AN Yi;ZHANG Hui;CHEN Sixiu;ZHENG Wen(School of Electrical and Information Engineering,Changchun Institute of Technology,Changchun 130012,China;Information Technology Department,Changchun Technical University of Automobile,Changchun 130013,China;School of Computer Science,National University of Singapore,Singapore 999002,Singapore)

机构地区：[1]长春工程学院电气与信息工程学院,长春130012 [2]长春汽车工业高等专科学校,长春1300013 [3]新加坡国立大学计算机学院,新加坡999002

出　　处：《长春工程学院学报（自然科学版）》2024年第1期59-63,共5页Journal of Changchun Institute of Technology：Natural Sciences Edition

基　　金：吉林省职业教育科研课题项目(2023XHY262,2023XHZ016);吉林省科技发展计划项目(20220203178SF);吉林省高等教育教学改革研究课题(2024L5LY26U0058)。

摘　　要：信息技术在教学中的应用导致师生之间缺乏一定程度的情感交流,为了弥补授课过程中的情感缺失,获得更好的教学反馈,提出基于注意力机制与多尺度特征融合(ASMF)的人脸表情识别算法。该算法以Resnet 50作为骨干网络,首先通过对多层卷积神经网络的输出特性进行多尺度的融合,引入上下文信息的同时提取更加丰富有效的表情特征信息;其次将注意力机制融入网络中,通过对各通道进行加权学习,得到注意力特征图,从而增强特征的表达能力,抑制冗余信息的影响;然后加入Dropout机制和Softmax Loss损失函数,进一步提高提取到的表情特征的可判别性;最后,利用消融试验在公开的数据集与自制的学生课堂表情数据集上验证该算法的有效性和稳定性,识别准确率达到93.87%。The application of information technology in teaching leads to a lack of emotional communication between teachers and students.In order to compensate for the lack of emotional communication during the teaching process and obtain better teaching feedback,a facial expression recognition algorithm based on attention mechanism and multi-scale feature fusion(ASMF)is proposed.The algorithm uses Resnet 50 as the backbone network.It firstly fuses the output characteristics of multi-layer convolutional neural networks at multiple scales,introduces contextual information while extracting richer and more effective expression feature information.Secondly,the attention mechanism is integrated into the network,and through weighted learning of each channel,attention feature maps are obtained to enhance the expression ability of features and suppress the impact of redundant information.Then,the Dropout mechanism and Softmax Loss function are added to further improve the discriminability of the extracted facial features Finally,the effectiveness and stability of the algorithm are validated by using ablation experiments on both publicly available datasets and self-made student classroom expression datasets,with a recognition accuracy of 93.87%.

关 键 词：表情识别 深度残差网络 注意力机制 多尺度融合 

分 类 号：TP399[自动化与计算机技术—计算机应用技术]