遮挡自适应权重的人脸特征点定位算法  

Face Landmark Localization with Adaptive Occlusion Weight

作　　者：管纾玥 狄岚 梁久祯[2] GUAN Shu-yue;DI Lan;LIANG Jiu-zhen(School of Artificial Intelligence and Computing,Jiangnan University,Wuxi 214122,China;School of Computer and Artificial Intelligence,Changzhou University,Changzhou 213164,China)

机构地区：[1]江南大学人工智能与计算机学院,江苏无锡214122 [2]常州大学计算机与人工智能学院,江苏常州213164

出　　处：《小型微型计算机系统》2023年第12期2773-2783,共11页Journal of Chinese Computer Systems

基　　金：江苏省石油化工过程关键设备数字孪生技术工程研究中心开放课题项目(DT2020720)资助。

摘　　要：针对遮挡造成人脸定位失败和人脸特征点的遮挡标签匮乏等问题,提出了一种遮挡自适应权重的人脸特征点定位算法.基于HRNet,设计了一个遮挡自适权重损失函数,使遮挡点获得一个较小的权重用来减轻遮挡对特征提取的影响.在网络输出阶段,添加遮挡预测模块以获取特征点的遮挡度,对遮挡度进行线性变换作为热图回归任务的自适应权重.同时,通过在原图上生成随机大小、形状、颜色、纹理、透明度的遮挡及对应标签,进行数据集扩增.此外,根据预测坐标生成人脸的点特征图、边特征图、区域特征图以及切割图,将其与原图像融合后再输入主干网络,获得更好的人脸特征.本算法在COFW和300W等相关数据集上进行评估,取得了较好的准确性.Occlusion is complex and random,which will break the structure of the face,resulting in the failure of facial landmark localization.At same time,there is a lack of occlusion labels for feature points.To solve these problems,we propose a algorithm for facial landmark localization with adaptive occlusion weight named occHRNet(occlusion_high-resolution network).Based on HRNet,an occlusion-adaptive weight loss function is designed so that the occlusion points get a smaller weight to reduce the impact of occlusion.In the network output stage,the occlusion prediction module is added to get the degree of occluded points.A linear transformation on the occlusion is perform to get the adaptive weight of the heat map regression task.Meanwhile,the dataset is amplified by generating occlusion of random size,shape,color,texture,transparency on the original image and corresponding labels.In addition,the point feature map,edge feature map,area feature map and cut map of the face are generated according to the predicted coordinates.Then,the multiple feature maps are fused with the original image before being fed into the backbone network to obtain better face features.The algorithm is evaluated on the COFW,300W nd other related datasets,and achieves better performance.

关 键 词：人脸特征点定位 人脸对齐 热图回归 遮挡生成 特征融合 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]