基于特征部位圆形域的人脸图像修复方法  

Face image inpainting method based on circular fields of feature parts

作　　者：王肖 魏嘉旺 袁玉波 WANG Xiao;WEI Jiawang;YUAN Yubo(School of Information Science and Engineering,East China University of Science and Technology,Shanghai 200237,China;Shanghai Engineering Research Center of Big Data and Internet Audience,Shanghai 200072,China)

机构地区：[1]华东理工大学信息科学与工程学院,上海200237 [2]上海大数据与互联网受众工程技术中心,上海200072

出　　处：《计算机应用》2020年第3期847-853,共7页journal of Computer Applications

基　　金：上海市工程技术中心项目(18DZ2252300)~~

摘　　要：针对基于样本块的纹理合成方法存在的修复结构不合理和效率较低的问题,提出基于特征部位圆形域的人脸图像修复方法。首先进行人脸特征点定位,依据特征点分布将人脸图像分割出4个特征部位圆形域,明确特征搜索域范围。然后在优先级模型中以指数函数的形式改变置信度项的衰减趋势,并结合结构梯度项使用局部梯度信息约束优先级,提高修复结果的结构连通性。在匹配块搜索阶段,根据目标块与各个特征部位圆形域的相对位置,确定匹配块的搜索域,提升搜索效率。最终在结构相似性的标准下选择结构最佳匹配块,完成结构连通的人脸图像修复。与4个先进的方法相比较,所提方法修复图像的峰值信噪比(PSNR)平均提升了1.219~2.663 dB,时间消耗平均减小了34.7%~69.6%。实验结果表明,该方法对保持人脸图像的结构连通性和视觉合理性有显著效果,在修复的精度和时间上都表现优异。To solve the problem of unreasonable structure and low efficiency of the example block-based image inpainting method,a method for face image inpainting based on circular fields of feature parts was proposed.Firstly,according to the distribution of feature points obtained by feature points localization,the face image was segmented into four circular fields to determine feature search domains.Then,in priority model,the attenuation trend of confidence term was changed in form of exponential function,and with the combination of structural gradient term,the priority was constrained by using local gradient information to improve structural connectivity of inpainting result.In the stage of matching patch search,according to relative position between target patch and each circular domain of feature part,the search domain of matching patch was determined to improve search efficiency.Finally,under the standard of structural similarity,face image inpainting with structural connectivity was completed by choosing the best matching patch.Compared with four state-of-theart inpainting methods,the proposed method has the Peak Signal-to-Noise Ratio(PSNR)of inpainted image increased by 1.219 to 2.663 dB on average,and the time consumption reduced by 34.7%to 69.6%on average.The experimental results show that the proposed method is effective in maintaining structural connectivity and visual rationality of face image,and has excellent performance in accuracy and time consumption of inpainting.

关 键 词：人脸图像 图像修复 特征部位 结构梯度项 结构相似性 

分 类 号：TP391.413[自动化与计算机技术—计算机应用技术]