中国古画渐进式多级特征修复算法  

Progressive Multilevel Feature Inpainting Algorithm for Chinese Ancient Paintings

作　　者：赵磊[1] 林思寰 林志洁[2] 丁建浩[3] 黄俊[4] 邢卫[1] 林怀忠[1] 鲁东明[1] Zhao Lei;Lin Sihuan;Lin Zhijie;Ding Jianhao;Huang Jun;Xing Wei*;Lin Huaizhong;Lu Dongming(College of Computer Science and Technology,Zhejiang University,Hangzhou 310027;School of Information and Electronic Engineering,Zhejiang University of Science and Technology,Hangzhou 310023;School of Media and Digital,Hangzhou Dianzi University,Hangzhou 310018;Center for Intelligent Information&Communications Technology Research and Development,Shanghai Advanced Research Institute,Chinese Academy of Sciences,Shanghai 201210)

机构地区：[1]浙江大学计算机科学与技术学院,杭州310027 [2]浙江科技学院信息与电子工程学院,杭州310023 [3]杭州电子科技大学人文艺术与数字媒体学院,杭州310018 [4]中国科学院上海高等研究院智能信息通信技术研究与发展中心,上海201210

出　　处：《计算机辅助设计与图形学学报》2023年第7期1040-1051,共12页Journal of Computer-Aided Design & Computer Graphics

基　　金：国家重点研发计划(2020YFC1523101);国家自然科学基金(62172365);国家社科基金重大项目(19ZDA197);石窟寺文物数字化保护国家文物局重点科研基地项目;浙江省自然科学基金(LY21F02005,LY19F020049);浙江省尖兵计划(2022C01222);浙江省基础公益项目(LGG20F020002);浙江省文物保护科技项目(2019011);脑与脑机融合前沿科学中心(浙江大学)项目(2021008)

摘　　要：针对中国古画图像修复后的结果图像内容不一致、存在明显人工痕迹、修复区域的细节信息丢失和修复后的内容模糊等问题,提出利用绘画图像的多级语义特征渐进式地修复中国古画的算法.将中国古画的修改过程分为5个阶段,分别从宏观、中观和微观的语义层面渐进式地修复古画图像.首先关注高抽象级别的语义信息和大尺度的结构信息;然后逐渐地将注意力转移到越来越精细的尺度上,而不必同时学习所有尺度的信息,由古画的高层的语义特征渐进式地向较低层的语义特征的修复.依据11位作家共197幅高清数字化古画制作了山水画、街景画、花鸟画和人物画4个数据集,在这4个数据集上的实验结果表明,所提算法在PSNR,SSIM,IS,FID等指标上的结果优于一步到位的修复算法.There are some problems in the field of Chinese ancient painting images,such as inconsistent re-paired image contents and obvious artificial traces,loss of detailed information in the repaired area,and blurred repaired content.To address these problems,we propose to use the multi-level semantic features of the painting image to repair ancient Chinese paintings gradually.The revision process of ancient Chinese painting is divided into five different stages,which are to repair the ancient painting image gradually from the macro,meso,and micro semantic levels.The repair model first pays attention to the high-level semantic information and large-scale structural information and then gradually shifts its attention to more and more fine scales without learning the information of all scales at the same time. The repair model gradually changes from the high-level semantic features of ancient paintings to the low-level semantic features. This method not only makes the repair process more orderly, but also makes use of the knowledge learned in the previous stage to simplify the repair in the subsequent stage. Based on 197 high-definition digital ancient paintings by 11 writers, four data sets of landscape painting, street view painting, flower, and bird painting, and figure painting are made. Experiments on the above data sets show that the algorithm in this paper is better than the one-step repair algorithms in PSNR, SSIM, IS, FID.

关 键 词：多级特征表达 艺术图像修复 渐进式修复 语义修复 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]