基于图像蒙板的无监督图像风格迁移  

Unsupervised image style transfer based on image mask

作　　者：孔棱睿 滕少华[1] Kong Lengrui;Teng Shaohua(College of Computer,Guangdong University of Technology,Guangzhou 510006,China)

机构地区：[1]广东工业大学计算机学院,广州510006

出　　处：《计算机应用研究》2020年第8期2552-2555,共4页Application Research of Computers

基　　金：国家自然科学基金资助项目(61402118,61673123,61603100,61702110);广东省科技计划项目(2015B090901016,2016B010108007);广东省教育厅项目(粤教高函[2018]1号,粤教高函[2015]133号,粤教高函[2014]97号);广州市科技计划项目(201604020145,201604030034,201508010067,201604046017,201802010026,201802010042)。

摘　　要：目前大多数的图像风格迁移方法属于有监督学习,训练数据需要成对出现,并且在处理图像背景时,现有的方法过于繁琐。针对这些问题,提出了一种基于图像蒙板的无监督图像风格迁移方法。在实验中,采用了基于循环一致性的CycleGAN架构,并使用Inception-ResNet结构设计了一个全新的具有内置图像蒙板的生成式模型,最后通过无监督学习将图像的背景与学习到的抽象特征进行自动重组。实验表明,新方法有效地对图像背景和抽象特征进行自动分离与重组,同时解决了特征学习过程中的区域干扰问题,获得了可观的视觉效果。At present,most of the current image style transfer methods are supervised learning,the training data need to appear in pairs.And when the background of the image needs to be processed,the existing methods are too cumbersome.In order to solve these problems,this paper proposed a new method of unsupervised image style transfer based on image mask.In the experiment,it adopted the architecture of the cycle-consistent generative adversarial network,and used the Inception-ResNet structure as the basic component to design a new generative model with the built-in image mask.At last,it automatically reconstructed the background of the image and the learned abstract features through unsupervised learning.Experiments show that the proposed method can effectively separate and reconstruct the background and the learned abstract features of the image,and solves the problem of regional interference in the feature learning process,and achieves considerable visual effects.

关 键 词：图像风格迁移 生成式对抗网络 无监督学习 图像蒙板 深度学习 

分 类 号：TP391.12[自动化与计算机技术—计算机应用技术]