多判别器循环生成对抗网络的素描人脸合成  

Sketch Face Synthesis Based on Multi-discriminator Cyclic Generative Adversarial Network

作　　者：周华强 曹林[1,2] 杜康宁 ZHOU Huaqiang;CAO Lin;DU Kangning(Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument,Beijing Information Science and Technology University,Beijing 100101,China;School of Information and Communication Engineering,Beijing Information Science and Technology University,Beijing 100101,China)

机构地区：[1]北京信息科技大学光电测试技术及仪器教育部重点实验室,北京100101 [2]北京信息科技大学信息与通信工程学院,北京100101

出　　处：《计算机工程与应用》2021年第3期231-238,共8页Computer Engineering and Applications

基　　金：国家自然科学基金(61671069);“勤信人才”培育计划(QXTCP A201902)。

摘　　要：素描人脸合成在娱乐和刑侦领域具有重要应用价值。为了解决传统素描人脸合成方法生成图像面部细节模糊,缺失真实感等问题,改进了CycleGAN网络结构,提出一种基于多判别器循环生成对抗网络的素描人脸合成方法。该方法选取残差网络作为生成网络模型,在生成器隐藏层中增加多个判别器,提高网络对生成图像细节特征的提取能力;并建立了重构误差约束映射关系,最小化生成图像与目标图像之间的距离。通过在CUHK和AR人脸数据库中的对比实验,证明了相比于原始CycleGAN框架该方法性能有明显提升;相比于目前领先的方法,所提方法生成的素描图像细节特征更清晰,真实感更强。Sketch face synthesis has important application value in the field of entertainment and criminal investigation.In order to solve the problem of fuzzy face details and lack of realistic sense in the traditional sketch face synthesis method,the CycleGAN framework is improved and a sketch face synthesis method based on multiple discriminator cycle generation antagonistic network is proposed.The residual network is used in proposed method as generating network model,and multiple discriminator are added in the hidden layer of generator to improve the performance of network to extract the detailed features of the generated image.The reconstructed error constrained mapping relation is established to minimize the distance between the generated image and the target image.Through the comparison experiment of CUHK and AR face database,it is proved that the performance of this method is obviously improved compared with that of the original CycleGAN framework.Compared with the current leading methods,the detailed features of the sketch images generated by the method proposed in this paper are clearer and more realistic.

关 键 词：素描人脸合成 生成对抗网络 残差网络 多判别器网络 深度学习 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]