基于Wasserstein距离的双向学习推理  

Bidirectional learned inference based on Wasserstein distance

作　　者：花强[1] 刘轶功 张峰[1] 董春茹[1] HUA Qiang;LIU Yigong;ZHANG Feng;DONG Chunru(Key Laboratory of Machine Learning and Computational Intelligence of Hebei Province,Hebei University,Baoding 071002,China)

机构地区：[1]河北大学河北省机器学习与计算智能重点实验室,河北保定071002

出　　处：《河北大学学报（自然科学版）》2020年第3期328-336,共9页Journal of Hebei University(Natural Science Edition)

基　　金：河北省自然科学基金面上项目(F2018201115,F2018201096);河北省教育厅科学技术研究重点项目(ZD2019021);河北省教育厅科学技术研究青年基金资助项目(QN2017019)。

摘　　要：基于Wasserstein距离的生成对抗网络(WGAN)将编码器和生成器双向集成于其模型中,从而增强了生成模型的学习能力,但其在优化目标中使用KL散度度量分布间的差异,会导致学习训练过程中出现梯度消失或梯度爆炸问题,降低模型鲁棒性.为克服这一问题,提出了一种基于Wasserstein距离的双向学习推理(WBLI)模型.文章首先建立了真实数据分布与隐数据分布双向学习网络,然后引入Wasserstein距离度量联合概率分布的差异性,并据此推导了可解的损失代价函数,给出了完整的网络学习模型和迭代算法.实验结果表明,WBLI模型有效缓解了传统GAN及其变种的模式坍塌问题,增强了训练学习的鲁棒性,可生产辨识度更高的样本.In WGAN,embedding encoder into Generative Adversarial Networks(GAN)can enhance the learning ability of the generative model.However,using the Kullback-Leibler(KL)divergence to measure the difference between two distributions in the optimization objective will lead to the gradient vanishing or gradient explosion problem in the learning training process and reduce the robustness of model.In order to tackle this problem,a Wasserstein-distance-based Bidirectional Learned Inference(WBLI)model is proposed in this paper.A bidirectional network is first established for learning the distribution of the true data and latent variables,where the difference of the joint probability distribution is measured by the Wasserstein distance.Based on this Wasserstein distance,we redesign the loss function which is solvable and consequently propose an iterative algorithm.The experimental results show that the WBLI model overcomes the defects of traditional GAN and its variants.It effectively eliminates the model collapse problem of generating models,increases the robustness of training learning,and contributes to the improvement of the recognition rate of classifiers.

关 键 词：生成对抗网络 KL散度 Wasserstein距离 变分自编码器 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]