Research on Image Fusion Based on Deep Adversarial Learning  

作　　者：Yachao Zhang Lijuan Feng Jiaxiang Wang 

机构地区：[1]School of Electronics and Electrical Engineering,Zhengzhou University of Science and Technology Zhengzhou 450064,China

出　　处：《IJLAI Transactions on Science and Engineering》2024年第4期1-8,共8页IJLAI科学与工程学报汇刊（英文）

基　　金：supported by the Science and technology research projects,name:Research on key technologies of image fusion based on deep learning,project number:242102210187.

摘　　要：Image fusion,as an important task in computer vision,essentially extracts important features from source images to complement each other and generate fusion images with higher quality and richer information.Infrared and visible images contain different information due to different imaging quantity principles.The key of infrared and visible image fusion algorithm is to integrate the thermal radiation information extracted from infrared images with the captured details and texture information of visible images,so as to obtain a fusion image with complete structure and rich detailed information.Based on the generative adversarial network model,this paper proposes an infrared and visible image fusion method based on dual path dual discriminator generating adversarial network,aiming at the problems existing in the existing research algorithms,such as inadequate extraction of feature information,low efficiency of network model feature transfer,easy loss of shallow information in single-path feature extraction,fewer fusion levels caused by sub-path feature extraction and unbalance of discriminator modes.The gradient path and contrast path based on the difference stitching of source images are constructed at the generator side to improve the detail information and contrast of fused images.The feature information of infrared and visible images is extracted by multi-scale decomposition to solve the problem of incomplete feature extraction on a single scale.Then the source image is introduced into each layer of the double-path dense network,which can improve the efficiency of feature transmission and obtain more source image information.At the end of the discriminator,a double discriminator is used to estimate the region distribution of infrared image and visible image,so as to avoid the mode imbalance problem of the loss of infrared image contrast information in the single discriminator network.Finally,we construct the master-auxiliary gradient and the master-auxiliary strength loss function to improve the information extr

关 键 词：Image fusion Dual path dual discriminator Adversarial network Master-auxiliary gradient 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]