自适应滤波器的神经网络生成及遥感图像处理新应用  

Neural network generation of adaptive filter and new applications in remote sensing image processing

作　　者：唐娉 刘璇 金兴 张正 TANG Ping;LIU Xuan;JIN Xing;ZHANG Zheng(Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing 100094,China;School of Electronic,Electrical and Communication Engineering,University of Chinese Academy of Sciences,Beijing 100049,China)

机构地区：[1]中国科学院空天信息创新研究院,北京100094 [2]中国科学院大学电子电气与通信工程学院,北京100049

出　　处：《遥感学报》2023年第7期1523-1533,共11页NATIONAL REMOTE SENSING BULLETIN

基　　金：国家自然科学基金重大项目(编号:42192584)。

摘　　要：图像自适应滤波是非线性的图像变换,有广泛的应用场景。传统的图像自适应滤波器均是专家设计的,如双边滤波器和形状自适应滤波等。CNN作为特征提取和非线性能力表达的有效工具,可用于学习构造图像自适应滤波器。本文首先介绍了图像自适应滤波器的生成网络,继而介绍了图像自适应滤波的两个图像处理的新应用:不同时相间的图像变换用于图像插值、不同波段间的图像变换用于图像融合。从这两类应用中,可以窥见图像自适应滤波在构建图像非线性变换方面的应用能力。Image adaptive filtering is a nonlinear image transformation,which has a wide range of applications.Traditional image adaptive filters are designed by experts,such as bilateral filter and shape adaptive filter.They can determine the shape,size,and weight of the filter based on the local structure and content of the image.They are commonly used to suppress noise while preserving the structural characteristics of the image.Convolutional Neural Networks(CNNs)are an effective tool for feature extraction and nonlinear expression.They can be used to learn and construct image adaptive filters.And this paper explores the application of nonlinear image adaptive filters generated by convolutional neural networks in image interpolation and image fusion.This paper introduces the generation network of an image adaptive filter,including its model structure and objective function.The common network structure usually employs an encoder-decoder architecture,which is mainly composed of three parts:feature extraction,feature recovery,and filter(convolution kernel)estimation.Then,the paper presents two different application scenarios of image adaptive filters:image interpolation and image fusion.The adaptive filter for images enables transformation between different phases during image interpolation and transformation between different bands during image fusion.In these two scenarios,the image adaptive filters are learned by the filter generation network based on the specific application scenario and then applied.In image interpolation applications,the image adaptive filter is used as a nonlinear transformation between two temporal images.The interpolated image is looked at as the mean of adaptive filtering of the previous temporal image and adaptive filtering of the latter temporal image.In image fusion applications,the image adaptive filter is used as a nonlinear fitting method to regress multispectral bands to the panchromatic band.It then extracts spatial details from the difference of the panchromatic band and the simulated pan

关 键 词：遥感 图像自适应滤波 滤波器生成网络 动态滤波器网络 图像插值 图像融合 

分 类 号：P2[天文地球—测绘科学与技术]