From single-to multi-modal remote sensing imagery interpretation:a survey and taxonomy  

作　　者：Xian SUN Yu TIAN Wanxuan LU Peijin WANG Ruigang NIU Hongfeng YU Kun FU 

机构地区：[1]Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing 100190,China [2]Key Laboratory of Network Information System Technology(NIST),Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing 100190,China [3]University of Chinese Academy of Sciences,Beijing 100190,China [4]School of Electronic,Electrical and Communication Engineering,University of Chinese Academyof Sciences,Beijing100190,China

出　　处：《Science China(Information Sciences)》2023年第4期1-28,共28页中国科学（信息科学）（英文版）

基　　金：supported by National Key R&D Program of China(Grant No.2021YFB3900504);National Natural Science Foundation of China(Grant Nos.61725105,62171436)。

摘　　要：Modality is a source or form of information.Through various modal information,humans can perceive the world from multiple perspectives.Simultaneously,the observation of remote sensing(RS)is multimodal.We observe the world macroscopically through panchromatic,Lidar,and other modal sensors.Multimodal observation of remote sensing has become an active area,which is beneficial for urban planning,monitoring,and other applications.Despite numerous advancements in this area,there has still not been a comprehensive assessment that provides a systematic overview with a unified evaluation.Accordingly,in this survey paper,we first highlight the key differences between single-and multimodal RS imagery interpretation,then use these differences to guide our research survey of multimodal RS imagery interpretation in a cascaded structure.Finally,some potential future research directions are explored and outlined.We hope that this survey will serve as a starting point for researchers to review state-of-the-art developments and work on multimodal research.

关 键 词：MULTIMODAL remote sensing image interpretation feature fusion co-learning 

分 类 号：TP751[自动化与计算机技术—检测技术与自动化装置]