A multi-frame sparse self-learning PWC-Net for motion estimation in satellite video scenes  

作　　者：Tengfei WANG Yanfeng GU Shengyang LI 

机构地区：[1]School of Electronics and Information Engineering,Harbin Institute of Technology,Harbin 150001,China [2]Technology and Engineering Center for Space Utilization,Chinese Academy of Sciences,Beijing 100094,China [3]University of Chinese Academy of Sciences,Beijing 100049,China

出　　处：《Science China(Information Sciences)》2023年第9期209-221,共13页中国科学（信息科学）（英文版）

基　　金：National Natural Science Foundation of Key International Cooperation(Grant No.61720106002);National Natural Science Foundation for Outstanding Scholars(Grant No.62025107)。

摘　　要：Motion estimation is an important approach to acquiring motion information of all targets in satellite video while it provides the ability to real-time monitor the Earth observation region.Compared with the case in computer vision,motion estimation in satellite video has to face two main difficulties:the large scale of observation and numerous weak targets of low signal-to-noise ratio.In this paper,a multi-frame sparse self-learning PWC-Net(MSSPWC-Net)is proposed to implement motion estimation of the weak targets in satellite video.To overcome the shortage that the existing PWC-Net fails to extract motion information from numerous weak targets,motion consistency and sparse self-learning are introduced to modify the pyramid,warping,and cost volume convolutional neural networks(CNN)network(PWC-Net).The motion consistency between neighboring frames as a multi-frame framework is mainly used to improve the accuracy of motion estimation of the weak targets,and sparse self-learning is adopted to deal with the case that labeled samples in satellite video are insufficient to train PWC-Net.Numerical experiments are conducted on 4 real satellite video datasets.Experimental results demonstrate that the proposed MSSPWC-Net achieves the excellent performance of motion estimation of the weak targets in satellite video and outperforms the state-of-the-art methods.

关 键 词：satellite video scenes motion estimation small blurry targets 

分 类 号：TP751[自动化与计算机技术—检测技术与自动化装置]