水利遥感数据规模化加工处理平台框架研究  

Study on a large-scale processing platform framework for hydrological remote sensing data

作　　者：江威 庞治国[1,2] 吕娟 丁小辉[3] 张朋杰 何国金 张伟 JIANG Wei;PANG Zhiguo;L Juan;DING Xiaohui;ZHANG Pengjie;HE Guojin;ZHANG Wei(China Institute of Water Resources and Hydropower Research,Beijing 100038,China;Research Center of Flood and Drought Disaster Reduction of the Ministry of Water Resources,Beijing 100038,China;School of Software and Internet of Things Engineering,Jiangxi University of Finance and Economics,Nanchang 330013,China;Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing 100094,China;Beijing Tianmu Innovation Technology Co.,Ltd.,Beijing 100096,China)

机构地区：[1]中国水利水电科学研究院,北京100038 [2]水利部防洪抗旱减灾工程技术研究中心(水旱灾害防御中心),北京100038 [3]江西财经大学软件与物联网工程学院,南昌330013 [4]中国科学院空天信息创新研究院,北京100094 [5]北京天目创新科技有限公司,北京100096

出　　处：《中国水利水电科学研究院学报（中英文）》2024年第2期219-228,共10页Journal of China Institute of Water Resources and Hydropower Research

基　　金：国家自然科学基金项目(42301450);中国水利水电科学研究院基本科研业务费专项项目(JZ110145B0012023);中国水科院减灾中心“技术研发型”科技创新人才项目(WH0166B012023)。

摘　　要：以卫星遥感为代表的地表信息空天获取手段是支撑新时期智慧水利建设的重要途径。当前,遥感数据获取能力与处理服务能力之间出现了失衡,大量的对地观测卫星遥感数据被获取,而能够支撑水利业务的遥感数据产品即时服务能力和动态更新频次仍然存在瓶颈,“卫星数据量大、处理流程复杂、产品服务不足”的现状长期存在,制约着水利行业遥感应用的质量和效率。本文通过调研当前国内外遥感大数据加工处理进展,分析了面向智慧水利建设的水利遥感数据处理平台需求,设计了一种水利遥感数据规模化加工处理平台的框架,用于海量卫星遥感数据产品全链路自动化处理,以提升水利遥感数据产品处理质量和服务效率。该平台可以实现超过30种多源高分遥感数据全流程处理,通过动态分配GPU和CPU计算缓存,实现卫星遥感数据正射校正、融合、镶嵌、质检以及水利遥感专题信息提取等流程规模化、并行化和自动化处理,生产满足数字孪生流域建设的卫星遥感专题产品,支撑新时期智慧水利建设的遥感深度应用。Satellite remote sensing,as a representative means of aerospace information acquisition,plays a crucial role in supporting the development of smart water resources management in the new era.Currently,there is a significant imbalance between the capability to acquire remote sensing data and the capability to provide data processing services.While a large volume of Earth observation satellite remote sensing data is being collected,there are still bottlenecks in the immediate service capability and dynamic update frequency of remote sensing data products that can support water resources management.The persistent challenges of“large satellite data volume,complex processing workflows,and inadequate product services”continue to hinder the quality and efficiency of remote sensing applications in the water resources field.This paper conducts research and analysis of the current progress in domestic and international remote sensing big data processing.It analyzes the requirements for a hydrological remote sensing data processing platform tailored for smart water resources management.A framework for a large-scale processing platform for water resources remote sensing data is designed,intended for the automated processing of massive satellite remote sensing data products along the entire chain.This platform aims to enhance the quality and efficiency of water resources remote sensing data product processing.It can achieve parallel processing for over 30 different sources of high-resolution remote sensing data,utilizing dynamic allocation of GPU and CPU computing resources to automate tasks such as satellite remote sensing data orthorectification,fusion,mosaicking,quality control,and extraction of hydrological remote sensing thematic information.The platform produces satellite remote sensing thematic products that meet the requirements for digital twin basin construction,thus supporting the deep application of remote sensing in smart water resources management in the new era.

关 键 词：水利遥感 规模化处理 遥感大数据 遥感专题产品 智慧水利 

分 类 号：TP751.1[自动化与计算机技术—检测技术与自动化装置]