面向海洋气象的数据汇聚平台  

Data Aggregation Platform for Marine Meteorology

作　　者：谢志敏 宋爽 张彤彤 李翀[3] Xie Zhimin;Song Shuang;Zhang Tongtong;Li Chong(Naval Military Marine Environment Construction Office,Beijing 100081,China;Academy of Military Sciences PLA China,Beijing 100091,China;Computer Network Information Center,Chinese Academy of Sciences,Beijing 100190,China)

机构地区：[1]海军军事海洋环境建设办公室,北京100081 [2]军事科学院,北京100091 [3]中国科学院计算机网络信息中心,北京100190

出　　处：《科研信息化技术与应用》2019年第2期42-50,共9页E-science Technology & Application

摘　　要：海洋气象数据标准各异、来源广泛、结构多样,将这些质量参差不齐的数据加以规范利用具有深远的实际意义。本文以现有海洋气象水文数据管理系统为主要数据源,结合开源爬虫技术定向获取气象水文信息,支持了结构化、半结构化和非结构化数据之间在线和离线格式转换,建立了标准统一、存储便捷、业务广泛的数据汇聚平台,并对数据采集、融合治理、汇聚存储及运维监控等数据汇聚全生命周期进行了设计实现,具有一定的理论意义和实际应用价值。Marine meteorology researchers have accumulated a large amount of meteorological and hydrological data. These data have different project backgrounds in different periods, with different standards, wide sources and Heterogeneous data. The use of these data with uneven data quality has far-reaching and practical significance. This paper takes the existing marine meteorological and hydrological data system as the main data source, and obtains more comprehensive meteorological and hydrological information based on open source web crawling technology, establishes the data aggregation platform which unified standard, convenient storage, covers various aspects of meteorological applications. Moreover we design and implement the entire data life cycle, involving data acquisition, aggregation exchange, data governance,maintenance and monitoring. It has certain theoretical and practical significance.

关 键 词：海洋气象 海洋大数据 数据治理 数据汇聚 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]