海洋大数据管理技术:架构、平台与存储策略  

Marine Big Data Management Technologies:Architecture,Platform and Storage Strategy

作　　者：韦广昊[1] 韩春花[1] 田先德[1] 杨锦坤[1] 苗庆生[1] WEI Guanghao;HAN Chunhua;TIAN Xiande;YANG Jinkun;MIAO Qingsheng(National Marine Data and Information Service,Tianjin 300171,China)

机构地区：[1]国家海洋信息中心,天津300171

出　　处：《海洋信息技术与应用》2021年第4期46-54,共9页JOURNAL OF MARINE INFORMATION TECHNOLOGY AND APPLICATION

摘　　要：海洋大数据管理是数据共事利用、价值发挥的核心基础。大数据时代,海洋数据在教据量、时效性、数据类型等方面发生了翻天覆地的变化,传统海洋数据管理方式的不足之处日益酉显,亟待引进大数据管理技术理念和方式。本丈通过分析梳理大数据生态架构和技术架构的优缺点和对海洋数据的适用性研究,提出了海洋大数据平台架构和海洋大数据资源池架构,建立了基于事务型数据库、MPP数据库和HDFS的海洋大数据存储架构,以及个性化的海洋大数据存储策略,对于海洋大数据管理具有畫要的技术指导意义。Marine big data management is the core foundation of data sharing and utilization.In the era of big data,marine data has undergone dramatic changes in data volume,timeliness,data type and data value mining,etc.The shortcomings of traditional ocean data management methods have become increasingly prominent,and it is urgent to introduce the technical concepts and methods of big data management.Through analysis of the pros and cons of the ecological and technical architectures of big data and its applicability to the ocean,this paper proposes the marine big data platform architecture,marine big data resources pool architecture,and builds the marine big data storage architecture based on MPP databases and HDFS,along with personalized big data storage strategy.The study may provide important technical guidance to marine big data management.

关 键 词：海洋大数据 数据管理 数据存储 海洋大数据资源池 数据架构 存储策略 

分 类 号：P717[天文地球—海洋科学]