基于大数据技术的水情云数据中心设计与研究  

Design and research of Zhejiang hydrologic cloud data center based on big data technology

作　　者：邱超 许金涛 元晓华 QIU Chao;XU Jintao;YUAN Xiaohua(Zhejiang Provincial Hydrology Bureau,Hangzhou 310009,China;Institute of Agricultural Remote Sensing and Information Technology Application,College of Environmental and Resource Sciences,Zhejiang University,Hangzhou 310058,China)

机构地区：[1]浙江省水文局,浙江杭州310009 [2]浙江大学环境与资源学院农业遥感与信息技术应用研究所,浙江杭州310058

出　　处：《浙江大学学报（理学版）》2019年第1期92-100,共9页Journal of Zhejiang University（Science Edition）

基　　金：浙江省水利科技计划项目(RB1717)

摘　　要：随着浙江省水情信息化的不断推进,水情数据种类、结构和数据量不断丰富和发展,传统的单结构化数据存储管理方式已不适合当前信息化社会的应用和服务需求。本研究采用先进的分布式数据采集、智能数据过滤、大数据存储等技术,构建基于大数据云平台技术的浙江省水情云数据中心,对各类分散的多源异构数据进行全面整合。实现了水情大数据的质量管控、深度挖掘和高效共享,丰富了水情信息的资源样本,拓展了服务深度和广度,提升了数据挖掘的服务效率和能力,为水利业务和事务的现代化发展奠定了坚实的基础。With the rapid advancement of hydrologic informatization in Zhejiang province,the type,structure and volume of hydrological data are continuously enriched and developed.Traditional single-structured data storage and management methods cannot meet the requirements of the information-based society,hence not suitable today.This research adopts advanced technologies such as distributed data acquisition,intelligent data filtering and big data storage to build a hydrologic cloud data center in Zhejiang province.Based on the big data cloud platform technology,the cloud data center integrates various types of distributed multi-source heterogeneous hydrological data.It not only supports quality control,deep mining and efficient sharing of hydrological data,but enriches the resource sample of hydrological information and expands the depth and breadth of hydrological services.With the improved data mining and analysis efficiency,the cloud data center lays a solid foundation for modernization of water conservancy.

关 键 词：分布式数据采集 智能数据过滤 大数据存储 

分 类 号：TP932[自动化与计算机技术] TV213[水利工程—水文学及水资源]