基于ETL的政务云气象数据仓库构建  

Establishment of Meteorological Data Warehouse Based on ETL Tools

作　　者：许皓皓 廉亮 姚浩立 XU Hao-Hao;LIAN Liang;YAO Hao-Li(Ningbo Meteorological Network and Equipment Support Center,Ningbo 315012,China;Ningbo Meteorological Service Center,Ningbo 315012,China)

机构地区：[1]宁波市气象网络与装备保障中心,宁波315012 [2]宁波市气象服务中心,宁波315012

出　　处：《计算机系统应用》2018年第9期224-228,共5页Computer Systems & Applications

摘　　要：针对气象网站等应用系统向地方政务云迁移过程中缺乏基础数据的现状,从功能性,开发成本,灵活性方面考虑选用ETL工具,基于Kettle软件对气象数据ETL流程进行建模,使用Quartz开发作业调度系统实现ETL流程的自动化运行,在政务云搭建SQL Server数据库集群,构建了政务云气象数据仓库.该数据仓库实现了异构环境气象数据在政务云的实时同步和存储,为气象应用系统在政务云的全面部署提供了数据支持,也为气象部门参与电子政务数据交换和共享打下基础.Aiming to solve current status of data deficiencies in the process of meteorological websites and other applications migrating to local government cloud, choosing ETL tools by considering functionality, development cost, and flexibility, a job scheduling system based on Quartz framework was developed to automatize the meteorological data ETL processes which are modeled by using Kettle software, an SQL Server database cluster was built, overall established a meteorological data warehouse in government cloud. This data warehouse fulfills the purpose of multiple-source meteorological data synchronizing and storing to government cloud in real-time, provides data support for those meteorological application systems has been or will be deployed in government cloud, also lays the foundation for meteorological department involving in E-government data sharing and exchanging.

关 键 词：政务云 气象数据仓库 数据同步 ETL KETTLE 

分 类 号：P409[天文地球—大气科学及气象学]