基于列式数据库的大数据平台设计与实现  

Design and Implementation of Big Data Platform based on Column Database

作　　者：刘彦会[1] LIU Yanhui(Department of Information,Minbei Vocational and Technical College,Nanping 353000,China)

机构地区：[1]闽北职业技术学院信息系,福建南平353000

出　　处：《成都工业学院学报》2021年第3期48-52,共5页Journal of Chengdu Technological University

摘　　要：基于现阶段水电企业等对大数据平台开发的需求,对水电企业的系统数据资源进行收集,建立大数据集成平台总体框架设计,并对大数据平台建立过程中的数据源层、数据集成层和数据存储层进行逐层设计与分析。在此基础上,为了最大限度地满足使用需求,大数据平台配置了14台服务器,包括Kettle服务器、GBase、Storm和Kafka等,完成了基于水电企业的大数据平台的实现,运行过程中较为稳定,可以实现数据的集成与分析应用,更加有利于公司的高效化运转。Based on the current needs of hydropower enterprises for the development of big data platform,the system data resources of hydropower enterprises were collected,the overall framework for big data integration platform was established,and the data source layer,data integration layer and data storage layer was designed and analyzed layer by layer in the process of building the big data platform,On this basis,in order to meet the use needs to the maximum extent,the big data platform was configured with 14 servers,including kettle server,gbase,storm and Kafka,etc.,and the implementation of big data platform based on hydropower enterprises was completed.The operation process is relatively stable,which can realize data integration and analysis application,which is more conducive to the efficient operation of the company.

关 键 词：大数据 平台设计 数据源层 数据集成层 数据存储层 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]