大数据数据仓库商业智能平台设计与实现  

Design and Implementation of Business Intelligence Platform for Big Data Warehouse

作　　者：杨细勇 YANG Xiyong(Xiamen Hymake Technology Co.,Ltd.,R&D Center,Xiamen,China,361008)

机构地区：[1]厦门海迈科技股份有限公司研发中心,福建厦门361008

出　　处：《福建电脑》2020年第12期35-38,共4页Journal of Fujian Computer

摘　　要：为了方便大数据量下的报表统计分析及互通融合各部门之间存在数据信息,本文提出大数据数据仓库的商业智能平台,该平台借助Spark等技术,通过ETL组件从不同业务系统、日志系统的多种数据源中提取原始数据,清洗数据后载入到数据仓库,借鉴Apache Kylin的Cube预计算的思想,结合Spark源码定制开发,通过多维度多度量的方式,构建模型和立方体,实现数据计算处理和查询,以Web报表和驾驶舱形式进行展示。平台的建立可为公司的管理层提供实时有效的决策信息,提高决策质量,助力建筑行业数字化和智能化转型。In order to facilitate the statistical analysis of reports under large amounts of data and the intercommunication and integration of data information between various departments,this paper proposes a business intelligence platform for big data warehouses.This platform uses technologies such as Spark to obtain data from different business systems and log systems through ETL components.Extract raw data from a variety of data sources,clean the data and load it into the data warehouse,draw on Apache Kylin's Cube pre-calculation idea,combine Spark source code custom development,build models and cubes through multi-dimensional and multi-measurement methods,and realize data calculation Processing and query are displayed in the form of Web reports and cockpit.The establishment of the platform can provide real-time and effective decision-making information for the company's management,improve the quality of decision-making,and help the digital and intelligent transformation of the construction industry.

关 键 词：报表统计 驾驶舱 大数据 数据仓库 商业智能 

分 类 号：TP31[自动化与计算机技术—计算机软件与理论]