大数据分析平台建设与应用综述  

Review on Construction and Application of Big Data Analytical Platform

作　　者：王强[1] 李俊杰[1] 陈小军[1] 黄哲学[1] 陈国良[2] 

机构地区：[1]深圳大学大数据技术与应用研究所,深圳518060 [2]深圳大学高性能计算研究所,深圳518060

出　　处：《集成技术》2016年第2期2-18,共17页Journal of Integration Technology

摘　　要：大数据分析平台是开展大数据处理与分析应用所必需的基础设施。文章基于课题组开展大数据分析平台建设的科研成果与实践经验,结合大型企业实施行业应用项目的切身感受,从大数据分析平台设计、主流热点技术、行业应用案例三个方面进行介绍。文章首先分析了大数据分析平台的主要功能和体系架构,然后介绍了大数据分析平台的关键技术,重点介绍了Spark技术的体系架构及核心组件,最后介绍了大数据技术在大规模制造业、零售业和智能电网三个领域的应用案例。The big data analytics platform is an indispensable infrastructure for big data processing and applications. Based on our research activities, practical experiences with big data analytics, and lessons learnt from industrial projects, this paper addressed the platform design, mainstream technologies, and industrial cases of big data analytics platforms. Firstly, the main functions and architecture of such platforms were analyzed. Then the key enabling technologies were introduced with a focus on the architecture of Spark and its core components. Finally three application case studies were presented in the areas of massive manufacture, retail, and smart grids.

关 键 词：大数据平台 大数据分析 大数据应用 内存计算 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]