Hadoop大数据平台安全问题和解决方案的综述  

Overview on Security Issues and Solutions of Hadoop Big Data Platform

作　　者：陈丽[1] 黄晋[2] 王锐[3] 

机构地区：[1]广东交通职业技术学院信息学院,广州510650 [2]华南师范大学计算机学院,广州510631 [3]中国移动通信集团广东有限公司,广州510623

出　　处：《计算机系统应用》2018年第1期1-9,共9页Computer Systems & Applications

基　　金：广东省自然科学基金(2016A030313437);广东省重大科技专项(2016B030305004)

摘　　要：大数据时代的到来,更强的计算机和更成熟的大数据平台工具让企业从海量数据中挖掘数据价值成为了可能,尤其是基于Hadoop的大数据平台,甚至利用廉价的商业硬件处理TB、PB级别的数据.在最初Hadoop大数据平台落地建设的过程中,往往功能先行,而忽略了安全的管控策略,直到2009年Yahoo团队提出了基于Kerberos的身份验证方案,才带动了Hadoop大数据平台安全管控工作的全面开展.本文介绍了Hadoop大数据平台的基本历程,描述了2009年之前Hadoop大数据平台存在的传统安全问题,并尝试着将目前行业内Hadoop生态系统组件的安全性和每个组件的安全解决方案做一次系统的梳理,希望为构建Hadoop大数据平台管控方案时提供参考意见,以便合理利用先进的安全管控方案保护好企业、用户的隐私数据.With the arrival of the big data era, more powerful computers and more mature big data platform tools for enterprises from the massive data mining data value has become possible, especially based on Hadoop Big Data Platform, which can even handle TB, PB level of data with cheap commercial hardware. In the initial construction process of Hadoop Big Data Platform, the first step often starts with the building function, ignoring the security control strategy. The Yahoo team proposed Kerberos-based authentication scheme in 2009, which led to the Hadoop Big Data Platform security control work in full swing. This article introduces the history of the Hadoop Big Data Platform. Then, it describes the traditional security issues existing in Hadoop Big Data Platform before 2009. Finally, it tries to present the security of the Hadoop ecosystem components in the industry and the security solution for each component. We hope to provide reference for the construction of Hadoop Big Data Platform security, so people can reasonably use advanced security control program to protect the enterprise＇s and user＇s privacy data.

关 键 词：大数据 HADOOP 身份验证 授权 数据安全 审计 

分 类 号：TP309[自动化与计算机技术—计算机系统结构] TP311.13[自动化与计算机技术—计算机科学与技术]