本文已被:浏览 3457次 下载 9099次
Received:April 08, 2017 Revised:May 04, 2017
Received:April 08, 2017 Revised:May 04, 2017
中文摘要: 大数据时代的到来,更强的计算机和更成熟的大数据平台工具让企业从海量数据中挖掘数据价值成为了可能,尤其是基于Hadoop的大数据平台,甚至利用廉价的商业硬件处理TB、PB级别的数据. 在最初Hadoop大数据平台落地建设的过程中,往往功能先行,而忽略了安全的管控策略,直到2009年Yahoo团队提出了基于Kerberos的身份验证方案,才带动了Hadoop大数据平台安全管控工作的全面开展. 本文介绍了Hadoop大数据平台的基本历程,描述了2009年之前Hadoop大数据平台存在的传统安全问题,并尝试着将目前行业内Hadoop生态系统组件的安全性和每个组件的安全解决方案做一次系统的梳理,希望为构建Hadoop大数据平台管控方案时提供参考意见,以便合理利用先进的安全管控方案保护好企业、用户的隐私数据.
Abstract:With the arrival of the big data era, more powerful computers and more mature big data platform tools for enterprises from the massive data mining data value has become possible, especially based on Hadoop Big Data Platform, which can even handle TB, PB level of data with cheap commercial hardware. In the initial construction process of Hadoop Big Data Platform, the first step often starts with the building function, ignoring the security control strategy. The Yahoo team proposed Kerberos-based authentication scheme in 2009, which led to the Hadoop Big Data Platform security control work in full swing. This article introduces the history of the Hadoop Big Data Platform. Then, it describes the traditional security issues existing in Hadoop Big Data Platform before 2009. Finally, it tries to present the security of the Hadoop ecosystem components in the industry and the security solution for each component. We hope to provide reference for the construction of Hadoop Big Data Platform security, so people can reasonably use advanced security control program to protect the enterprise's and user's privacy data.
keywords: big data Hadoop authentication authorization data security audit
文章编号: 中图分类号: 文献标志码:
基金项目:广东省自然科学基金(2016A030313437);广东省重大科技专项(2016B030305004)
引用文本:
陈丽,黄晋,王锐.Hadoop大数据平台安全问题和解决方案的综述.计算机系统应用,2018,27(1):1-9
CHEN Li,HUANG Jin,WANG Rui.Overview on Security Issues and Solutions of Hadoop Big Data Platform.COMPUTER SYSTEMS APPLICATIONS,2018,27(1):1-9
陈丽,黄晋,王锐.Hadoop大数据平台安全问题和解决方案的综述.计算机系统应用,2018,27(1):1-9
CHEN Li,HUANG Jin,WANG Rui.Overview on Security Issues and Solutions of Hadoop Big Data Platform.COMPUTER SYSTEMS APPLICATIONS,2018,27(1):1-9