本文已被:浏览 1695次 下载 3341次
Received:August 07, 2012 Revised:September 11, 2012
Received:August 07, 2012 Revised:September 11, 2012
中文摘要: 传统的数据分析, 很难满足现阶段大数据处理效率的要求. Hadoop云计算技术的应用, 实现了海量数据存储和分析, 提高了数据存储和分析的效率. 在总结传统系统利弊的基础上, 以Hadoop分布式文件系统(HDFS)取代现有的单机数据存储, 以map/reduce应用程序取代传统的单机数据分析, 并对其做出优化. 实验证明, Hadoop系统架构在生产上部署、投入使用的可行性.
中文关键词: 云计算 Hadoop 数据分析 map/reduce
Abstract:The traditional data analysis, it is difficult to meet data processing efficiency requirements at this stage. Application of Hadoop cloud computing technology, realization of data storage and analysis, improve the efficiency of data storage and analysis. This paper is on the basis of summing up the pros and cons of traditional system, with Hadoop Distributed File System (HDFS) to replace the existing stand-alone data storage, map/reduce application instead of the traditional stand-alone data analysis, and make the optimization. The experiment approves that the feasibility of Hadoop system architecture in the production deployment and using.
keywords: cloud computing Hadoop data analysis map/reduce
文章编号: 中图分类号: 文献标志码:
基金项目:
引用文本:
李寒,唐兴兴.基于参数优化的Hadoop云计算平台.计算机系统应用,2013,22(3):21-24
LI Han,TANG Xing-Xing.Hadoop Cloud Computing Model Based on Parameters Optimization.COMPUTER SYSTEMS APPLICATIONS,2013,22(3):21-24
李寒,唐兴兴.基于参数优化的Hadoop云计算平台.计算机系统应用,2013,22(3):21-24
LI Han,TANG Xing-Xing.Hadoop Cloud Computing Model Based on Parameters Optimization.COMPUTER SYSTEMS APPLICATIONS,2013,22(3):21-24