Hadoop平台的性能优化研究  

Research on Performance Optimization of Hadoop Platform

作　　者：栾亚建[1] 黄翀民[1] 龚高晟[1] 赵铁柱[1] 

机构地区：[1]华南理工大学广东省计算机网络重点实验室,广州510640

出　　处：《计算机工程》2010年第14期262-263,266,共3页Computer Engineering

基　　金：Sun Microsystems公司研究基金资助项目

摘　　要：随着基于MapReduce模型的应用程序越来越多,Hadoop性能取决于应用程序。针对上述特性,从应用着手剖析Hadoop存在的局限和不足,提出解决方案,利用作业和任务的多重并发平衡磁盘和网络带宽,减小瓶颈出现的可能性,提高系统性能。As applications programs based on MapReduce model growing up,Hadoop＇s performance depends on applications.From applications,this paper analyzes the limitations and shortcomings of Hadoop architecture and storage technology,and proposes a feasible and cost-effective solution to address the problem.It builds a series tests to convince the idea.The solution is multi-level parallel,both on job and I/O levels,which makes full use of disk and network bandwidth,reduces I/O bottlenecks and improves performance.

关 键 词：分布式计算 存储 并发I/O 性能优化 

分 类 号：TP302[自动化与计算机技术—计算机系统结构]