基于实时负载的HDFS负载均衡改进与实现  

Improvement and Realization of HDFS Load Balance based on Real-time Load

作　　者：陈晨[1] 张东[1] 

机构地区：[1]四川大学,四川成都610065

出　　处：《计算机安全》2014年第12期21-25,共5页Network & Computer Security

摘　　要：针对HDFS系统自带的负载均衡策略所使用的静态固定阈值的主观性太强以及未考虑集群繁忙时启动均衡机制对主业务运行效率的影响,重新定义了系统负载,提出了基于实时负载的动态阈值的计算方法。该方法根据各Data Node所占磁盘空间使用率情况以及Data Node的工作繁忙状态,使集群动态地计算出能反映当前集群繁忙状态的阈值,减少均衡机制对整个集群主业务的影响,从而实现集群在系统使用和磁盘占用空间之间更好的平衡。This article deal with strong subjectivity of static threshold used by HDFS load balance and the influence on the main work when the colony is busy,redefines the new meaning of system load and bring up the method how to caleulate the value of dynamic threshold. The method based on storage space utilization and busy state of all the datanode,calculates the threshold that can reflect the busy stare of the colony,reducing the influence on main work to achieve the halanee between the system use and the total disk space.

关 键 词：云计算 HDFS 负载均衡 阈值 

分 类 号：TP393.4[自动化与计算机技术—计算机应用技术]