基于任务属性的MapReduce任务调度算法改进  

The Improvement of MapReduce Task Scheduling Algorithm Based on Task Attributes

作　　者：朱洁[1] 李雯睿[1] 王江平[1] 

机构地区：[1]南京晓庄学院数学与信息技术学院,江苏南京211171

出　　处：《南京晓庄学院学报》2014年第6期82-86,共5页Journal of Nanjing Xiaozhuang University

基　　金：国家自然科学基金(61202136);江苏省科技项目(BY2013095-3-11);南京晓庄学院科研项目(2012NXY14;2013NXY99)

摘　　要：针对MapReduce任务调度中任务属性取默认值的不合理性以及人为指定值的不确定性,对调度算法实现动态调整任务优先级、计算合理的Reduce任务数、明确Reduce任务启动时机等改进,达到提升任务并行度、缩短作业执行时间的目的.Fair与LATE算法改进前后的实验结果表明,基于任务属性的改进能提高调度算法性能与作业整体执行效率.Task scheduling is the core problem in MapReduce.Researches on scheduling algorithm rarely involve task attributes.Aiming at the irrationality of default values of the task attributes and the uncertainty of artificially specified values,this study made dynamic priority adjustments and calculated the rational number and the starting time of Reduce tasks,with a view to enhancing tasks parallelism and reducing the executing time of jobs.The results of the experiments based on Fair and LATE algorithms show that the improvement based on task attributes improves the scheduling algorithm performance and the overall jobs execution efficiency.

关 键 词：MAPREDUCE 任务调度 任务属性 优先级 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]