基于Hadoop视频转码的任务调度算法  

Scheduling Algorithm Based on Video Transcoding Using Hadoop

作　　者：毕莎莎[1] 陈清华[1,2,3] 高煜红[4] 

机构地区：[1]南京工业大学电子与信息工程学院,江苏南京210009 [2]浙江清华长三角研究院,浙江嘉兴314006 [3]北京大学软件与微电子学院,北京102600 [4]浙江工业大学信息工程学院,浙江杭州310023

出　　处：《无线电通信技术》2014年第2期63-66,85,共5页Radio Communications Technology

基　　金：江苏省基础研究计划资助项目(BK2010137);浙江省十二五重大科技专项(2012C01037-1);嘉兴市科技计划项目(2011AZ1013)

摘　　要：现有的分布式转码系统大多没有考虑到根据计算节点的处理能力分配转码任务量,对转码过程造成影响,导致转码效率降低。针对这一问题,在对现有Max-Min算法的研究基础上,提出一种新的任务调度算法。利用佩奇排名算法评估机器转码性能,输入视频被分成大小不同的段,依据其复杂度和机器的转码能力进行映射。处理能力强的节点将分配到更多的视频块,最终所有计算节点的完成时间得到均衡化。实验结果表明,该算法能够显著提升视频转码效率,在很大程度上改善了云转码系统。Allocation videos in accordance with the processing capacity of computing nodes has a significant impact on transcoding performance,which is currently not taken by most existing distributed transeoding systems into account, resulting in degradation of transcoding efficiency.To address this problem,based on the research of existing scheduling algorithm Max-Min,a modified algorithm is proposed.This paper used a PageRank to evaluate the computer performance. Input video sequences are divided into segments, and mapped to multiple computers.Computing nodes with higher handling abilities will get more video segments.Obviously,it would average the finish time of the computers. Experimental results show that the proposed algorithm can achieve performance improvement of transcoding efficiency,and enhance distributed transcoding system to a large extent.

关 键 词：分布式转码 任务调度 佩奇排名 均衡化 

分 类 号：TN92[电子电信—通信与信息系统]