集群内高效可靠的数据文件分发方案的设计  

Design of Efficient and Reliable Data File Distribution Solution in Cluster

作　　者：杨永凯[1,2] 彭明田 王炜东[1] YANG Yong-kai;PENG Ming-tian;WANG Wei-dong(TravelSky Technology Limited,Beijing 101318,China;Key Laboratory of Intelligent Passenger Service of Civil Aviation,Beijing 101318,China)

机构地区：[1]中国民航信息网络股份有限公司,北京101318 [2]民航旅客服务智能化应用技术重点实验室,北京101318

出　　处：《计算机技术与发展》2019年第11期163-167,共5页Computer Technology and Development

基　　金：国家核高基课题(2014ZX010450101);国家发改委2014年云计算工程项目(发改办高技[2014]1799号)

摘　　要：为了实现局域网集群内数据文件的高效和可靠的分发,设计了数据流和控制流相结合的数据文件分发方案。在数据流方面,以ZeroMQ为基础设计了UDP协议下的多播数据文件传输方案。在控制流方面,基于TCP协议设计了多播数据文件传输控制方案。传输控制方案包括监控模块、检测模块、调速模块和计速模块,监控模块和检测模块实现了对数据文件传输开关的控制,调速模块和计速模块实现了对数据文件传输速率的控制,两方面结合实现了对多播数据文件传输的有效调度,达到了数据文件分发过程中的高效和可靠的双重目的。工程实践表明,在保证一定的多播传输速率的基础上,可以提升数据文件分发的一次多播成功率,减少多播传输的轮次,能够实现集群内高效可靠的数据文件分发。In order to achieve efficient and reliable data file distribution in cluster,a data file distribution solution combining data flow and control flow is designed.In the data flow,based on ZeroMQ,the multicast data file transmission scheme based on UDP is designed,and in the control flow,a multicast data file transmission control scheme based on TCP is designed.The transmission control scheme includes monitor module,check module,shift module and meter module.The monitor module and check module realize the control of the data file transmission switch,the shift module and the meter module realize the control of the data file transmission rate,and the combination of the two aspects realizes the effective scheduling of the multicast data file transmission,achieving the dual purpose of high efficiency and reliability in the data file distribution.Engineering practice shows that,on the basis of guaranteeing a certain multicast transmission rate,the success rate of one multicast for data file distribution can be improved,the round of multicast transmission can be reduced,and the efficient and reliable data file distribution within the cluster can be realized.

关 键 词：集群 文件分发 ZeroMQ 多播 传输控制 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]