对象存储系统中基于监控的动态负载均衡方法  

Monitoring-based dynamic load balancing approach in object-based storage system

作　　者：王家柱 范中磊[1] 毕强 郭少松 WANG Jiazhu;FAN Zhonglei;BI Qiang;GUO Shaosong(College ofInformation,Chang’An University,Xi′an 710064,Shaanxi,China)

机构地区：[1]长安大学信息工程学院,陕西西安710064

出　　处：《微电子学与计算机》2022年第12期69-76,共8页Microelectronics & Computer

基　　金：中央高校基本科研业务费专项资金(CHD2011TD009)。

摘　　要：负载均衡在存储系统领域一直是研究的热点,但在分布式的对象存储系统中的应用与实现方面仍存在缺陷.针对对象存储系统中负载均衡方法大都依靠经验或有限的动态配置指导自适应算法进行、在负载再平衡过程中无法控制迁移节奏,算法实现复杂,未充分考虑存储节点实时负载状况等不足,提出了一种基于监控的动态负载均衡方法.该方法将监控系统引入对象存储系统,完成对各存储节点负载状况的实时感知;根据节点负荷、异构性等因素进行综合估计来触发迁移算法,避免了依靠经验及预设值指导算法执行;利用监控系统灵活的自定义事件触发机制和故障自动化处理机制,设计负载迁移策略,动态完成节点间的负载再平衡,降低算法实现复杂难度;使用监控系统动作执行过程中的多步操作顺序流控制完成一次一迁移,有效掌控负载迁移节奏.将该方法应用到自主研发的对象存储系统CSCloud进行验证的结果表明,该方法能及时获取集群中各节点的负载信息,并实现及时、准确的动态负载平衡,为对象存储系统和其他分布式存储系统实现负载均衡提供了新思路.The load balancing has always been a research hotspot in the field of storage systems,but there are still shortcomings in its application and implementation in distributed object-based storage systems.Aiming at the facts that load balancing in object-based storage system mostly relies on experience or limited dynamic configuration to guide the execution of the algorithm,the migration rhythm cannot be controlled during the load rebalancing process,the algorithm implementation is complex,and the real-time load conditions of storage nodes are not fully considered,a dynamic load balancing method based on monitoring is proposed.In this method,the monitoring system is introduced into the object-based storage system to complete the real-time perception of the load status of each storage node;the migration algorithm is triggered by comprehensive estimation according to the node load,heterogeneity and other factors,avoiding relying on experience and preset values to guide the execution of the algorithm;Use the flexible custom event trigger mechanism and fault automatic processing mechanism of the monitoring system to design a load migration strategy to dynamically complete the load rebalancing between nodes,and reduce the complexity of the algorithm implementation;Use the multi-step operation sequence flow control in the monitoring system action execution process to complete one-by-one migration,and effectively control the load migration rhythm.The results of the verification of the method applied to the self-developed object-based storage system CSCloud show that the method can obtain the load information of each node in the cluster in a timely manner and achieve timely and accurate dynamic load balancing,which provides a new idea for the dynamic load balancing of object-based storage system and other distributed storage systems.

关 键 词：对象存储系统 负载均衡 监控系统 实时感知 负载迁移 

分 类 号：TP301[自动化与计算机技术—计算机系统结构] TP303[自动化与计算机技术—计算机科学与技术]