基于Storm的自适应弹性资源分配策略组件实现  

Component Implementation of Adaptive Elastic Resource Allocation Strategy Based on Storm

作　　者：李丽娜 刘世龙 马钰博 靳德政 李念峰[1] LI Lina;LIU Shilong;MA Yubo;JIN Dezheng;LI Nianfeng(College of Computer Science and Technology,Changchun University,Changchun 130022,China;College of Cyber Security,Changchun University,Changchun 130022,China)

机构地区：[1]长春大学计算机科学技术学院,长春130022 [2]长春大学网络安全学院,长春130022

出　　处：《吉林大学学报（理学版）》2023年第2期384-392,共9页Journal of Jilin University:Science Edition

基　　金：吉林省自然科学基金(批准号:YDZJ202101ZYTS191);吉林省科技厅重点研发项目(批准号:20210201083GX);教育部产学研创新项目(批准号:2020HYB03002,2021ALA03004).

摘　　要：针对Storm平台的静态资源分配问题,提出一种分布式自适应弹性资源分配策略,能最优满足应用的资源需求.基于该策略,结合Storm的资源分配机制、应用编程接口和用户界面的参数,实现了一个面向Storm的弹性资源分配组件,支持应用资源的自适应动态调整.实验结果表明,在真实的流数据集上,分布式最优策略与中值式动态资源分配策略和Storm的静态资源分配策略相比,在吞吐量、丢失率和资源利用率上均有优势.同时,该自适应弹性资源分配组件能很好地与Storm系统交互,为其他弹性资源调度组件开发提供了可借鉴的解决方案.Aiming at the problem of static resource allocation of the Storm platform,we proposed a distributed adaptive elastic resource allocation strategy,which could optimally meet the resource requirements of applications.Based on this strategy,combined with the resource allocation mechanism,application programming interface and user interface parameters of Storm,an elastic resource allocation component deployed in Storm was implemented to support adaptive and dynamic adjustment of application resources.The experimental results show that on the real stream data set,compared with the middle-value dynamic resource allocation strategy and the static resource allocation strategy of Storm,this distributed optimal strategy has advantages in throughput,loss rate and resource utilization.Meanwhile,this adaptive elastic resource allocation component can well interact with the Storm system,providing a reference solution for the development of other elastic resource scheduling components.

关 键 词：流数据处理 资源分配 弹性调度 组件实现 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]