关于Kafka分区策略对系统性能影响的研究  

Research on the influence of Kafka partition assignment strategy on system performance

作　　者：孟月昊 林荣霞 冯文 刘全兵 Meng Yuehao;Lin Rongxia;Feng Wen;Liu Quanbing(32753Troops,Wuhan,Hubei 430000,China)

机构地区：[1]32753部队,湖北武汉430000

出　　处：《计算机时代》2020年第11期11-15,共5页Computer Era

摘　　要：在实际应用Kafka系统过程中,常因分区策略选择不当而导致系统负载不均衡,节点经常下线,影响业务工作。文章从消费速率变化和CPU使用率两个方面切入,研究分析了RangeAssignor、RoundRobinAssignor、StickyAssignor三种分区策略对Kafka在系统开销和负载均衡方面的影响,得出了这三种分区策略对系统影响的特点,对在实际生产应用Kafka过程中分区策略的选择和使用,起到了一定的参考作用。In the actual application of the Kafka,the system load is often unbalanced due to improper partitioning strategy selection,which results the nodes go offline and affects business work.In order to solve the problem,this paper focus on the changes of consumption rate and CPU utilization rate,studied and analyzed the influence of RangeAssignor,RoundRobinAssignor and StickyAssignor on system overhead and system stability when Kafka applied,and summarized the characteristics of the three partition strategies.This paper offers a reference for the selection and usage of partition strategy in the actual application of Kafka.

关 键 词：分布式消息系统 Kafka 分区策略 系统开销 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]