基于Q Learning算法的区域配网业务路由分配方法研究  

Research on Route Allocation Method of Regional Distribution Network Service Based on Q Learning Algorithm

作　　者：赵志军 金军 ZHAO Zhi-jun;JIN Jun(State Grid Jiaxing Electric Power Supply Company,Jiaxing,Zhejiang 314000,China;Jiaxing Hengchuang Electric Power Group Co.Ltd.,Jiaxing,Zhejiang 314000,China)

机构地区：[1]国网浙江省电力有限公司嘉兴供电公司,浙江嘉兴314000 [2]嘉兴恒创电力集团有限公司,浙江嘉兴314000

出　　处：《计算技术与自动化》2021年第1期104-108,共5页Computing Technology and Automation

摘　　要：传统的配网业务路由分配方法的链条占用率过高,导致丢包率较大。为此,设计了基于Q Learning算法的区域配网业务路由分配方法。按照传统分类方式划分业务路由中的性能指标,根据路由约束条件计算指标的约束值,从而确定业务路由的最优传输路径。结合Bellman Equation方法不断计算并更新配网中的Q值,再综合节点和网络业务指标,利用Q Learning算法计算得到区域配网中的风险均衡度。不断变换VNFs的路由顺序将其转换为TSP路由问题,最终得到路由分配矩阵,实现区域配网业务路由的分配。实验结果表明:与传统分配方法相比,基于Q Learning算法的分配方法的链条占用率低,有效减小了业务数据转发过程的丢包率。The traditional routing distribution method of distribution network has a high chain occupancy rate,which leads to a high packet loss rate.This study designed a routing distribution method for regional distribution network based on Q Learning algorithm.According to the traditional classification method,the performance index of the service route is divided,and the constraint value of the index is calculated according to the route constraint conditions,so as to determine the optimal transmission path of the service route.The Bellman Equation method is used to calculate and update the Q value in the distribution network,and then the node and network service indexes are integrated to calculate the risk equilibrium degree in the regional distribution network.The routing order of VNFs is constantly changed into TSP routing problem,and finally the routing distribution matrix is obtained to realize the routing distribution of regional distribution network.The experimental results show that compared with the traditional distribution method,the distribution method based on Q Learning algorithm has a low chain occupancy rate and effectively reduces the packet loss rate in the process of forwarding business data.

关 键 词：Q Learning算法 业务路由 Bellman Equation方法 最优传输路径 风险均衡度 路由分配 

分 类 号：TN915[电子电信—通信与信息系统]