基于深度强化学习的电力物联网动态切片策略研究  

Dynamic Slicing Strategy for Power Internet of Things Based onDeep Reinforcement Learning

作　　者：辛锐 吴军英 薛冰 张鹏飞 李艳军 柴守亮 王佳楠 XIN Rui;WU Junying;XUE Bing;ZHANG Pengfei;LI Yanjun;CHAI Shouliang;WANG Jianan(ICT Branch,State Grid Hebei Electric Power Co.,Ltd.,Shijiazhuang 050021,China;Guangzhou Institute of Technology,Xidian University,Guangzhou 510555,China;Handan Branch,State Grid Hebei Electric Power Co.,Ltd.,Handan 056035,China;Beijing China-Power Information Technology Co.,Ltd.,Beijing 100085,China)

机构地区：[1]国网河北省电力有限公司信息通信分公司,河北石家庄050021 [2]西安电子科技大学广州研究院,广东广州510555 [3]国网河北省电力有限公司邯郸供电分公司,河北邯郸056035 [4]北京中电普华信息技术有限公司,北京100085

出　　处：《无线电工程》2024年第6期1380-1387,共8页Radio Engineering

基　　金：河北省省级科技计划资助(22310302D)。

摘　　要：软件定义电力物联网支持构建承载不同业务的网络切片(Network Slice,NS),通过部署NS为具有业务需求的物联网设备提供端到端服务。业务NS的部署涉及2个互相耦合的问题,即虚拟网络功能(Virtual Network Function,VNF)部署和业务传输路由确定。在海量业务需求与动态网络场景中,NS部署方案需要根据网络状态,实现智能的动态灵活部署。针对上述问题,研究动态网络场景下的切片策略,基于深度强化学习算法求解VNF部署和业务传输路由确定这一复杂联合优化问题,实验证明所提策略能根据目前的网络状态灵活地改变部署方案,控制业务路由平均能量损耗、平均可靠性和平均剩余带宽占有率,提高了网络整体传输性能。Software-defined power internet of things supports the construction of Network Slice(NS)that can carry different business requirements.By deploying NS,end-to-end services can be provided to internet of things devices with specific business demands.The deployment of business NS involves two interrelated issues,namely the deployment of Virtual Network Function(VNF)and the determination of business transmission routings.In dynamic network scenario with massive business requirements,NS deployment solutions need to achieve intelligent and dynamically flexible deployment based on the network status.To address the aforementioned problems,the slicing strategy in the dynamic network scenario is explored and the complex joint optimization problem of VNF deployment and business transmission routing determination is solved based on deep reinforcement learning algorithm.The experimental findings demonstrate that the proposed strategy effectively adjusts the deployment plan based on the current state,controls the average energy loss,average reliability,and average remaining bandwidth occupation of the service path,and improves the overall transmission performance of the network.

关 键 词：软件定义电力物联网 切片 虚拟网络功能 路由 深度强化学习 

分 类 号：TM73[电气工程—电力系统及自动化]