基于深度强化学习的风电柔直并网系统次同步振荡抑制方法  

Subsynchronous Oscillation Suppression Method for Flexible Direct Grid-Connected Wind Power System Based on Deep Reinforcement Learning

作　　者：戴礼国 杨浩 陈力 张敏 许祖峰 孙建萍 冯双[2] DAI Liguo;YANG Hao;CHEN Li;ZHANG Min;XU Zufeng;SUN Jianping;FENG Shuang(College of Software Engineering,Southeast University,Nanjing 211189,China;School of Electrical Engineering,Southeast University,Nanjing 210096,China;State Key Laboratory of Smart Grid Protection and Control,NARI Group Corporation,Nanjing 211106,China)

机构地区：[1]东南大学软件学院,江苏南京211189 [2]东南大学电气工程学院,江苏南京210096 [3]智能电网保护和运行控制国家重点实验室(南瑞集团)(国家电力科学研究院)有限公司,江苏南京211106

出　　处：《智慧电力》2023年第4期1-7,91,共8页Smart Power

基　　金：国家重点研发计划资助项目(2021YFB2400500)。

摘　　要：风电柔性直流换流站与风机交互导致的次同步振荡严重威胁电网安全稳定运行。深度强化学习算法可以有效地应对风电柔直并网系统多变的运行工况。提出了一种基于深度强化学习的振荡抑制方法。首先,基于柔直送端变流器的数学模型和机理,设计了系统的环境状态合集、可行动作集及奖励函数。为了应对所设计的环境状态合集中的电流变量及电压变量均为连续量带来的维数灾问题,继而采用深度确定性策略梯度算法进行可行动作集的动作决策探索。最后通过仿真系统在多变运行工况下对该方法的有效性和鲁棒性进行验证,仿真结果表明所提方法能够充分地适应海上风电柔直并网系统的多风速运行条件,并能在短时间内有效抑制振荡。The subsynchronous oscillation caused by the interaction between flexible direct converter station and wind farm threatens the safe and stable operation of power grid.Deep reinforcement learning can effectively cope with the variable operating conditions of wind power flexible direct grid-connected system.An oscillation suppression method based on deep reinforcement learning is proposed.Firstly,based on the mathematical model and mechanism of the flexible direct grid-connected system,the environmental state set,feasible action set and reward function of the system are designed.Then in order to cope with the dimension disasters caused by continuous current and voltage variables in the designed environment state aggregation,the deep deterministic strategy gradient algorithm is used to explore the action decision.Finally,the effectiveness and robustness of the proposed method are verified in the simulation system under multiple operating conditions.The simulation results show that the proposed method can fully adapt to the multi-wind speed operating conditions of flexible direct grid-connected system of offshore wind power,and can effectively suppress the oscillation in a short time.

关 键 词：风电场 柔性直流输电 次同步振荡 强化学习 深度确定性策略梯度 振荡抑制 

分 类 号：TM732[电气工程—电力系统及自动化]