Deep reinforcement learning for wind and energy storage coordination in wholesale energy and ancillary service markets  

作　　者：Jinhao Li Changlong Wang Hao Wang 

机构地区：[1]Department of Data Science and AI,Faculty of Information Technology,Monash University,Melbourne,Victoria,Australia [2]Department of Civil Engineering,Monash University,Melbourne,Victoria,Australia [3]Monash Energy Institute,Monash University,Melbourne,Victoria,Australia

出　　处：《Energy and AI》2023年第4期371-382,共12页能源与人工智能（英文）

基　　金：This work has been supported in part by the FIT Academic Funding of Monash University,Australia and the Australian Research Council(ARC)Discovery Early Career Researcher Award(DECRA)under Grant DE230100046.

摘　　要：Wind energy has been increasingly adopted to mitigate climate change.However,the variability of wind energy causes wind curtailment,resulting in considerable economic losses for wind farm owners.Wind curtailment can be reduced using battery energy storage systems(BESS)as onsite backup sources.Yet,this auxiliary role may significantly weaken the economic potential of BESS in energy trading.Ideal BESS scheduling should balance onsite wind curtailment reduction and market bidding,but practical implementation is challenging due to coordination complexity and the stochastic nature of energy prices and wind generation.We investigate the joint-market bidding strategy of a co-located wind-battery system in the spot and Regulation Frequency Control Ancillary Service markets.We propose a novel deep reinforcement learning-based approach that decouples the system’s market participation into two related Markov decision processes for each facility,enabling the BESS to absorb onsite wind curtailment while performing joint-market bidding to maximize overall operational revenues.Using realistic wind farm data,we validated the coordinated bidding strategy,with outcomes surpassing the optimization-based benchmark in terms of higher revenue by approximately 25%and more wind curtailment reduction by 2.3 times.Our results show that joint-market bidding can significantly improve the financial performance of wind-battery systems compared to participating in each market separately.Simulations also show that using curtailed wind generation as a power source for charging the BESS can lead to additional financial gains.The successful implementation of our algorithm would encourage co-location of generation and storage assets to unlock wider system benefits.

关 键 词：Wind-battery system Wind curtailment Electricity market Deep reinforcement learning 

分 类 号：F41[经济管理—产业经济]