Dueling-DQN在空调节能控制中的应用  

Application of Dueling-DQN in Air Conditioning Control for Energy Saving

作　　者：李骏翔 李兆丰 杨赛赛 陶洪峰 姚辉 吴超 LEE Chun-Hsiang;LI Zhao-Feng;YANG Sai-Sai;TAO Hong-Feng;YAO Hui;WU Chao(Research Institute of Big Data,Zhejiang Post and Telecom Engineering Construction Co.Ltd.,Hangzhou 310052,China;School of Public Affairs,Zhejiang University,Hangzhou 310058,China)

机构地区：[1]浙江省邮电工程建设有限公司大数据研究院,杭州310052 [2]浙江大学公共管理学院,杭州310058

出　　处：《计算机系统应用》2021年第10期271-279,共9页Computer Systems & Applications

摘　　要：针对电信机房空调运行耗电量大,空调自动控制系统设计困难的问题,提出了一种规则约束和DuelingDQN算法相结合的空调节能控制方法.该方法能根据不同机房环境自适应学习建模,在保证机房室内温度在规定范围的前提下,节省空调耗电量.同时针对实际机房应用场景,设计节能控制算法中的状态,动作和奖励函数,并采用深度强化学习算法Dueling-DQN提高模型表达能力和学习效率.在电信机房实际验证结果表明:该控制方法与空调默认设定参数运行相比节能18.3%,并可以很方便推广到不同环境场景的机房环境中,为电信机房节能减排提供解决方案.To tackle the problems of large power consumption and intricate design of the automatic control system for air conditioning in a telecommunication room, this study proposes an energy-saving control method based on the DuelingDQN algorithm and rule constraint for mechanical control system design. With the ability to learn modeling adaptively according to the environments of different computer rooms, this method can save the power consumption of air conditioning while ensuring the indoor temperature in the specified range. Moreover, according to the actual application scenarios of computer rooms, the states, actions and reward functions of the energy-saving control algorithm are designed.Besides, a deep reinforcement learning algorithm Dueling-DQN is used to improve the model expression ability and learning efficiency. The results of actual verification in telecommunication rooms show that the control method can save energy by 18.3% compared with the air conditioning at default parameters. It can be easily extended to machines in different environmental scenarios to provide solutions for energy conservation and emission reduction of telecommunication rooms.

关 键 词：节能控制 Dueling-DQN 强化学习 机房空调调控 

分 类 号：TB657.2[一般工业技术—制冷工程] TN80[电子电信—信息与通信工程]