摘要
With the growing integration of distributed energy resources(DERs),flexible loads,and other emerging technologies,there are increasing complexities and uncertainties for modern power and energy systems.This brings great challenges to the operation and control.Besides,with the deployment of advanced sensor and smart meters,a large number of data are generated,which brings opportunities for novel data-driven methods to deal with complicated operation and control issues.Among them,reinforcement learning(RL)is one of the most widely promoted methods for control and optimization problems.This paper provides a comprehensive literature review of RL in terms of basic ideas,various types of algorithms,and their applications in power and energy systems.The challenges and further works are also discussed.
基金
supported by the Sichuan Science and Technology Program(Sichuan Distinguished Young Scholars)(No.2020JDJQ0037).
作者简介
Di Cao is currently pursuing the Ph.D.degree in control science and engineering with University of Electronic Science and Technology of China,Chengdu,China.His research interests include optimization of distribution network and application of machine learning algorithms in power system.e-mail:caodi@std.uestc.edu.cn;Corresponding author:Weihao Hu received the B.Eng.and M.Sc.degrees in electrical engineering from Xi’an Jiaotong University,Xi’an,China,in 2004 and 2007,respectively,and the Ph.D.degree from Aalborg University,Aalborg,Denmark,in 2012.He is currently a Full Professor and the Director of the Institute of Smart Power and Energy Systems,University of Electronics Science and Technology of China,Chengdu,China.His research interests include artificial intelligence in modern power system and renewable power generation.e-mail:whu@uestc.edu.cn;Junbo Zhao received the Ph.D.degree from the Bradley Department of Electrical and Computer Engineering,Virginia Polytechnic Institute and State University,Falls Church,USA,in 2018.Now he is an Assistant Professor with Mississippi State University,Starkville,USA.His research interests include power system modeling,real-time monitoring,dynamics and cyber security,big data analytic,and robust statistical signal processing.e-mail:junbo@ece.msstate.edu;Guozhou Zhang received the B.S.degree from Chongqing University of Technology,Chongqing,China,in 2016,the M.S.degree from the University of Electronic Science and Technology of China,Chengdu,China,in 2019,where he is currently pursuing the Ph.D.degree in control science and engineering.His research interest includes power system analysis and control.e-mail:zgz@std.uestc.edu.cn;Bin Zhang received the B.S.degree from Hohai University,Nanjing,China,in 2017.He is currently pursuing the M.S.degree in University of Electronic Science and Technology of China,Chengdu,China.His research interest is optimization of hybrid energy system.e-mail:sven@uestc.edu.cn;Zhou Liu received the B.Eng.and M.Sc.degrees in electrical engineering from Huazhong University of Science and Technology(HUST),Wuhan,China,in 2004 and 2007,respectively,and the Ph.D.degree in energy technology from the Department of Energy Technology,Aalborg University,Aalborg,Denmark,in 2013.He is currently with the Department of Energy Technology,Aalborg University as an Assistant Professor.His research interests include power system analysis and digital simulation,wide-area protection and control,wind power integration and power substation automation,high-voltage direct current(HVDC)circuit breaker and protection.e-mail:zli@et.aau.dk;Zhe Chen received the B.Eng.and M.Sc.degrees from the Northeast China Institute of Electric Power Engineering,Jilin,China,and the Ph.D.degree from the University of Durham,Durham,UK.He is a Full Professor with the Department of Energy Technology,Aalborg University,Aalborg,Denmark.His research areas include power systems,power electronics and electric machines,and his main current research interests include wind energy and modern power systems.e-mail:zch@et.aau.dk;Frede Blaabjerg received the Ph.D.degree in electrical engineering from Aalborg University,Aalborg,Denmark,in 1995.He was with ABB-Scandia,Randers,Denmark,from 1987 to 1988.He became an Assistant Professor,in 1992,an Associate Professor in 1996,and a Full Professor of power electronics and drives in 1998.In 2017,he became a Villum Investigator.He is Honoris Causa at University Politehnica Timisoara,Timisoara,Romania,and Tallinn Technical University,Tallinn,Estonia.His current research interests include power electronics and its applications such as in wind turbines,PV systems,reliability,harmonics and adjustable speed drives.e-mail:fbl@et.aau.dk
