A deep reinforcement learning algorithm for the power order optimization allocation of AGC in interconnected power grids

Lei Xi, Lipeng Zhou, Lang Liu, Dongliang Duan, Yanchun Xu, Liuqing Yang, Shouxiang Wang

Research output: Contribution to journalArticlepeer-review

Abstract

The integration of distributed generations (solar power, wind power), energy storage devices, and electric vehicles, causes unpredictable disturbances in power grids. It has become a top priority to coordinate the distributed generations, loads, and energy storages in order to better facilitate the utilization of new energy. Therefore, a novel algorithm based on deep reinforcement learning, namely the deep PDWoLF-PHC (policy dynamics based win or learn fast-policy hill climbing) network (DPDPN), is proposed to allocate power order among the various generators. The proposed algorithm combines the decision mechanism of reinforcement learning with the prediction mechanism of a deep neural network to obtain the optimal coordinated control for the source-grid-load. Consequently it solves the problem brought by stochastic disturbances and improves the utilization rate of new energy. Simulations are conducted with the case of the improved IEEE two-area and a case in the Guangdong power grid. Results show that the adaptability and control performance of the power system are improved using the proposed algorithm as compared with using other existing strategies.

Original languageEnglish (US)
Article number9056999
Pages (from-to)712-723
Number of pages12
JournalCSEE Journal of Power and Energy Systems
Volume6
Issue number3
DOIs
StatePublished - Sep 2020
Externally publishedYes

Bibliographical note

Funding Information:
Manuscript received August 9, 2019; revised March 3, 2020; accepted March 12, 2020. Date of online publication April 6, 2020; date of current version May 20, 2020. This work was supported in part by the National Natural Science Foundation of China under Grant No. 51707102. L. Xi, L. P. Zhou, and Y. C. Xu are with the College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China. L. Liu is with the State Grid Xianning Electric Power Supply Company, Xianning 437100, China. D. L. Duan is with the Department of Electrical and Computer Engineering, University of Wyoming, Laramie, WY, USA. L. Q. Yang is with the Department of Electrical and Computer Engineering, Colorado State University, Fort Collins, CO, USA. S. X. Wang (corresponding author, e-mail: sxwang@tju.edu.cn) is with the Key Laboratory of Smart Grid of Ministry of Education, Tianjin University, Tianjin 300072, China. DOI: 10.17775/CSEEJPES.2019.01840

Keywords

  • Automatic generation control
  • deep reinforcement learning
  • DPDPN
  • power order allocation

Fingerprint Dive into the research topics of 'A deep reinforcement learning algorithm for the power order optimization allocation of AGC in interconnected power grids'. Together they form a unique fingerprint.

Cite this