Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power

Conference contribution
(Conference Contribution)


Publication Details

Author(s): Ebell N, Heinrich F, Schlund J, Pruckner M
Publication year: 2018
Conference Proceedings Title: 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)
Pages range: 1-6
ISBN: 978-1-5386-7954-8
Language: English


Abstract

Rooftop-installed photovoltaic systems for residential buildings with battery energy storage system are increasing. Controlling power flows of volatile and unpredictable renewable energy sources in such a system is challenging. Therefore, in this paper we present an algorithm based on Reinforcement Learning to control the power flows of a residential household with a battery energy storage system and a photovoltaic system using neural networks as a function approximation. In a nondeterministic environment the optimal choice of a series of actions to be taken is complex. Training a Reinforcement Learning algorithm, these complex  patterns can be learned. The task of the energy storage is to reduce the energy feedin to the electric grid as well as to improve power system stability by providing frequency containment reserve power to the transmission system operator. Our model includes the profiles of the grid’s frequency, photovoltaic power generation and the electric load of two different households for one year. The first household is used to train the algorithm and to adjust the weights of the neural network to estimate the state-action values. The second household is used to test the functionality of the algorithm on unseen data. To evaluate the behavior of the Reinforcement Learning algorithm the results are compared to a simulation of rule-based control. As a result, after 300 episodes of training, the algorithm is able to reduce the energy consumption from the grid up to 7:8% compared to the rule-based control system managing the system’s power flows.


FAU Authors / FAU Editors

Ebell, Niklas
Computer Science 7 (Computer Networks and Communication Systems)
Pruckner, Marco Prof. Dr.-Ing.
Juniorprofessur für Energieinformatik
Schlund, Jonas
Computer Science 7 (Computer Networks and Communication Systems)


How to cite

APA:
Ebell, N., Heinrich, F., Schlund, J., & Pruckner, M. (2018). Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power. In 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) (pp. 1-6). Aalborg, DK.

MLA:
Ebell, Niklas, et al. "Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power." Proceedings of the 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), Aalborg 2018. 1-6.

BibTeX: 

Last updated on 2019-09-01 at 11:10