Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power

Ebell N, Heinrich F, Schlund J, Pruckner M (2018)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2018

Pages Range: 1-6

Conference Proceedings Title: 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)

Event location: Aalborg DK

ISBN: 978-1-5386-7954-8

DOI: 10.1109/SmartGridComm.2018.8587480

Abstract

Rooftop-installed photovoltaic systems for residential buildings with battery energy storage system are increasing. Controlling power flows of volatile and unpredictable renewable energy sources in such a system is challenging. Therefore, in this paper we present an algorithm based on Reinforcement Learning to control the power flows of a residential household with a battery energy storage system and a photovoltaic system using neural networks as a function approximation. In a nondeterministic environment the optimal choice of a series of actions to be taken is complex. Training a Reinforcement Learning algorithm, these complex  patterns can be learned. The task of the energy storage is to reduce the energy feedin to the electric grid as well as to improve power system stability by providing frequency containment reserve power to the transmission system operator. Our model includes the profiles of the grid’s frequency, photovoltaic power generation and the electric load of two different households for one year. The first household is used to train the algorithm and to adjust the weights of the neural network to estimate the state-action values. The second household is used to test the functionality of the algorithm on unseen data. To evaluate the behavior of the Reinforcement Learning algorithm the results are compared to a simulation of rule-based control. As a result, after 300 episodes of training, the algorithm is able to reduce the energy consumption from the grid up to 7:8% compared to the rule-based control system managing the system’s power flows.

Authors with CRIS profile

Niklas Ebell Computer Science 7 (Computer Networks and Communication Systems) Jonas Schlund Computer Science 7 (Computer Networks and Communication Systems) Marco Pruckner Juniorprofessur für Energieinformatik

Related research project(s)

Control of energy systems based on self-learning algorithms May 16, 2017 - May 16, 2020

How to cite

APA:

Ebell, N., Heinrich, F., Schlund, J., & Pruckner, M. (2018). Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power. In 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) (pp. 1-6). Aalborg, DK.

MLA:

Ebell, Niklas, et al. "Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power." Proceedings of the 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), Aalborg 2018. 1-6.

BibTeX: Download