Bakakeu J, Baer S, Klos HH, Peschke J, Brossog M, Franke J (2021)
Publication Type: Book chapter / Article in edited volumes
Publication year: 2021
Publisher: Springer Science and Business Media Deutschland GmbH
Edited Volumes: Artificial Intelligence in Industry 4.0
Series: Studies in Computational Intelligence
City/Town: Cham
Book Volume: 928
Pages Range: 143-163
DOI: 10.1007/978-3-030-61045-6_11
This chapter proposes an artificial intelligence based solution for the efficient operation of a heterogeneous cluster of flexible manufacturing machines with energy generation and storage capabilities in an electricity micro-grid featuring a high volatility of electricity prices. The problem of finding the optimal control policy is first formulated as a game theoretic sequential decision making problem under uncertainty, where at every time step the uncertainty is characterized by future weather dependent energy prices, high demand fluctuation, as well as random unexpected disturbances on the factory floor. Because of the parallel interaction of the machines with the grid, the local viewpoints of an agent are non-stationary and non-Markovian. Therefore, traditional methods such as standard reinforcement learning approaches that learn a specialized policy for a single machine are not applicable. To address this problem, we propose a multi-agent actor-critic method that takes into account the policies of other participants to achieve explicit coordination between a large numbers of actors. We show the strength of our approach in mixed cooperative and competitive scenarios where different production machines were able to discover different coordination strategies in order to increase the energy efficiency of the whole factory floor.
APA:
Bakakeu, J., Baer, S., Klos, H.H., Peschke, J., Brossog, M., & Franke, J. (2021). Multi-Agent Reinforcement Learning for the Energy Optimization of Cyber-Physical Production Systems. In Alexiei Dingli, Foaad Haddod, Christina Klüver (Eds.), Artificial Intelligence in Industry 4.0. (pp. 143-163). Cham: Springer Science and Business Media Deutschland GmbH.
MLA:
Bakakeu, Jupiter, et al. "Multi-Agent Reinforcement Learning for the Energy Optimization of Cyber-Physical Production Systems." Artificial Intelligence in Industry 4.0. Ed. Alexiei Dingli, Foaad Haddod, Christina Klüver, Cham: Springer Science and Business Media Deutschland GmbH, 2021. 143-163.
BibTeX: Download