Deep Reinforcement Learning for Robotic Control in High-Dexterity Assembly Tasks - A Reward Curriculum Approach

Leyendecker L, Schmitz M, Zhou HA, Samsonov V, Rittstieg M, Lutticke D (2022)

Publication Type: Journal article

Publication year: 2022

Journal

International Journal of Semantic Computing World Scientific Publishing

Book Volume: 16

Pages Range: 381-402

Journal Issue: 03

DOI: 10.1142/S1793351X22430024

Abstract

For years, the fully-automated robotic assembly has been a highly sought-after technology in large-scale manufacturing. Yet it still struggles to find widespread implementation in industrial environments. Traditional programming has so far proven to be insufficient in providing the required flexibility and dexterity to solve complex assembly tasks. Research in robotic control using deep reinforcement learning (DRL) advances quickly, however, the transfer to real-world applications in industrial settings is lagging behind. In this study, we apply DRL for robotic motion control to a multi-body contact automotive assembly task. Our focus lies on optimizing the final performance on the real-world setup. We propose a reward-curriculum learning approach in combination with domain randomization to obtain both force-sensitivity and generalizability of the controller's performance. We train the agent exclusively in simulation and successfully perform the Sim-to-Real transfer. Finally, we evaluate the controller's performance and robustness on an industrial setup and reflect its adherence to the high standards of automotive production.

Authors with CRIS profile

Markus Schmitz Lehrstuhl für Wirtschaftsinformatik, insbesondere IT-Management

Involved external institutions

Fraunhofer-Institut für Produktionstechnologie (IPT) DE Germany (DE) Rheinisch-Westfälische Technische Hochschule (RWTH) Aachen DE Germany (DE) BMW AG - Bayerische Motoren Werke / BMW Group DE Germany (DE)

How to cite

APA:

Leyendecker, L., Schmitz, M., Zhou, H.A., Samsonov, V., Rittstieg, M., & Lutticke, D. (2022). Deep Reinforcement Learning for Robotic Control in High-Dexterity Assembly Tasks - A Reward Curriculum Approach. International Journal of Semantic Computing, 16(03), 381-402. https://dx.doi.org/10.1142/S1793351X22430024

MLA:

Leyendecker, Lars, et al. "Deep Reinforcement Learning for Robotic Control in High-Dexterity Assembly Tasks - A Reward Curriculum Approach." International Journal of Semantic Computing 16.03 (2022): 381-402.

BibTeX: Download