Cooperative Assistance in Robotic Surgery through Multi-Agent Reinforcement Learning
Scheikl PM, Gyenes B, Davitashvili T, Younis R, Schulze A, Mueller-Stich BP, Neumann G, Wagner M, Mathis-Ullrich F (2021)
Publication Type: Conference contribution
Publication year: 2021
Journal
Publisher: Institute of Electrical and Electronics Engineers Inc.
Pages Range: 1859-1864
Conference Proceedings Title: IEEE International Conference on Intelligent Robots and Systems
Event location: Prague, CZE
ISBN: 9781665417143
DOI: 10.1109/IROS51168.2021.9636193
Abstract
Cognitive cooperative assistance in robot-assisted surgery holds the potential to increase quality of care in minimally invasive interventions. Automation of surgical tasks promises to reduce the mental exertion and fatigue of surgeons. In this work, multi-agent reinforcement learning is demonstrated to be robust to the distribution shift introduced by pairing a learned policy with a human team member. Multi-agent policies are trained directly from images in simulation to control multiple instruments in a sub task of the minimally invasive removal of the gallbladder. These agents are evaluated individually and in cooperation with humans to demonstrate their suitability as autonomous assistants. Compared to human teams, the hybrid teams with artificial agents perform better considering completion time (44.4% to 71.2% shorter) as well as number of collisions (44.7% to 98.0% fewer). Path lengths, however, increase under control of an artificial agent (11.4% to 33.5% longer). A multi-agent formulation of the learning problem was favored over a single-agent formulation on this surgical sub task, due to the sequential learning of the two instruments. This approach may be extended to other tasks that are difficult to formulate within the standard reinforcement learning framework. Multi-agent reinforcement learning may shift the paradigm of cognitive robotic surgery towards seamless cooperation between surgeons and assistive technologies.
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Scheikl, P.M., Gyenes, B., Davitashvili, T., Younis, R., Schulze, A., Mueller-Stich, B.P.,... Mathis-Ullrich, F. (2021). Cooperative Assistance in Robotic Surgery through Multi-Agent Reinforcement Learning. In IEEE International Conference on Intelligent Robots and Systems (pp. 1859-1864). Prague, CZE: Institute of Electrical and Electronics Engineers Inc..
MLA:
Scheikl, Paul Maria, et al. "Cooperative Assistance in Robotic Surgery through Multi-Agent Reinforcement Learning." Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2021, Prague, CZE Institute of Electrical and Electronics Engineers Inc., 2021. 1859-1864.
BibTeX: Download