Intuitive, VR- and Gesture-based Physical Interaction with Virtual Commissioning Simulation Models

Metzner M, Krieg L, Krüger D, Ködel T, Franke J (2020)


Publication Type: Book chapter / Article in edited volumes

Publication year: 2020

Edited Volumes: Annals of Scientific Society for Assembly, Handling and Industrial Robotics

Pages Range: 11-20

ISBN: 9783662617540

DOI: 10.1007/978-3-662-61755-7_2

Abstract

To manage complexity in modern, highly automated production systems, functional simulation for logic validation, known as virtual commissioning, is an important enabler. However, established systems for virtual commissioning are highly specialized software, which are solely used by simulation experts. In this contribution, we present a system for intuitive, user-integrated virtual commissioning. Using virtual reality, we allow for a first person experience of the simulation at runtime. By implementing a stereo-camera-based hand tracking system, we facilitate intuitive manual interaction with the simulation, including physical manipulation. Furthermore, we also integrate common human-machine interfaces, like touch panels, which are directly streamed from the industrial controller, offering the operator comparable interaction experience as with the real system. We conduct a user study quantifying the intuitiveness of interaction for defined tasks of our system compared to a standard simulation setup.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Metzner, M., Krieg, L., Krüger, D., Ködel, T., & Franke, J. (2020). Intuitive, VR- and Gesture-based Physical Interaction with Virtual Commissioning Simulation Models. In Annals of Scientific Society for Assembly, Handling and Industrial Robotics. (pp. 11-20).

MLA:

Metzner, Maximilian, et al. "Intuitive, VR- and Gesture-based Physical Interaction with Virtual Commissioning Simulation Models." Annals of Scientific Society for Assembly, Handling and Industrial Robotics. 2020. 11-20.

BibTeX: Download