Exploring Visuo-Haptic augmented reality user interfaces for Stereo-tactic neurosurgery planning

Eck U, Stefan P, Laga H, Sandor C, Fallavollita P, Navab N (2016)


Publication Type: Conference contribution

Publication year: 2016

Journal

Publisher: Springer Verlag

Book Volume: 9805 LNCS

Pages Range: 208-220

Conference Proceedings Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Event location: Bern, CHE

ISBN: 9783319437743

DOI: 10.1007/978-3-319-43775-0_19

Abstract

Stereo-tactic neurosurgery planning is a time-consuming and complex task that requires detailed understanding of the patient anatomy and the affected regions in the brain to precisely deliver the treatment and to avoid proximity to any known risk structures. Traditional user interfaces for neurosurgery planning use keyboard and mouse for interaction and visualize the medical data on a screen. Previous research, however, has shown that 3D user interfaces are more intuitive for navigating volumetric data and enable users to understand spatial relations more quickly. Furthermore, new imaging modalities and automated segmentation of relevant structures provide important information to medical experts. However, displaying such information requires frequent context switches or occludes otherwise important information. In collaboration with medical experts, we analyzed the planning workflow for stereo-tactic neurosurgery interventions and identified two tasks in the process that can be improved: volume exploration and trajectory refinement. In this paper, we present a novel 3D user interface for neurosurgery planning that is implemented using a head-mounted display and a haptic device. The proposed system improves volume exploration with bi-manual interaction to control oblique slicing of volumetric data and reduces visual clutter with the help of haptic guides that enable users to precisely target regions of interest and to avoid proximity to known risk structures.

Involved external institutions

How to cite

APA:

Eck, U., Stefan, P., Laga, H., Sandor, C., Fallavollita, P., & Navab, N. (2016). Exploring Visuo-Haptic augmented reality user interfaces for Stereo-tactic neurosurgery planning. In Hongen Liao, Guoyan Zheng, Su-Lin Lee, Philippe Cattin, Pierre Jannin (Eds.), Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp. 208-220). Bern, CHE: Springer Verlag.

MLA:

Eck, Ulrich, et al. "Exploring Visuo-Haptic augmented reality user interfaces for Stereo-tactic neurosurgery planning." Proceedings of the 7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016, Bern, CHE Ed. Hongen Liao, Guoyan Zheng, Su-Lin Lee, Philippe Cattin, Pierre Jannin, Springer Verlag, 2016. 208-220.

BibTeX: Download