Intraoperative fusion of models and data for robust distance sensing

Briel M, Haide L, Weber T, Jungo A, Piccinelli N, Kronreif G, Mathis-Ullrich F, Tagliabue E (2026)

Publication Type: Journal article

Publication year: 2026

Journal

International Journal of Computer Assisted Radiology and Surgery Springer Verlag (Germany)

DOI: 10.1007/s11548-026-03615-1

Abstract

Purpose: Instrument-integrated optical sensors are gaining popularity in microsurgery due to their ability to provide accurate measurements of instrument-to-tissue distances, enabling precise instrument control. However, obstructions in the optical path can result in measurement errors. In this work, we propose a method to improve robustness of distance information from sensorized microsurgical instruments. Methods: Our pipeline integrates a rapid search algorithm to identify relevant neighboring data points, as well as geometric and non-geometric techniques to accurately model the local tissue structure. Additionally, we implement a fusion of measurement and model to identify and overcome disturbances, e.g., obstructions from surgical instruments or semantic segmentation errors. Results: Our simulation examines the effect of different modeling parameters and techniques on distance prediction, yielding a mean absolute error of less than 0.02 mm when using the local spline fit. Experiments in ex vivo human eyes show that our pipeline achieves up to 89 % error reduction when compared to sensor only. Conclusion: Our method improves the reliability of instrument-integrated optical sensors. This work could enable distance-based instrument control in challenging conditions, thereby enhancing surgical precision in delicate ophthalmic procedures. Our approach can be generalized to any surgery with sensorized instruments and beyond.

Authors with CRIS profile

Franziska Mathis-Ullrich Professur für Robotische Planung und Kognition in der Chirurgie

Involved external institutions

Universität Bern CH Switzerland (CH) University of Verona / Università degli Studi di Verona IT Italy (IT) Austrian Center for Medical Innovation and Technology (ACMIT) AT Austria (AT) Carl Zeiss AG DE Germany (DE) Karlsruhe Institute of Technology (KIT) DE Germany (DE)

How to cite

APA:

Briel, M., Haide, L., Weber, T., Jungo, A., Piccinelli, N., Kronreif, G.,... Tagliabue, E. (2026). Intraoperative fusion of models and data for robust distance sensing. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-026-03615-1

MLA:

Briel, Marius, et al. "Intraoperative fusion of models and data for robust distance sensing." International Journal of Computer Assisted Radiology and Surgery (2026).

BibTeX: Download