Surgical scene generation and adversarial networks for physics-based iOCT synthesis

Sommersperger M, Martin-Gomez A, Mach K, Gehlbach PL, Nasseri MA, Iordachita I, Navab N (2022)

Publication Type: Journal article

Publication year: 2022

Journal

Biomedical Optics Express Optical Society of America

Book Volume: 13

Pages Range: 2414-2430

Journal Issue: 4

DOI: 10.1364/BOE.454286

Abstract

The development and integration of intraoperative optical coherence tomography (iOCT) into modern operating rooms has motivated novel procedures directed at improving the outcome of ophthalmic surgeries. Although computer-assisted algorithms could further advance such interventions, the limited availability and accessibility of iOCT systems constrains the generation of dedicated data sets. This paper introduces a novel framework combining a virtual setup and deep learning algorithms to generate synthetic iOCT data in a simulated environment. The virtual setup reproduces the geometry of retinal layers extracted from real data and allows the integration of virtual microsurgical instrument models. Our scene rendering approach extracts information from the environment and considers iOCT typical imaging artifacts to generate cross-sectional label maps, which in turn are used to synthesize iOCT B-scans via a generative adversarial network. In our experiments we investigate the similarity between real and synthetic images, show the relevance of using the generated data for image-guided interventions and demonstrate the potential of 3D iOCT data synthesis.

Involved external institutions

Technische Universität München (TUM) DE Germany (DE) Johns Hopkins University (JHU) US United States (USA) (US) Klinikum rechts der Isar DE Germany (DE)

How to cite

APA:

Sommersperger, M., Martin-Gomez, A., Mach, K., Gehlbach, P.L., Nasseri, M.A., Iordachita, I., & Navab, N. (2022). Surgical scene generation and adversarial networks for physics-based iOCT synthesis. Biomedical Optics Express, 13(4), 2414-2430. https://doi.org/10.1364/BOE.454286

MLA:

Sommersperger, Michael, et al. "Surgical scene generation and adversarial networks for physics-based iOCT synthesis." Biomedical Optics Express 13.4 (2022): 2414-2430.

BibTeX: Download