Technical Note: PYRO-NN: Python reconstruction operators in neural networks

Syben-Leisner C, Michen M, Stimpel B, Seitz S, Ploner S, Maier A (2019)


Publication Type: Journal article, Original article

Publication year: 2019

Journal

Book Volume: 46

Pages Range: 5110-5115

Journal Issue: 11

URI: https://aapm.onlinelibrary.wiley.com/doi/abs/10.1002/mp.13753

DOI: 10.1002/mp.13753

Open Access Link: https://aapm.onlinelibrary.wiley.com/doi/abs/10.1002/mp.13753

Abstract

Purpose: Recently, several attempts were conducted to transfer deep learning to medical image reconstruction. An increasingly number of publications follow the concept of embedding the computed tomography (CT) reconstruction as a known operator into a neural network. However, most of the approaches presented lack an efficient CT reconstruction framework fully integrated into deep learning environments. As a result, many approaches use workarounds for mathematically unambiguously solvable problems. Methods: PYRO-NN is a generalized framework to embed known operators into the prevalent deep learning framework Tensorflow. The current status includes state-of-the-art parallel-, fan-, and cone-beam projectors, and back-projectors accelerated with CUDA provided as Tensorflow layers. On top, the framework provides a high-level Python API to conduct FBP and iterative reconstruction experiments with data from real CT systems. Results: The framework provides all necessary algorithms and tools to design end-to-end neural network pipelines with integrated CT reconstruction algorithms. The high-level Python API allows a simple use of the layers as known from Tensorflow. All algorithms and tools are referenced to a scientific publication and are compared to existing non-deep learning reconstruction frameworks. To demonstrate the capabilities of the layers, the framework comes with baseline experiments, which are described in the supplementary material. The framework is available as open-source software under the Apache 2.0 licence at https://github.com/csyben/PYRO-NN. Conclusions: PYRO-NN comes with the prevalent deep learning framework Tensorflow and allows to setup end-to-end trainable neural networks in the medical image reconstruction context. We believe that the framework will be a step toward reproducible research and give the medical physics community a toolkit to elevate medical image reconstruction with new deep learning techniques.

Authors with CRIS profile

How to cite

APA:

Syben-Leisner, C., Michen, M., Stimpel, B., Seitz, S., Ploner, S., & Maier, A. (2019). Technical Note: PYRO-NN: Python reconstruction operators in neural networks. Medical Physics, 46(11), 5110-5115. https://dx.doi.org/10.1002/mp.13753

MLA:

Syben-Leisner, Christopher, et al. "Technical Note: PYRO-NN: Python reconstruction operators in neural networks." Medical Physics 46.11 (2019): 5110-5115.

BibTeX: Download