Whole-Body Multi-Organ Segmentation Using Anatomical Attention

Liu C, Denzinger F, Folle L, Qiu J, Klein L, Maier J, Kachelrieb M, Lell M, Maier A (2023)

Publication Type: Conference contribution

Publication year: 2023

Journal

Publisher: IEEE Computer Society

Book Volume: 2023-April

Conference Proceedings Title: Proceedings - International Symposium on Biomedical Imaging

Event location: Cartagena, COL

ISBN: 9781665473583

DOI: 10.1109/ISBI53787.2023.10230529

Abstract

Automated multi-organ segmentation is an increasingly important field of research enabling a holistic assessment of the human body. Deep learning-based methods, which are increasingly potent at segmentation tasks, struggle to provide anatomy consistent results due to the highly diverse input data. This e.g. may lead to the prediction of the liver in the head region as the data-driven method is not aware of typical locations of these organs. In this work, we propose to use anatomical attention to circumvent this problem. We define it as distance maps with respect to anatomical landmarks. We also introduce a pipeline to enable the use of anatomical attention. In a first step, anatomical distance maps are extracted using a lightweight attention network. These attention distance maps are then fused with the image data to provide additional anatomical information for a segmentation network. In total, the proposed pipeline is leveraged for a whole-body multi-organ segmentation task of 14 organs. In our evaluation, conducted as an ablation study, the added anatomical attention leads to an average dice score of 60.2, compared to 53.2 of an attention U-Net and 41.8 of a vanilla U-Net. Furthermore, we achieved anatomically plausible predictions.

Authors with CRIS profile

Involved external institutions

Deutsches Krebsforschungszentrum (DKFZ) Germany (DE) Klinikum Nürnberg Germany (DE)

How to cite

APA:

Liu, C., Denzinger, F., Folle, L., Qiu, J., Klein, L., Maier, J.,... Maier, A. (2023). Whole-Body Multi-Organ Segmentation Using Anatomical Attention. In Proceedings - International Symposium on Biomedical Imaging. Cartagena, COL: IEEE Computer Society.

MLA:

Liu, Chang, et al. "Whole-Body Multi-Organ Segmentation Using Anatomical Attention." Proceedings of the 20th IEEE International Symposium on Biomedical Imaging, ISBI 2023, Cartagena, COL IEEE Computer Society, 2023.

BibTeX: Download