Zeineldin R, Mathis-Ullrich F (2024)
Publication Type: Conference contribution
Publication year: 2024
Publisher: Springer Science and Business Media Deutschland GmbH
Book Volume: 14669 LNCS
Pages Range: 24-34
Conference Proceedings Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Event location: Vancouver, BC, CAN
ISBN: 9783031761621
DOI: 10.1007/978-3-031-76163-8_3
Motivated by the need for advanced solutions in the segmentation and inpainting of glioma-affected brain regions in multi-modal magnetic resonance imaging (MRI), this study presents an integrated approach leveraging the strengths of ensemble learning with hybrid transformer models and convolutional neural networks (CNNs), alongside the innovative application of 3D Pix2Pix Generative Adversarial Network (GAN). Our methodology combines robust tumor segmentation capabilities, utilizing axial attention and transformer encoders for enhanced spatial relationship modeling, with the ability to synthesize biologically plausible brain tissue through 3D Pix2Pix GAN. This integrated approach addresses the BraTS 2023 cluster challenges by offering precise segmentation and realistic inpainting, tailored for diverse tumor types and sub-regions. The results demonstrate outstanding performance, evidenced by quantitative evaluations such as the Dice Similarity Coefficient (DSC), Hausdorff Distance (HD95) for segmentation, and Structural Similarity Index Measure (SSIM), Peak Signal-to-Noise Ratio (PSNR), and Mean-Square Error (MSE) for inpainting. Qualitative assessments further validate the high-quality, clinically relevant outputs. In conclusion, this study underscores the potential of combining advanced machine learning techniques for comprehensive brain tumor analysis, promising significant advancements in clinical decision-making and patient care within the realm of medical imaging.
APA:
Zeineldin, R., & Mathis-Ullrich, F. (2024). Ensemble Learning and 3D Pix2Pix for Comprehensive Brain Tumor Analysis in Multimodal MRI. In Ujjwal Baid, Sylwia Malec, Spyridon Bakas, Reuben Dorent, Monika Pytlarz, Alessandro Crimi, Ruisheng Su, Navodini Wijethilake (Eds.), Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp. 24-34). Vancouver, BC, CAN: Springer Science and Business Media Deutschland GmbH.
MLA:
Zeineldin, Ramy, and Franziska Mathis-Ullrich. "Ensemble Learning and 3D Pix2Pix for Comprehensive Brain Tumor Analysis in Multimodal MRI." Proceedings of the Challenge on Brain Tumor Segmentation, BraTS 2023, International Challenge on Cross-Modality Domain Adaptation for Medical Image Segmentation, CrossMoDA 2023, held in conjunction with the Medical Image Computing for Computer Assisted Intervention Conference, MICCAI 2023, Vancouver, BC, CAN Ed. Ujjwal Baid, Sylwia Malec, Spyridon Bakas, Reuben Dorent, Monika Pytlarz, Alessandro Crimi, Ruisheng Su, Navodini Wijethilake, Springer Science and Business Media Deutschland GmbH, 2024. 24-34.
BibTeX: Download