Automatic view planning with multi-scale deep reinforcement learning agents
Alansary A, Le Folgoc L, Vaillant G, Oktay O, Li Y, Bai W, Passerat-Palmbach J, Guerrero R, Kamnitsas K, Hou B, Mcdonagh S, Glocker B, Kainz B, Rueckert D (2018)
Publication Type: Conference contribution
Publication year: 2018
Journal
Publisher: Springer Verlag
Book Volume: 11070 LNCS
Pages Range: 277-285
Conference Proceedings Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Event location: Granada, ESP
ISBN: 9783030009274
DOI: 10.1007/978-3-030-00928-1_32
Abstract
We propose a fully automatic method to find standardized view planes in 3D image acquisitions. Standard view images are important in clinical practice as they provide a means to perform biometric measurements from similar anatomical regions. These views are often constrained to the native orientation of a 3D image acquisition. Navigating through target anatomy to find the required view plane is tedious and operator-dependent. For this task, we employ a multi-scale reinforcement learning (RL) agent framework and extensively evaluate several Deep Q-Network (DQN) based strategies. RL enables a natural learning paradigm by interaction with the environment, which can be used to mimic experienced operators. We evaluate our results using the distance between the anatomical landmarks and detected planes, and the angles between their normal vector and target. The proposed algorithm is assessed on the mid-sagittal and anterior-posterior commissure planes of brain MRI, and the 4-chamber long-axis plane commonly used in cardiac MRI, achieving accuracy of 1.53 mm, 1.98 mm and 4.84 mm, respectively.
Authors with CRIS profile
Involved external institutions
United Kingdom (GB)How to cite
APA:
Alansary, A., Le Folgoc, L., Vaillant, G., Oktay, O., Li, Y., Bai, W.,... Rueckert, D. (2018). Automatic view planning with multi-scale deep reinforcement learning agents. In Julia A. Schnabel, Christos Davatzikos, Carlos Alberola-López, Gabor Fichtinger, Alejandro F. Frangi (Eds.), Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp. 277-285). Granada, ESP: Springer Verlag.
MLA:
Alansary, Amir, et al. "Automatic view planning with multi-scale deep reinforcement learning agents." Proceedings of the 21st International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2018, Granada, ESP Ed. Julia A. Schnabel, Christos Davatzikos, Carlos Alberola-López, Gabor Fichtinger, Alejandro F. Frangi, Springer Verlag, 2018. 277-285.
BibTeX: Download