Zaiss M, Rajput JR, Dang HN, Golkov V, Cremers D, Knoll F, Maier A (2024)
Publication Type: Conference contribution
Publication year: 2024
Publisher: Springer Science and Business Media Deutschland GmbH
Pages Range: 94-99
Conference Proceedings Title: Informatik aktuell
Event location: Erlangen, DEU
ISBN: 9783658440367
DOI: 10.1007/978-3-658-44037-4_28
In this study, we explore the potential of generative pre-trained transformer (GPT), as a coding assistant for MRI sequence programming using the Pulseq framework. The programming of MRI sequences is traditionally a complex and time-consuming task, and the Pulseq standard has recently simplified this process. It allows researchers to define and generate complex pulse sequences used in MRI experiments. Leveraging GPT-4’s capabilities in natural language generation, we adapted it for MRI sequence programming, creating a specialized assistant named GPT4MR. Our tests involved generating various MRI sequences, revealing that GPT-4, guided by a tailored prompt, outperformed GPT-3.5, producing fewer errors and demonstrating improved reasoning. Despite limitations in handling complex sequences, GPT4MR corrected its own errors and successfully generated code with step-by-step instructions. The study showcases GPT4MR’s ability to accelerate MRI sequence development, even for novel ideas absent in its training set. While further research and improvement are needed to address complexity limitations, a well-designed prompt enhances performance. The findings propose GPT4MR as a valuable MRI sequence programming assistant, streamlining prototyping and development. The future prospect involves integrating a PyPulseq plugin into lightweight, open-source LLMs, potentially revolutionizing MRI sequence development and prototyping.
APA:
Zaiss, M., Rajput, J.R., Dang, H.N., Golkov, V., Cremers, D., Knoll, F., & Maier, A. (2024). Exploring GPT-4 as MR Sequence and Reconstruction Programming Assistant. In Andreas Maier, Thomas M. Deserno, Heinz Handels, Klaus Maier-Hein, Christoph Palm, Thomas Tolxdorff (Eds.), Informatik aktuell (pp. 94-99). Erlangen, DEU: Springer Science and Business Media Deutschland GmbH.
MLA:
Zaiss, Moritz, et al. "Exploring GPT-4 as MR Sequence and Reconstruction Programming Assistant." Proceedings of the German Conference on Medical Image Computing, BVM 2024, Erlangen, DEU Ed. Andreas Maier, Thomas M. Deserno, Heinz Handels, Klaus Maier-Hein, Christoph Palm, Thomas Tolxdorff, Springer Science and Business Media Deutschland GmbH, 2024. 94-99.
BibTeX: Download