Multi-task Localization and Segmentation for X-Ray Guided Planning in Knee Surgery

Kordon FJ, Fischer P, Privalov M, Swartman B, Schnetzke M, Franke J, Lasowski R, Maier A, Kunze H (2019)


Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2019

Publisher: Springer

City/Town: Cham

Pages Range: 622-630

Conference Proceedings Title: Medical Image Computing and Computer Assisted Intervention – MICCAI 2019

Event location: Shenzhen CN

ISBN: 978-3-030-32226-7

DOI: 10.1007/978-3-030-32226-7_69

Abstract

X-ray based measurement and guidance are commonly used tools in orthopaedic surgery to facilitate a minimally invasive workflow. Typically, a surgical planning is first performed using knowledge of bone morphology and anatomical landmarks. Information about bone location then serves as a prior for registration during overlay of the planning on intra-operative X-ray images. Performing these steps manually however is prone to intra-rater/inter-rater variability and increases task complexity for the surgeon. To remedy these issues, we propose an automatic framework for planning and subsequent overlay. We evaluate it on the example of femoral drill site planning for medial patellofemoral ligament reconstruction surgery. A deep multi-task stacked hourglass network is trained on 149 conventional lateral X-ray images to jointly localize two femoral landmarks, to predict a region of interest for the posterior femoral cortex tangent line, and to perform semantic segmentation of the femur, patella, tibia, and fibula with adaptive task complexity weighting. On 38 clinical test images the framework achieves a median localization error of 1.50 mm for the femoral drill site and mean IOU scores of 0.99, 0.97, 0.98, and 0.96 for the femur, patella, tibia, and fibula respectively. The demonstrated approach consistently performs surgical planning at expert-level precision without the need for manual correction.

Authors with CRIS profile

Additional Organisation(s)

Related research project(s)

Involved external institutions

How to cite

APA:

Kordon, F.J., Fischer, P., Privalov, M., Swartman, B., Schnetzke, M., Franke, J.,... Kunze, H. (2019). Multi-task Localization and Segmentation for X-Ray Guided Planning in Knee Surgery. In Shen D., Liu T., Peters T.M., Staib L.H., Essert C., Zhou S., Yap P.-T., Khan A. (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 (pp. 622-630). Shenzhen, CN: Cham: Springer.

MLA:

Kordon, Florian Johannes, et al. "Multi-task Localization and Segmentation for X-Ray Guided Planning in Knee Surgery." Proceedings of the 22nd International Conference on Medical Image Computing and Computer Assisted Intervention – MICCAI 2019, Shenzhen Ed. Shen D., Liu T., Peters T.M., Staib L.H., Essert C., Zhou S., Yap P.-T., Khan A., Cham: Springer, 2019. 622-630.

BibTeX: Download