On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial

Sebastian Andress; Alex Johnson M.D.; Mathias Unberath; Alexander F. Winkler; Kevin Yu; Javad Fotouhi; Simon Weidert M.D.; Greg M. Osgood M.D.; Nassir Navab

doi:10.1117/1.JMI.5.2.021209

26 January 2018 On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial

Sebastian Andress, Alex Johnson M.D., Mathias Unberath, Alexander F. Winkler, Kevin Yu, Javad Fotouhi, Simon Weidert M.D., Greg M. Osgood M.D., Nassir Navab

Author Affiliations +

Journal of Medical Imaging, Vol. 5, Issue 2, 021209 (January 2018). https://doi.org/10.1117/1.JMI.5.2.021209

Abstract

Fluoroscopic x-ray guidance is a cornerstone for percutaneous orthopedic surgical procedures. However, two-dimensional (2-D) observations of the three-dimensional (3-D) anatomy suffer from the effects of projective simplification. Consequently, many x-ray images from various orientations need to be acquired for the surgeon to accurately assess the spatial relations between the patient’s anatomy and the surgical tools. We present an on-the-fly surgical support system that provides guidance using augmented reality and can be used in quasiunprepared operating rooms. The proposed system builds upon a multimodality marker and simultaneous localization and mapping technique to cocalibrate an optical see-through head mounted display to a C-arm fluoroscopy system. Then, annotations on the 2-D x-ray images can be rendered as virtual objects in 3-D providing surgical guidance. We quantitatively evaluate the components of the proposed system and, finally, design a feasibility study on a semianthropomorphic phantom. The accuracy of our system was comparable to the traditional image-guided technique while substantially reducing the number of acquired x-ray images as well as procedure time. Our promising results encourage further research on the interaction between virtual and real objects that we believe will directly benefit the proposed method. Further, we would like to explore the capabilities of our on-the-fly augmented reality support system in a larger study directed toward common orthopedic interventions.

Citation Download Citation

Sebastian Andress, Alex Johnson M.D., Mathias Unberath, Alexander F. Winkler, Kevin Yu, Javad Fotouhi, Simon Weidert M.D., Greg M. Osgood M.D., and Nassir Navab "On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial," Journal of Medical Imaging 5(2), 021209 (26 January 2018). https://doi.org/10.1117/1.JMI.5.2.021209

Received: 15 September 2017; Accepted: 4 January 2018; Published: 26 January 2018

ACCESS THE FULL ARTICLE

JOURNAL ARTICLE
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY