CONFERENCE PROCEEDINGS
Advanced Search
Home > Journals > J. Med. Imag. > Volume 10 > Issue 2 > Article
Open Access
1 March 2023 HoloLens augmented reality system for transperineal free-hand prostate procedures
Ming Li, Sherif Mehralivand, Sheng Xu, Nicole Varble, Ivane Bakhutashvili, Sandeep Gurram, Peter A. A. Pinto, Peter L. Choyke, Bradford J. Wood, Baris Turkbey
Author Affiliations +
Journal of Medical Imaging, Vol. 10, Issue 2, 025001 (March 2023). https://doi.org/10.1117/1.JMI.10.2.025001
Abstract

Purpose

An augmented reality (AR) system was developed to facilitate free-hand real-time needle guidance for transperineal prostate (TP) procedures and to overcome the limitations of a traditional guidance grid.

Approach

The HoloLens AR system enables the superimposition of annotated anatomy derived from preprocedural volumetric images onto a patient and addresses the most challenging part of free-hand TP procedures by providing real-time needle tip localization and needle depth visualization during insertion. The AR system accuracy, or the image overlay accuracy (n = 56), and needle targeting accuracy (n = 24) were evaluated within a 3D-printed phantom. Three operators each used a planned-path guidance method (n = 4) and free-hand guidance (n = 4) to guide needles into targets in a gel phantom. Placement error was recorded. The feasibility of the system was further evaluated by delivering soft tissue markers into tumors of an anthropomorphic pelvic phantom via the perineum.

Results

The image overlay error was 1.29 ± 0.57 mm, and needle targeting error was 2.13 ± 0.52 mm. The planned-path guidance placements showed similar error compared to the free-hand guidance (4.14 ± 1.08 mm versus 4.20 ± 1.08 mm, p = 0.90). The markers were successfully implanted either into or in close proximity to the target lesion.

Conclusions

The HoloLens AR system can provide accurate needle guidance for TP interventions. AR support for free-hand lesion targeting is feasible and may provide more flexibility than grid-based methods, due to the real-time 3D and immersive experience during free-hand TP procedures.
Published by SPIE
Citation Download Citation
Ming Li, Sherif Mehralivand, Sheng Xu, Nicole Varble, Ivane Bakhutashvili, Sandeep Gurram, Peter A. A. Pinto, Peter L. Choyke, Bradford J. Wood, and Baris Turkbey "HoloLens augmented reality system for transperineal free-hand prostate procedures," Journal of Medical Imaging 10(2), 025001 (1 March 2023). https://doi.org/10.1117/1.JMI.10.2.025001
Received: 16 May 2022; Accepted: 9 February 2023; Published: 1 March 2023
JOURNAL ARTICLE
 12 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Augmented reality
Prostate
Magnetic resonance imaging
Autoregressive models
Visualization
Cameras
Computed tomography
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top