HoloLens augmented reality system for transperineal free-hand prostate procedures

Abstract

Purpose: An augmented reality (AR) system was developed to facilitate free-hand real-time needle guidance for transperineal prostate (TP) procedures and to overcome the limitations of a traditional guidance grid.Approach: The HoloLens AR system enables the superimposition of annotated anatomy derived from preprocedural volumetric images onto a patient and addresses the most challenging part of free-hand TP procedures by providing real-time needle tip localization and needle depth visualization during insertion. The AR system accuracy, or the image overlay accuracy (n ¼ 56), and needle targeting accuracy (n ¼ 24) were evaluated within a 3D-printed phantom. Three operators each used a planned-path guidance method (n ¼ 4) and free-hand guidance (n ¼ 4) to guide needles into targets in a gel phantom. Placement error was recorded. The feasibility of the system was further evaluated by delivering soft tissue markers into tumors of an anthropomorphic pelvic phantom via the perineum. Results:The image overlay error was 1.29 AE 0.57 mm, and needle targeting error was 2.13 AE 0.52 mm. The planned-path guidance placements showed similar error compared to the free-hand guidance (4.14 AE 1.08 mm versus 4.20 AE 1.08 mm, p ¼ 0.90). The markers were successfully implanted either into or in close proximity to the target lesion.Conclusions: The HoloLens AR system can provide accurate needle guidance for TP interventions. AR support for free-hand lesion targeting is feasible and may provide more flexibility than grid-based methods, due to the real-time 3D and immersive experience during free-hand TP procedures.

Virtual and augmented reality in biomedical engineering

“…As procedures are not limited to the above, to develop a state-of-the-art and to offer hints of future prospects, authors in [ 20 – 22 ] identify, catalog, and analyze series describing AR approaches tested in liver, prostate, and hip surgery.…”