HoloNeedle: Augmented Reality Guidance System for Needle Placement Investigating the Advantages of Three-Dimensional Needle Shape Reconstruction

Lin, Michael A.; Siu, Alexa F.; Bae, Jung Hwa; Cutkosky, Mark R.; Daniel, Bruce L.

doi:10.1109/lra.2018.2863381

Cited by 23 publications

(26 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Projective AR approaches were used to project-specific navigation instructions on how to position and insert instruments [8,13]. Optical see-through AR solutions enabled the superposition of guidance information through semi-transparent displays [10] or AR glasses like the HoloLens [14].…”

Section: Related Workmentioning

confidence: 99%

HoloInjection: augmented reality support for CT‐guided spinal needle injections

Heinrich

Schwenderling

Becker

et al. 2019

Healthcare Technology Letters

View full text Add to dashboard Cite

The correct placement of needles is decisive for the success of many minimally-invasive interventions and therapies. These needle insertions are usually only guided by radiological imaging and can benefit from additional navigation support. Augmented reality (AR) is a promising tool to conveniently provide needed information and may thus overcome the limitations of existing approaches. To this end, a prototypical AR application was developed to guide the insertion of needles to spinal targets using the mixed reality glasses Microsoft HoloLens. The system's registration accuracy was attempted to measure and three guidance visualisation concepts were evaluated concerning achievable in-plane and out-of-plane needle orientation errors in a comparison study. Results suggested high registration accuracy and showed that the AR prototype is suitable for reducing out-of-plane orientation errors. Limitations, like comparatively high in-plane orientation errors, effects of the viewing position and missing image slices indicate potential for improvement that needs to be addressed before transferring the application to clinical trials.

show abstract

Section: Related Workmentioning

confidence: 99%

HoloInjection: augmented reality support for CT‐guided spinal needle injections

Heinrich

Schwenderling

Becker

et al. 2019

Healthcare Technology Letters

View full text Add to dashboard Cite

show abstract

“…Once the transformation is known, digitizing probes can be used to obtain fiducial or landmark positions and display holograms of pre-operative imaging data overlaid on the patient. Applications of this registration approach include real-time AR guidance for needle placement (Panel 2, adapted from Lin et al 2018 [45]) and real-time skeletal visualization during human movement (Panel 3, adapted from Debarba et al 2018 [49]). [25]), a user wearing a HoloLens (A) touched physical points on a 3D-printed head model (B) with an optically tracked pointer.…”

Section: Discussionmentioning

confidence: 99%

“…While the built-in SLAM and computer vision capabilities of 3D-AR devices are useful for many clinical applications, external tracking hardware is often required to improve the precision of spatial tracking and localization. For example, one study evaluated 3D-AR for guiding a flexible needle to a 2 cm phantom target [45] . Precise tracking and registration were important because the application required tracking the needle base, and small errors in needle tracking or headset registration would cause much larger errors in the display of the needle tip.…”

Section: External Tracking Hardwarementioning

confidence: 99%

See 1 more Smart Citation

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Andrews

Henry²,

Soriano³

et al. 2021

IEEE J. Transl. Eng. Health Med.

View full text Add to dashboard Cite

Many clinical procedures would benefit from direct and intuitive real-time visualization of anatomy, surgical plans, or other information crucial to the procedure. Three-dimensional augmented reality (3D-AR) is an emerging technology that has the potential to assist physicians with spatial reasoning during clinical interventions. The most intriguing applications of 3D-AR involve visualizations of anatomy or surgical plans that appear directly on the patient. However, commercially available 3D-AR devices have spatial localization errors that are too large for many clinical procedures. For this reason, a variety of approaches for improving 3D-AR registration accuracy have been explored. The focus of this review is on the methods, accuracy, and clinical applications of registering 3D-AR devices with the clinical environment. The works cited represent a variety of approaches for registering holograms to patients, including manual registration, computer vision-based registration, and registrations that incorporate external tracking systems. Evaluations of user accuracy when performing clinically relevant tasks suggest that accuracies of approximately 2 mm are feasible. 3D-AR device limitations due to the vergenceaccommodation conflict or other factors attributable to the headset hardware add on the order of 1.5 mm of error compared to conventional guidance. Continued improvements to 3D-AR hardware will decrease these sources of error.

show abstract

“…Breathing can be compensated by techniques such as simple respiratory gating 20 or high frequency jet ventilation under general anesthesia 21 . Soft tissue deformation can be compensated by deformable modeling 9 , and needle bending can be extrapolated using a shape sensing needle 22 . Further developments will incorporate some of these features prior to evaluation with live subjects.…”

Section: Discussionmentioning

confidence: 99%

Augmented reality improves procedural efficiency and reduces radiation dose for CT-guided lesion targeting: a phantom study using HoloLens 2

Park

Hunt

Nadolski

et al. 2020

Sci Rep

View full text Add to dashboard Cite

Out-of-plane lesions pose challenges for CT-guided interventions. Augmented reality (AR) headsets are capable to provide holographic 3D guidance to assist CT-guided targeting. A prospective trial was performed assessing CT-guided lesion targeting on an abdominal phantom with and without AR guidance using HoloLens 2. Eight operators performed a cumulative total of 86 needle passes. Total needle redirections, radiation dose, procedure time, and puncture rates of nontargeted lesions were compared with and without AR. Mean number of needle passes to reach the target reduced from 7.4 passes without AR to 3.4 passes with AR (p = 0.011). Mean CT dose index decreased from 28.7 mGy without AR to 16.9 mGy with AR (p = 0.009). Mean procedure time reduced from 8.93 min without AR to 4.42 min with AR (p = 0.027). Puncture rate of a nontargeted lesion decreased from 11.9% without AR (7/59 passes) to 0% with AR (0/27 passes). First needle passes were closer to the ideal target trajectory with AR versus without AR (4.6° vs 8.0° offset, respectively, p = 0.018). AR reduced variability and elevated the performance of all operators to the same level irrespective of prior clinical experience. AR guidance can provide significant improvements in procedural efficiency and radiation dose savings for targeting out-of-plane lesions.

show abstract

HoloNeedle: Augmented Reality Guidance System for Needle Placement Investigating the Advantages of Three-Dimensional Needle Shape Reconstruction

Cited by 23 publications

References 13 publications

HoloInjection: augmented reality support for CT‐guided spinal needle injections

HoloInjection: augmented reality support for CT‐guided spinal needle injections

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Augmented reality improves procedural efficiency and reduces radiation dose for CT-guided lesion targeting: a phantom study using HoloLens 2

Contact Info

Product

Resources

About