Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft HoloLens 1

Gu, Wenhao; Shah, Kinjal; Knopf, Jonathan; Navab, Nassir; Unberath, Mathias

doi:10.1080/21681163.2020.1835556

Cited by 24 publications

(30 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In Figure 8 , a breakdown of the 57 papers included in our survey is depicted based on their general surgical speciality. The majority of papers (

) focused on orthopedic applications, such as osteotomy [ 45 , 46 , 47 , 48 , 49 ] and K-wire placement [ 50 , 51 ], with the second largest (

) involving maxillofacial surgery procedures, such as tumor resection [ 52 ] and craniofacial fibrous dysplasia [ 53 , 54 ]. The prevalence of OST-HMD investigation in orthopedic and maxillofacial surgeries is likely due to the rigid nature of the relevant anatomy, the availability of consistent landmarks for registration and tracking, and the prevalence of commercially available surgical navigation suites.…”

Section: Resultsmentioning

confidence: 99%

Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery

2022

View full text Add to dashboard Cite

We conducted a systematic review of recent literature to understand the current challenges in the use of optical see-through head-mounted displays (OST-HMDs) for augmented reality (AR) assisted surgery. Using Google Scholar, 57 relevant articles from 1 January 2021 through 18 March 2022 were identified. Selected articles were then categorized based on a taxonomy that described the required components of an effective AR-based navigation system: data, processing, overlay, view, and validation. Our findings indicated a focus on orthopedic (n=20) and maxillofacial surgeries (n=8). For preoperative input data, computed tomography (CT) (n=34), and surface rendered models (n=39) were most commonly used to represent image information. Virtual content was commonly directly superimposed with the target site (n=47); this was achieved by surface tracking of fiducials (n=30), external tracking (n=16), or manual placement (n=11). Microsoft HoloLens devices (n=24 in 2021, n=7 in 2022) were the most frequently used OST-HMDs; gestures and/or voice (n=32) served as the preferred interaction paradigm. Though promising system accuracy in the order of 2–5 mm has been demonstrated in phantom models, several human factors and technical challenges—perception, ease of use, context, interaction, and occlusion—remain to be addressed prior to widespread adoption of OST-HMD led surgical navigation.

show abstract

“…In Figure 8 , a breakdown of the 57 papers included in our survey is depicted based on their general surgical speciality. The majority of papers (

) focused on orthopedic applications, such as osteotomy [ 45 , 46 , 47 , 48 , 49 ] and K-wire placement [ 50 , 51 ], with the second largest (

Section: Resultsmentioning

confidence: 99%

Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery

2022

View full text Add to dashboard Cite

show abstract

“…Gu et al [42] designed a marker-less image-based registration pipeline using HoloLens and built-in sensors-to guide glenoid drilling during the total shoulder arthroplasty (TSA) procedure-and performed a feasibility analysis. They evaluated the performance of inside-out image-based registration on the HoloLens using a short-throw Gu et al [42] designed a marker-less image-based registration pipeline using HoloLens and built-in sensors-to guide glenoid drilling during the total shoulder arthroplasty (TSA) procedure-and performed a feasibility analysis. They evaluated the performance of inside-out image-based registration on the HoloLens using a short-throw time-of-flight (ToF) camera and conducted a pilot study on its application to TSA.…”

Section: Medical and Surgical Aids And Systemsmentioning

confidence: 99%

Review of Microsoft HoloLens Applications over the Past Five Years

2021

View full text Add to dashboard Cite

Since Microsoft HoloLens first appeared in 2016, HoloLens has been used in various industries, over the past five years. This study aims to review academic papers on the applications of HoloLens in several industries. A review was performed to summarize the results of 44 papers (dated between January 2016 and December 2020) and to outline the research trends of applying HoloLens to different industries. This study determined that HoloLens is employed in medical and surgical aids and systems, medical education and simulation, industrial engineering, architecture, civil engineering and other engineering fields. The findings of this study contribute towards classifying the current uses of HoloLens in various industries and identifying the types of visualization techniques and functions.

show abstract

“…Thus, the Microsoft HoloLens may be used for numerous applications in entertainment, education, navigation, medicine, planning and product design. It may for instance be used for visual guidance during surgery (Gu et al 2020;Pratt et al 2018), for visualisation of city models and various types of city data (Zhang et al 2018) or for the visualisation of 3D objects embedded in the real world (Hockett and Ingleby 2016). Furthermore, the Microsoft HoloLens could be useful for the in-situ visualisation of virtual contents (e.g.…”

Section: Introductionmentioning

confidence: 99%

Efficient 3D Mapping and Modelling of Indoor Scenes with the Microsoft HoloLens: A Survey

Weinmann

Wursthorn

Weinmann

et al. 2021

PFG

View full text Add to dashboard Cite

The Microsoft HoloLens is a head-worn mobile augmented reality device. It allows a real-time 3D mapping of its direct environment and a self-localisation within the acquired 3D data. Both aspects are essential for robustly augmenting the local environment around the user with virtual contents and for the robust interaction of the user with virtual objects. Although not primarily designed as an indoor mapping device, the Microsoft HoloLens has a high potential for an efficient and comfortable mapping of both room-scale and building-scale indoor environments. In this paper, we provide a survey on the capabilities of the Microsoft HoloLens (Version 1) for the efficient 3D mapping and modelling of indoor scenes. More specifically, we focus on its capabilities regarding the localisation (in terms of pose estimation) within indoor environments and the spatial mapping of indoor environments. While the Microsoft HoloLens can certainly not compete in providing highly accurate 3D data like laser scanners, we demonstrate that the acquired data provides sufficient accuracy for a subsequent standard rule-based reconstruction of a semantically enriched and topologically correct model of an indoor scene from the acquired data. Furthermore, we provide a discussion with respect to the robustness of standard handcrafted geometric features extracted from data acquired with the Microsoft HoloLens and typically used for a subsequent learning-based semantic segmentation.

show abstract

Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft HoloLens 1

Cited by 24 publications

References 35 publications

Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery

Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery

Review of Microsoft HoloLens Applications over the Past Five Years

Efficient 3D Mapping and Modelling of Indoor Scenes with the Microsoft HoloLens: A Survey

Contact Info

Product

Resources

About