HoloLens 1 vs. HoloLens 2: Improvements in the New Model for Orthopedic Oncological Interventions

Pose-Díez-de-la-Lastra, Alicia; Moreta-Martínez, Rafael; García-Sevilla, Mónica; García-Mato, David; Calvo-Haro, José Antonio; Mediavilla-Santos, Lydia; Pérez-Mañanes, Rubén; Haxthausen, Felix von; Pascau, Javier

doi:10.3390/s22134915

Cited by 26 publications

(26 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The MR device used was HoloLens 2 (Microsoft), an untethered, head-mounted device that permits users to view 3D holographic images as part of their surrounding environment Figure 1…”

Section: Methodsmentioning

confidence: 99%

Effect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment

Lawson,

Martin,

Guha

et al. 2023

JAMA Netw Open

View full text Add to dashboard Cite

ImportanceMixed-reality (MR) technology has the potential to enhance care delivery, but there remains a paucity of evidence for its efficacy and feasibility.ObjectiveTo assess the efficacy and feasibility of MR technology to enhance emergency care delivery in a simulated environment.Design, Setting, and ParticipantsThis pilot randomized crossover trial was conducted from September to November 2021 at a single center in a high-fidelity simulated environment with participants block randomized to standard care (SC) or MR-supported care (MR-SC) groups. Participants were 22 resident-grade physicians working in acute medical and surgical specialties prospectively recruited from a single UK Academic Health Sciences Centre. Data were analyzed from September to December 2022.InterventionParticipants resuscitated a simulated patient who was acutely unwell, including undertaking invasive procedures. Participants completed 2 scenarios and were randomly assigned to SC or MR-SC for the first scenario prior to crossover. The HoloLens 2 MR device provided interactive holographic content and bidirectional audiovisual communication with senior physicians in the MR-SC group.Main Outcomes and MeasuresThe primary outcome was error rate assessed via the Imperial College Error Capture (ICECAP) multidimensional error-capture tool. Secondary outcomes included teamwork (Observational Teamwork Assessment for Surgery [OTAS]; range, 0-6 and Teamwork Skills Assessment for Ward Care [T-SAW-C]; range, 1-5), scenario completion, stress and cognitive load (NASA Task Load Index [NASA-TLX; range 0-100]), and MR device user acceptability.ResultsA total of 22 physicians (15 males [68.2%]; median [range] age, 28 [25-34] years) were recruited. MR technology significantly reduced the mean (SD) number of errors per scenario compared with SC (5.16 [3.34] vs 8.30 [3.09] errors; P = .003), with substantial reductions in procedural (0.79 [0.75] vs 1.52 [1.20] errors; P = .02), technical (1.95 [1.40] vs 3.65 [2.03] errors; P = .01), and safety (0.37 [0.96] vs 0.96 [0.85] errors; P = .04) domains. MR resulted in significantly greater scenario completion rates vs SC (22 scenarios [100%] vs 14 scenarios [63.6%]; P = .003). It also led to significant improvements in the overall quality of teamwork and interactions vs SC as measured by mean (SD) OTAS (25.41 [6.30] vs 16.33 [5.49]; P &lt; .001) and T-SAW-C (27.35 [6.89] vs 18.37 [6.09]; P &lt; .001) scores. As reported via mean (range) NASA-TLX score, there were significant reductions for MR-SC vs SC in participant temporal demands (38 [20-50] vs 46 [30-70]; P = .03) and significant improvements in self-reported task performance (50 [30-60] vs 39 [10-70]; P = .01). Overall, 19 participants (86.4%) reported that they were more confident in making clinical decisions and undertaking clinical procedures with MR support.Conclusions and RelevanceThis study found that the use of MR technology reduced error, improved teamwork, and enhanced practitioner confidence when used to support the delivery of simulated emergency medical care.Trial RegistrationClinicalTrials.gov Identifier: NCT05870137

show abstract

“…The MR device used was HoloLens 2 (Microsoft), an untethered, head-mounted device that permits users to view 3D holographic images as part of their surrounding environment Figure 1…”

Section: Methodsmentioning

confidence: 99%

Effect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment

Lawson,

Martin,

Guha

et al. 2023

JAMA Netw Open

View full text Add to dashboard Cite

show abstract

“…Furthermore, in order to further improve the authenticity of virtual surgery, some input devices shaped like scalpel, tweezer, vascular clamp and so on can be well-designed for specific application [44,45]. With the continuous upgrade of hardware, the advanced equipment for augmented reality or mixed reality like Microsoft HoloLens with gesture tracking will further improve the effect of virtual surgery [46][47][48].…”

Section: Conclusion and Further Perspectivementioning

confidence: 99%

A virtual surgical prototype system based on gesture recognition for virtual surgical training in maxillofacial surgery

et al. 2022

View full text Add to dashboard Cite

Background Virtual reality (VR) technology is an ideal alternative of operation training and surgical teaching. However, virtual surgery is usually carried out using the mouse or data gloves, which affects the authenticity of virtual operation. A virtual surgery system with gesture recognition and real-time image feedback was explored to realize more authentic immersion. Method Gesture recognition technology proposed with an efficient and real-time algorithm and high fidelity was explored. The recognition of hand contour, palm and fingertip was firstly realized by hand data extraction. Then, an Support Vector Machine classifier was utilized to classify and recognize common gestures after extraction of feature recognition. The algorithm of collision detection adopted Axis Aligned Bounding Box binary tree to build hand and scalpel collision models. What’s more, nominal radius theorem (NRT) and separating axis theorem (SAT) were applied for speeding up collision detection. Based on the maxillofacial virtual surgical system we proposed before, the feasibility of integration of the above technologies in this prototype system was evaluated. Results Ten kinds of signal static gestures were designed to test gesture recognition algorithms. The accuracy of gestures recognition is more than 80%, some of which were over 90%. The generation speed of collision detection model met the software requirements with the method of NRT and SAT. The response time of gesture] recognition was less than 40 ms, namely the speed of hand gesture recognition system was greater than 25 Hz. On the condition of integration of hand gesture recognition, typical virtual surgical procedures including grabbing a scalpel, puncture site selection, virtual puncture operation and incision were carried out with realization of real-time image feedback. Conclusion Based on the previous maxillofacial virtual surgical system that consisted of VR, triangular mesh collision detection and maxillofacial biomechanical model construction, the integration of hand gesture recognition was a feasible method to improve the interactivity and immersion of virtual surgical operation training.

show abstract

“…An AR system provides physicians additional information both during and before the procedures. However, AR systems often have relatively limited physician control, oftentimes due to the nature of integrating AR technology with currently used systems [2]. Differences in user interfaces (UI) have been shown to have a greater impact on task completion than headset type [3,4].…”

Section: Introductionmentioning

confidence: 99%

An advanced system with advanced user interfaces for image-guided intervention applications

Bettati¹,

Fei

2023

Medical Imaging 2023: Image-Guided Procedures, Robotic Interventions, and Modeling

View full text Add to dashboard Cite

Augmented Reality (AR) is becoming a more common addition to physicians’ repertoire for aiding in resident training and patient interactions. However, the use of augmented reality in clinical settings is still beset with many complications, including the lack of physician control over the systems, set modes of interactions within the system, and physician’s lack of familiarity with such AR systems. In this paper, we plan to expand on our previous prostate biopsy AR system by adding in improved user interface systems within the virtual world in order to allow the user to more accurately visualize only parts of the system which they consider to be useful at that time. To accomplish this, we have incorporated three-dimensional virtual sliders built from the ground up, using Unity to afford control over each model’s RGB values, as well as their transparency. This means that the user would be able to fully edit the color, and transparency of each individual model in real time as they see fit quickly and easily while still being immersed in the augmented space. This would allow users to view internal holograms while not sacrificing the capability to view the external structure. Such leeway could be invaluable when visualizing a tumor within a prostate and would provide the physician with the capability to view as much or as little of the surrounded virtual models as desired, while providing the option to reinstate the surrounding models at will. The AR system can provide a new approach for potential uses in image-guided interventions including targeted biopsy of the prostate.

show abstract

HoloLens 1 vs. HoloLens 2: Improvements in the New Model for Orthopedic Oncological Interventions

Cited by 26 publications

References 31 publications

Effect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment

Effect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment

A virtual surgical prototype system based on gesture recognition for virtual surgical training in maxillofacial surgery

An advanced system with advanced user interfaces for image-guided intervention applications

Contact Info

Product

Resources

About