Mixed Reality in Visceral Surgery

Sauer, Igor M.; Queisner, Moritz; Tang, Peter; Moosburner, Simon; Hoepfner, Ole; Horner, Rosa; Lohmann, R; Pratschke, Johann

doi:10.1097/sla.0000000000002448

Cited by 108 publications

(62 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Multiple applications are necessary to integrate patient data into the HMDs. This process has been previously reported in detail . In short, we used Ziostation 2 (Ziosoft, Tokyo, Japan) to segment CT Images into a 3D model, and a proprietary viewer for the Microsoft HoloLens was created.…”

Section: Methodsmentioning

confidence: 99%

“…We have previously described our current workflow using the Microsoft HoloLens (Microsoft Corporation, Redmond, Washington, USA) HMD for visualizing patient specific anatomical structures. Through continued use, limitations, such as the field of view (FOV), display resolution, and processing power of the Microsoft HoloLens became apparent.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Real world usability analysis of two augmented reality headsets in visceral surgery

et al. 2019

Self Cite

View full text Add to dashboard Cite

Recent developments in the field of augmented reality (AR) have enabled new use cases in surgery. Initial set‐up of an appropriate infrastructure for maintaining an AR surgical workflow requires investment in appropriate hardware. We compared the usability of the Microsoft HoloLens and Meta 2 head mounted displays (HMDs). Fifteen medicine students tested each device and were questioned with a variant of the System Usability Scale (SUS). Two surgeons independently tested the devices in an intraoperative setting. In our adapted SUS, ergonomics, ease of use, and visual clarity of the display did not differ significantly between HMD groups. The field of view (FOV) was smaller in the Microsoft HoloLens than the Meta 2 and significantly more study subjects (80% vs. 13.3%; P < 0.001) felt limited through the FOV. Intraoperatively, decreased mobility due to the necessity of an AC adapter and additional computing device for the Meta 2 proved to be limiting. Object stability was rated superior in the Microsoft HoloLens than the Meta 2 by our surgeons and lead to increased use. In summary, after examination of the Meta 2 and the Microsoft HoloLens, we found key advantages in the Microsoft HoloLens which provided palpable benefits in a surgical setting.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Real world usability analysis of two augmented reality headsets in visceral surgery

et al. 2019

Self Cite

View full text Add to dashboard Cite

show abstract

“…Thus, identification of important vessels and anatomical markers surrounding the lesion can be improved by the assessment of enhanced CT/MRI image fusions before the operation, which is vital in reducing intraoperative bleeding and operation times and accelerating postoperative recovery. Queisner et al [179] conducted a series of clinical studies to evaluate the efficiency of contrast-enhanced CT/MRI image fusion technology in hepatectomy for different anatomical locations. Data from their study suggest that most preoperative surgical planning schemes based on image fusion are similar to the actual operative procedure conducted following the exploration of the liver.…”

Section: Surgical Operation Assistancementioning

confidence: 99%

Application of Image Fusion in Diagnosis and Treatment of Liver Cancer

Zhu

2020

Applied Sciences

View full text Add to dashboard Cite

With the accelerated development of medical imaging equipment and techniques, image fusion technology has been effectively applied for diagnosis, biopsy and radiofrequency ablation, especially for liver tumor. Tumor treatment relying on a single medical imaging modality might face challenges, due to the deep positioning of the lesions, operation history and the specific background conditions of the liver disease. Image fusion technology has been employed to address these challenges. Using the image fusion technology, one could obtain real-time anatomical imaging superimposed by functional images showing the same plane to facilitate the diagnosis and treatments of liver tumors. This paper presents a review of the key principles of image fusion technology, its application in tumor treatments, particularly in liver tumors, and concludes with a discussion of the limitations and prospects of the image fusion technology.

show abstract

“…In (19) the author presented the use of MR-HMD in the intestines' surgery by using surgical imaging, providing information to surgeons, and displaying display and tracking technology. Biomechanical modeling and object recognition algorithms will facilitate MR-HMD in bowel surgery through the conversion of X-ray into a three-dimensional model.…”

Section: Mixed Reality In Medical Fieldmentioning

confidence: 99%

Using Azure to construct recent architecture for visualize training in real-time

Mamdouh¹

2020

IJST

View full text Add to dashboard Cite

Background/Objectives: In recent years, visualization systems were not only entertainment but also essential in training in our various fields. They do not depend on fixed devices only. They use visual systems, such as the headmounted display that Microsoft developed as the Mixed Reality (MR) HoloLens. Its features are equipped with engines that allow the user to interact with the headset via oral orders to communicate remotely with specialists in the surgical field in real-life situations. The main objective of the study is to use the 3D anatomical information models, the Digital Imaging and Communications in Medicine (DICOM) file and all the patient's data, its registration on Azure cloud computing system, to obtain the necessary training and support in case of encountering any emergency before and during the surgical planning. Method: This study presents the application as divided into two stages of anatomical simulation: training for local and international trainees through MR. The first stage classified (DICOM) files to the 3D model using the machine learning and HoloLens emulator of anatomy operational structure. The second stage involves Microsoft Azure and stores on cloud network by Data Lake, Azure Cosmo DB, and utilization of the Azure Spatial Anchors service to access the trainee to locate it at any time through the ID that is displayed by the IoT Sensor. Finding: This study examines Mixed Reality technology, HoloLens, and Head Mount Display to show the expected potential results to improve the surgeon's actions in surgery. This examination finished by 3D displaying anatomical models because they allow the surgeon to access the best solutions in real-life situations during the process to assess the three-dimensional holograms related to patient imaging or surgical techniques.

show abstract

Mixed Reality in Visceral Surgery

Cited by 108 publications

References 11 publications

Real world usability analysis of two augmented reality headsets in visceral surgery

Real world usability analysis of two augmented reality headsets in visceral surgery

Application of Image Fusion in Diagnosis and Treatment of Liver Cancer

Using Azure to construct recent architecture for visualize training in real-time

Contact Info

Product

Resources

About