Case‐specific three‐dimensional hologram with a mixed reality technique for tumor resection in otolaryngology

Abstract

Objective We report our first experience of using a case‐specific three‐dimensional (3D) hologram for tumor resection in otolaryngology to show the proof of concept. In addition, a questionnaire was administered to assess the usefulness of the mixed reality technique in otolaryngology. Methods A case‐specific 3D hologram was developed from enhanced images of dynamic computed tomography, with reference to contrast‐enhanced magnetic resonance images, and used for preoperative planning and intraoperative image reference. To evaluate the usefulness of the 3D hologram with head mount displays (HMDs), 18 attendings and resident otolaryngologists completed a questionnaire with the Likert scale. Results The case‐specific 3D hologram on HMDs was successfully used by means of easy gesture‐handling without any monitors preoperatively and intraoperatively. The experience of picturing the tumor localization and evaluating the surgical approach was statistically better using the 3D hologram on HMDs than using the computer images (P < .01). Similarly, the holograms were observed to be better for intraoperative application and surgical education than computer images (P < .01). Conclusion We demonstrated the use of a case‐specific 3D hologram for tumor resection in otolaryngology. The technology may be useful for preoperative planning and intraoperative image reference, especially for challenging cases, and surgical education. Level of Evidence NA.

XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis

“…Case-specific 3D holograms can provide young surgeons with a more precise image to understand surgical procedures in comparison to a surgery or anatomy textbook [128] (Figure 2A). Therefore, surgical simulation using case-specific 3D holograms can contribute to shortening the operative time and improving surgical safety.…”

Use of Extended Reality in Medical Education: An Integrative Review

“…Mitani et al (2021) developed 3D holograms in otolaryngological tumor resection with a mixed reality technique for attending and resident otolaryngologists to view on HMDs [ 75 ]. The use of the 3D holograms on HMDs was reported to be more beneficial than the radiological images displayed on a computer screen.…”

Advances and Innovations in Ablative Head and Neck Oncologic Surgery Using Mixed Reality Technologies in Personalized Medicine

“…However, there is still a need for a digital interface between tomographic examination and spatial imaging for surgical planning. MR technology, as a multimodal interactive image analysis platform, can create digital patient-specific 3D holographic models with high precision from multimodal image data [ 35 , 36 ]. Thus, by integrating segmented datasets, 3D visualization of tumor extent and clearance distance has the potential to provide better information on resectability or postoperative functional limitations.…”

“…Mixed reality technology can be helpful as a visual interface between tomographic examination and spatial representation for surgical planning. It provides radiologists and surgeons with a multimodal interactive user interface for data processing and an efficient way to navigate through tomographic data, enabling surgical planning tailored to the patient [ 34 , 35 , 36 ]. Combined with mixed reality technology, digital patient-specific models can be created with high precision, enabling individualized treatment planning [ 37 ].…”