Use of Mixed Reality in Neuro-Oncology: A Single Centre Experience

Jain, Swati; Gao, Yujia; Yeo, Tseng Tsai; Ngiam, Kee Yuan

doi:10.3390/life13020398

Cited by 10 publications

(16 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This technology seeks to provide surgeons with detailed and continuous visualisation of the individual patient's anatomy during surgical procedures. MR technology has been applied in various surgical procedures to improve anatomy visualisation and dissection accuracy, including neurosurgery [11], venipuncture [12], hepatobiliary and transplant surgery [13], and craniomaxillofacial plastic surgery [14].…”

Section: Discussionmentioning

confidence: 99%

Case Report: Application of HoloLens for Intra-Operative Assessment of a Retrosternal Thyroid Goitre

Leong

Cheng

Lee

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

Thyroidectomy is a common surgical procedure performed to treat a myriad of thyroid pathologies. 2-19% of thyroidectomies involve a retrosternal goitre, which is an extension of thyroid tissue into the thoracic cavity. Resection of retrosternal goitres are more challenging that standard thyroidectomies and typically have higher complication rate of recurrent laryngeal nerve injury, hypoparathyroidism and post op bleeding. Goitres can be removed either via a transcervical approach, transthoracic approach or a combination of both. A transcervical approach is generally favoured. Direct visualisation of the lower poles of the goitre is challenging in such scenarios, making it difficult to confirm full removal of the goitre. Retrosternal goitres are usually evaluated and characterised with cross-sectional imaging such as a computed tomography (CT) scan, in order to estimate the size and location of the goitre. We demonstrate a mixed reality technique of visualising retrosternal goitres, involving projecting three-dimensional (3D) reconstruction of the CT scan onto the patient to directly visualise the size and location of the goitre. This guides surgeons in the removal of retrosternal goitres, with the aim to reduce complications and facilitate complete excision of the goitre. We believe that HoloLens2 is a novel new adjunct which will aid surgeons in future surgeries involving a retrosternal goitre.

show abstract

Section: Discussionmentioning

confidence: 99%

Case Report: Application of HoloLens for Intra-Operative Assessment of a Retrosternal Thyroid Goitre

Leong

Cheng

Lee

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…For the AR-related experience, the Microsoft HoloLens was worn by the primary user in the actual operating theatre. Details of its use in the adult neurosurgical operating theatre have been previously described in the literature [8,22]. Similar to the VR setup, the Ho-loLens is also a standalone system that is wirelessly connected to the cloud-based Holoeyes XR platform.…”

Section: Outline Of Trial With Mixed Reality Modelsmentioning

confidence: 99%

“…Hence, this workflow involves frequent switching of views during the surgery and may be disruptive intraoperatively [6,27]. MR devices in the form of 3D goggles, in corroboration with their software applications, have been described as a useful intraoperative adjunct to allow the neurosurgeon to visualize the tumor spatially within the brain seamlessly [8]. Nonetheless, these cases have been mostly reported in adult neurosurgery, and overall, the incorporation of MR systems into routine use for neurosurgery is still in its infancy [5].…”

Section: Current Visual-spatial Limitations In Pediatric Brain Tumor ...mentioning

confidence: 99%

“…In recent years, there has been an increasing body of literature on the application of mixed reality (MR) systems for pre-operative planning and intraoperative neuro-navigation to spatially visualize the brain tumor with precision [5][6][7][8]]. An MR system encompasses two similar yet distinct systems: virtual reality (VR); and augmented reality (AR) [5].…”

Section: Introductionmentioning

confidence: 99%

“…Next, user-tracking and this feedback to the system allows a seamless user-environment interface [11]. Specifically in neurosurgery, AR prototypes have been developed to overcome the issue of limited views of the surgical field during the course of the operation [8,12,13]. Studies have demonstrated that MR technology is useful in the education of neurosurgery residents as a training tool [6,14].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Mixed Reality for Pediatric Brain Tumors: A Pilot Study from a Singapore Children’s Hospital

Liang,

Teo,

Coyuco

et al. 2023

Surgeries

View full text Add to dashboard Cite

Mixed reality (MR) platforms for neurosurgical education, training, and clinical use have gained popularity in recent years. However, their use in pediatric neurosurgery is comparatively unexplored. We designed a study to explore the use of an MR-based application for pediatric brain tumors. The primary aim is to determine if the use of MR provides the neurosurgical team with a better understanding of the visuospatial anatomy of neoplasms in pediatric craniums and to guide operative planning. Secondary aims include exploring its use as an educational tool for junior doctors and medical students. Methods: Three-dimensional anatomical models of selected pediatric brain tumors are created and uploaded to an MR application. The processed data is transferred into designated MR head-mounted devices. At the end of the trial, users are required to fill in an evaluation form. Results: A total of 30 participants took part in this study. Based on the collated feedback data, all of them agreed that the MR platform was useful as a tool in different aspects of understanding the selected pediatric brain tumors. Conclusions: This study demonstrates a proof of concept of the feasibility of MR platforms for a better understanding of pediatric brain tumors. Further development is needed to refine the current setup to be more versatile.

show abstract

Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and Medicine

Krieger,

Egger,

Kleesiek

et al. 2024

J Digit Imaging. Inform. med.

View full text Add to dashboard Cite

Abstract3D data from high-resolution volumetric imaging is a central resource for diagnosis and treatment in modern medicine. While the fast development of AI enhances imaging and analysis, commonly used visualization methods lag far behind. Recent research used extended reality (XR) for perceiving 3D images with visual depth perception and touch but used restrictive haptic devices. While unrestricted touch benefits volumetric data examination, implementing natural haptic interaction with XR is challenging. The research question is whether a multisensory XR application with intuitive haptic interaction adds value and should be pursued. In a study, 24 experts for biomedical images in research and medicine explored 3D medical shapes with 3 applications: a multisensory virtual reality (VR) prototype using haptic gloves, a simple VR prototype using controllers, and a standard PC application. Results of standardized questionnaires showed no significant differences between all application types regarding usability and no significant difference between both VR applications regarding presence. Participants agreed to statements that VR visualizations provide better depth information, using the hands instead of controllers simplifies data exploration, the multisensory VR prototype allows intuitive data exploration, and it is beneficial over traditional data examination methods. While most participants mentioned manual interaction as the best aspect, they also found it the most improvable. We conclude that a multisensory XR application with improved manual interaction adds value for volumetric biomedical data examination. We will proceed with our open-source research project ISH3DE (Intuitive Stereoptic Haptic 3D Data Exploration) to serve medical education, therapeutic decisions, surgery preparations, or research data analysis.

show abstract

Use of Mixed Reality in Neuro-Oncology: A Single Centre Experience

Cited by 10 publications

References 29 publications

Case Report: Application of HoloLens for Intra-Operative Assessment of a Retrosternal Thyroid Goitre

Case Report: Application of HoloLens for Intra-Operative Assessment of a Retrosternal Thyroid Goitre

Mixed Reality for Pediatric Brain Tumors: A Pilot Study from a Singapore Children’s Hospital

Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and Medicine

Contact Info

Product

Resources

About