MARIN: an open-source mobile augmented reality interactive neuronavigation system

Léger, Étienne; Reyes, Jonatan; Drouin, Simon; Popa, Tiberiu; Hall, Jeffery A.; Collins, D. Louis; Kersten-Oertel, Marta

doi:10.1007/s11548-020-02155-6

Cited by 29 publications

(20 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the last few years, the guidance accuracy and precision of AR has been refined, which allows healthy and diseased tissue to be distinguished; this improves the intuitiveness of the guidance visualization, and the surgical outcomes [ 4 ]. AR, or the fusion of virtual information with the real environment, allows subsurface anatomy to be superimposed on to a surgeon’s live endoscopic or microscopic view by using concurrent navigation, which facilitates neurosurgical guidance [ 30 , 31 ].…”

Section: Discussionmentioning

confidence: 99%

“…Compared to other HMDs, such as smart glasses for neurosurgical navigation as reported by Maruyama et al [ 1 ], which are limited because the overlaid images are only seen by the surgeon wearing the glasses, in the VOSTARS system the AR images can also be observed by other surgeons and surgical nurses on an external display located in the operating room, as well as remotely. Compared to mobile devices for AR, which have many advantages including the fact that they are easy to move around and can be draped in sterile bags, which allows for continuous use throughout a procedure using a touch screen [ 4 ], VOSTARS system have proved to be effective in guiding skin incision, craniotomy and lesion targeting, and are also useful to facilitate training in brain tumor resection procedures.…”

Section: Discussionmentioning

confidence: 99%

“…In recent years, there has been considerable interest in using augmented reality (AR) head-mounted displays (HMDs), either video see-through (VST) or optical see-through (OST), and mobile devices for AR in the operating room (OR) [ 1 , 2 , 3 , 4 ]. Some consumer-level and general purposes OST HMDs, such as the Microsoft ®® HoloLens ®® , can be successfully used for preoperative simulation, for planning and for monitoring patient’s vitals in real-time during surgical procedures.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Augmented Reality-Assisted Craniotomy for Parasagittal and Convexity En Plaque Meningiomas and Custom-Made Cranio-Plasty: A Preliminary Laboratory Report

Montemurro

Condino

Cattari

et al. 2021

IJERPH

View full text Add to dashboard Cite

Background: This report discusses the utility of a wearable augmented reality platform in neurosurgery for parasagittal and convexity en plaque meningiomas with bone flap removal and custom-made cranioplasty. Methods: A real patient with en plaque cranial vault meningioma with diffuse and extensive dural involvement, extracranial extension into the calvarium, and homogeneous contrast enhancement on gadolinium-enhanced T1-weighted MRI, was selected for this case study. A patient-specific manikin was designed starting with the segmentation of the patient’s preoperative MRI images to simulate a craniotomy procedure. Surgical planning was performed according to the segmented anatomy, and customized bone flaps were designed accordingly. During the surgical simulation stage, the VOSTARS head-mounted display was used to accurately display the planned craniotomy trajectory over the manikin skull. The precision of the craniotomy was assessed based on the evaluation of previously prepared custom-made bone flaps. Results: A bone flap with a radius 0.5 mm smaller than the radius of an ideal craniotomy fitted perfectly over the performed craniotomy, demonstrating an error of less than ±1 mm in the task execution. The results of this laboratory-based experiment suggest that the proposed augmented reality platform helps in simulating convexity en plaque meningioma resection and custom-made cranioplasty, as carefully planned in the preoperative phase. Conclusions: Augmented reality head-mounted displays have the potential to be a useful adjunct in tumor surgical resection, cranial vault lesion craniotomy and also skull base surgery, but more study with large series is needed.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Augmented Reality-Assisted Craniotomy for Parasagittal and Convexity En Plaque Meningiomas and Custom-Made Cranio-Plasty: A Preliminary Laboratory Report

Montemurro

Condino

Cattari

et al. 2021

IJERPH

View full text Add to dashboard Cite

show abstract

“…For example, the Ibis Neuronav system includes a built-in module to produce AR images from a surgical microscope that has the ability to record live images ( 3 ). An extension of Ibis called MARIN adds similar capabilities to produce AR image from a tablet computer ( 52 ).…”

Section: Discussionmentioning

confidence: 99%

The Essential Role of Open Data and Software for the Future of Ultrasound-Based Neuronavigation

2021

Self Cite

View full text Add to dashboard Cite

With the recent developments in machine learning and modern graphics processing units (GPUs), there is a marked shift in the way intra-operative ultrasound (iUS) images can be processed and presented during surgery. Real-time processing of images to highlight important anatomical structures combined with in-situ display, has the potential to greatly facilitate the acquisition and interpretation of iUS images when guiding an operation. In order to take full advantage of the recent advances in machine learning, large amounts of high-quality annotated training data are necessary to develop and validate the algorithms. To ensure efficient collection of a sufficient number of patient images and external validity of the models, training data should be collected at several centers by different neurosurgeons, and stored in a standard format directly compatible with the most commonly used machine learning toolkits and libraries. In this paper, we argue that such effort to collect and organize large-scale multi-center datasets should be based on common open source software and databases. We first describe the development of existing open-source ultrasound based neuronavigation systems and how these systems have contributed to enhanced neurosurgical guidance over the last 15 years. We review the impact of the large number of projects worldwide that have benefited from the publicly available datasets “Brain Images of Tumors for Evaluation” (BITE) and “Retrospective evaluation of Cerebral Tumors” (RESECT) that include MR and US data from brain tumor cases. We also describe the need for continuous data collection and how this effort can be organized through the use of a well-adapted and user-friendly open-source software platform that integrates both continually improved guidance and automated data collection functionalities.

show abstract

“…With the application of various advanced stereotactic techniques, such as the ROSA (Robotized Stereotactic Assistant) device, stereoscopic virtual reality system, and augmented reality interactive neuronavigation, the surgical procedure would be increasingly safe and precise (91)(92)(93).…”

Section: ) Stereotactic Hematoma Puncture and Drainagementioning

confidence: 99%

Primary Brainstem Hemorrhage: A Review of Prognostic Factors and Surgical Management

et al. 2021

View full text Add to dashboard Cite

Primary brainstem hemorrhage (PBSH) is the most fatal subtype of intracerebral hemorrhage and is invariably associated with poor prognosis. Several prognostic factors are involved, of which the two most predominant and consistent are the initial level of consciousness and hemorrhage size. Other predictors, such as age, hyperthermia, and hydrocephalus, are generally not dependable indicators for making prognoses. Scoring systems have now been developed that can predict mortality and functional outcomes in patients suffering from PBSH, which can thus guide treatment decision-making. A novel grading scale, entitled “the new primary pontine hemorrhage (PPH) score,” represents the latest approach in scoring systems. In this system, patients with a score of 2–3 points appear to benefit from surgical management, although this claim requires further verification. The four main surgical options for the treatment of PBSH are craniotomy, stereotactic hematoma puncture and drainage, endoscopic hematoma removal, and external ventricular drainage. Nevertheless, the management of PBSH still primarily involves conservative treatment methods and surgery is generally not recommended, according to current practice. However, the ongoing clinical trial, entitled Safety and Efficacy of Surgical Treatment in Severe Primary Pontine Hemorrhage Evacuation (STIPE), should provide additional evidence to support the surgical treatment of PBSH. Therefore, we advocate the update of epidemiological data and re-evaluation of PBSH treatment in a contemporary context.

show abstract

MARIN: an open-source mobile augmented reality interactive neuronavigation system

Cited by 29 publications

References 20 publications

Augmented Reality-Assisted Craniotomy for Parasagittal and Convexity En Plaque Meningiomas and Custom-Made Cranio-Plasty: A Preliminary Laboratory Report

Augmented Reality-Assisted Craniotomy for Parasagittal and Convexity En Plaque Meningiomas and Custom-Made Cranio-Plasty: A Preliminary Laboratory Report

The Essential Role of Open Data and Software for the Future of Ultrasound-Based Neuronavigation

Primary Brainstem Hemorrhage: A Review of Prognostic Factors and Surgical Management

Contact Info

Product

Resources

About