An integrated visualization system for surgical planning and guidance using image fusion and an open MR

Abstract

A surgical guidance and visualization system is presented, which uniquely integrates capabilities for data analysis and on-line interventional guidance into the setting of interventional MRI. Various pre-operative scans (T1-and T2-weighted MRI, MR angiography, and functional MRI (fMRI)) are fused and automatically aligned with the operating field of the interventional MR system. Both pre-surgical and intra-operative data may be segmented to generate three-dimensional surface models of key anatomical and functional structures. Models are combined in a three-dimensional scene along with reformatted slices that are driven by a tracked surgical device. Thus, pre-operative data augments interventional imaging to expedite tissue characterization and precise localization and targeting. As the surgery progresses, and anatomical changes subsequently reduce the relevance of preoperative data, interventional data is refreshed for software navigation in true real time. The system has been applied in Index terms: neurosurgical planning; image guided surgery; image fusion; 3D visualization; interventional MRI IMAGE-GUIDED SURGERY SYSTEMS strive to enhance the surgeon's capability to utilize medical imagery to decrease the invasiveness of surgical procedures and increase their accuracy and safety. These systems can be categorized into performing one or more of the following functions: data analysis (2,3,4), surgical planning (2,3,4), surgical guidance (5,6,7,8,9,10), and surgical guidance with intra-operative updates (11,12,13,14). The systems focused on surgical guidance tend to present the surgeon with data that was gathered prior to surgery, track surgical instruments within the operating field, and render the tracked devices along with the data. For more difficult surgeries, it is beneficial to present the surgeon with not just one diagnostic scan, but with an array of information derived from fusing data sets with information on morphology, cortical function, and metabolic activity. These varied data sets are acquired in different coordinate systems and need to be aligned, or registered, to a common framework for surgical planning before that framework is in turn registered to the patient for surgical guidance. The latter registration allows the surgeon to establish a correspondence between the patient lying on the operating table and the images rendered on a nearby computer screen.The major shortcoming of image guided surgery systems is that the use of pre-surgically acquired data does not account for intra-operative changes in brain morphology. The systems with intra-operative updates have been introduced to fill that void, but they have fallen short of achieving perfect interactivity and full information disclosure to the surgeon. In particular, the benefits of interventional MRI could be amplified by focusing on five issues: image quality, imaging time, multi-modal fusion, faster localization, and three-dimensional visualization. The need for better image quality arises because some anatomical structures are difficult...

User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability

“…A number of other software packages provide semi-automatic segmentation capability, but these packages tend to be either very broad or very specific in the scope of functionality that they provide. For instance, large-scale packages such as Mayo Analyze (Robb and Hanson, 1995) and the open-source 3D Slicer (Gering et al, 2001) include 3D active contour segmentation modules, and the NIH MIPAV tool (McAuliffe et al, 2001) provides in-slice active contour segmentation. These tools carry a steep learning curve, due the large number of features that they provide.…”

A novel MRI‐compatible brain ventricle phantom for validation of segmentation and volumetry methods

“…Affinities range between 0 and 1 and pixels are chosen based on a threshold affinity. A second segmentation tool, using 3D Slicer's Editor Module, was also used to quantify the images (25). Grow Cut Segmentation was used to generate the initial label map.…”

Software Strategy for Robotic Transperineal Prostate Therapy in Closed-Bore MRI

“…1A), 2) closed-bore whole body 3T MRI scanner (GE Excite HD 3T, GE Healthcare, Chalfont St. Giles, UK), and 3) open-source surgical navigation software (3D Slicer, http://www.slicer.org/) [12]. The 3D Slicer, running on a Linux-based workstation (SunJava Workstation W2100z, Sun Microsystems, CA), serves as a user interface for the entire system; it displays pre-operative 3D images for planning and intraoperative semi real-time MR images for guiding the procedure.…”