Abstract:We present a new approach for automatic registration of X-ray mammograms and MR images. Multimodal breast cancer diagnosis is supported by automatic localization of small lesions, which are only visible in the mammograms or in the MR image. To cope with the huge deformation of the breast during mammography, a finite element model of the deformable behavior of the breast is applied during the registration. An evaluation of the registration with six clinical data sets resulted in an accurate localization with a … Show more
“…The registration method is based on a method originally developed for the registration of Magnetic Resonance Tomography images with X-ray mammograms [9,22] and was successfully applied for the registration of USCT images with X-ray mammograms. The obtained accuracy for an automated registration (TRE 11.9 mm) is slightly better than for the registration with MRI images (13.2 mm), well within the range other MRI-to-mammography registration approaches in literature [20,51] and as well in a range which might assist radiologists in multimodal diagnosis.…”
Section: Discussionmentioning
confidence: 99%
“…[22,39]. At first the USCT volume is rigidly aligned with the X-ray mammogram in anteroposterior direction at the chest wall.…”
Section: Image Registrationmentioning
confidence: 99%
“…Methods include a 2D registration of projected MRI images [13,14], 3D affine transformations [15], using idealized ellipsoidal models of the breast in combination with Finite Element compression simulations [16] and using biomechanical models of the breast [17][18][19][20][21][22]. None of these methods has been applied to other modalities than MRI.…”
“…The registration method is based on a method originally developed for the registration of Magnetic Resonance Tomography images with X-ray mammograms [9,22] and was successfully applied for the registration of USCT images with X-ray mammograms. The obtained accuracy for an automated registration (TRE 11.9 mm) is slightly better than for the registration with MRI images (13.2 mm), well within the range other MRI-to-mammography registration approaches in literature [20,51] and as well in a range which might assist radiologists in multimodal diagnosis.…”
Section: Discussionmentioning
confidence: 99%
“…[22,39]. At first the USCT volume is rigidly aligned with the X-ray mammogram in anteroposterior direction at the chest wall.…”
Section: Image Registrationmentioning
confidence: 99%
“…Methods include a 2D registration of projected MRI images [13,14], 3D affine transformations [15], using idealized ellipsoidal models of the breast in combination with Finite Element compression simulations [16] and using biomechanical models of the breast [17][18][19][20][21][22]. None of these methods has been applied to other modalities than MRI.…”
“…For example, an 8% error in c 1 results in 2 mm RMS errors in prediction accuracy. However, this analysis suggests that larger errors in the estimation of c 1 will still satisfy the sub-5 mm accuracy required for clinical applications (Ruiter et al 2004). …”
Section: Validation Of the Optimized Materials Parametermentioning
confidence: 98%
“…This paper focuses on the construction of a modeling framework that can reasonably accurately predict the compressive deformations, in order to match the deformed model to the mammogram images (step 3). It has been reported that model predictions should be better than 5 mm accurate compared to actual deformation to be useful for early breast cancer diagnosis (Ruiter et al 2004). In constructing the modeling framework, we use a systematic approach to validate each aspect of our model using carefully controlled experimental studies.…”
Section: Biomechanical Model: the Motivationmentioning
A number of biomechanical models have been proposed to improve nonrigid registration techniques for multimodal breast image alignment. A deformable breast model may also be useful for overcoming difficulties in interpreting 2D X-ray projections (mammograms) of 3D volumes (breast tissues). If a deformable model could accurately predict the shape changes that breasts undergo during mammography, then the model could serve to localize suspicious masses (visible in mammograms) in the unloaded state, or in any other deformed state required for further investigations (such as biopsy or other medical imaging modalities). In this paper, we present a validation study that was conducted in order to develop a biomechanical model based on the well-established theory of continuum mechanics (finite elasticity theory with contact mechanics) and demonstrate its use for this application. Experimental studies using gel phantoms were conducted to test the accuracy in predicting mammographic-like deformations. The material properties of the gel phantom were estimated using a nonlinear optimization process, which minimized the errors between the experimental and the model-predicted surface data by adjusting the parameter associated with the neo-Hookean constitutive relation. Two compressions (the equivalent of cranio-caudal and medio-lateral mammograms) were performed on the phantom, and the corresponding deformations were recorded using a MRI scanner. Finite element simulations were performed to mimic the experiments using the estimated material properties with appropriate boundary conditions. The simulation results matched the experimental recordings of the deformed phantom, with a sub-millimeter root-mean-square error for each compression state. Having now validated our finite element model of breast compression, the next stage is to apply the model to clinical images.
Breast magnetic resonance imaging (MRI) and x-ray mammography are two image modalities widely used for the early detection and diagnosis of breast diseases in women. The combination of these modalities leads to a more accurate diagnosis and treatment of breast diseases. The aim of this paper is to review the registration between breast MRI and x-ray mammographic images using patient-specific finite element-based biomechanical models. Specifically, a biomechanical model is obtained from the patient's MRI volume and is subsequently used to mimic the mammographic acquisition. Due to the different patient positioning and movement restrictions applied in each image modality, the finite element analysis provides a realistic physics-based approach to perform the breast deformation. In contrast with other reviews, we do not only expose the overall process of compression and registration but we also include main ideas, describe challenges, and provide an overview of the used software in each step of the process. Extracting an accurate description from the MR images and preserving the stability during the finite element analysis require an accurate knowledge about the algorithms used, as well as the software and underlying physics. The wide perspective offered makes the paper suitable not only for expert researchers but also for graduate students and clinicians. We also include several medical applications in the paper, with the aim to fill the gap between the engineering and clinical performance.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.