Deformable 3D–2D image registration and analysis of global spinal alignment in long‐length intraoperative spine imaging

Abstract

Background Spinal deformation during surgical intervention (caused by patient positioning and/or the correction of malalignment) confounds conventional navigation due to the assumptions of rigid transformation. Moreover, the ability to accurately quantify spinal alignment in the operating room would provide an assessment of the surgical product via metrics that correlate with clinical outcomes. Purpose A method for deformable 3D–2D registration of preoperative CT to intraoperative long‐length tomosynthesis images is reported for an accurate 3D evaluation of device placement in the presence of spinal deformation and automated evaluation of global spinal alignment (GSA). Methods Long‐length tomosynthesis (“Long Film,” LF) images were acquired using an O‐arm imaging system (Medtronic, Minneapolis USA). A deformable 3D–2D patient registration was developed using multi‐scale masking (proceeding from the full‐length image to local subvolumes about each vertebra) to transform vertebral labels and planning information from preoperative CT to the LF images. Automatic measurement of GSA (main thoracic kyphosis [MThK] and lumbar lordosis [LL]) was obtained using a spline fit to registered labels. The “Known‐Component Registration” method for device registration was adapted to the multi‐scale process for 3D device localization from orthogonal LF images. The multi‐scale framework was evaluated using a deformable spine phantom in which pedicle screws were inserted, and deformations were induced over a range in LL ∼25°–80°. Further validation was carried out in a cadaver study with implanted pedicle screws and a similar range of spinal deformation. The accuracy of patient and device registration was evaluated in terms of 3D translational error and target registration error, respectively, and the accuracies of automatic GSA measurements were compared to manual annotation. Results Phantom studies demonstrated accurate registration via the multi‐scale framework for all vertebral levels in both the neutral and deformed spine: median (interquartile range, IQR) patient registration error was 1.1 mm (0.7–1.9 mm IQR). Automatic measures of MThK and LL agreed with manual delineation within −1.1° ± 2.2° and 0.7° ± 2.0° (mean and standard deviation), respectively. Device registration error was 0.7 mm (0.4–1.0 mm IQR) at the screw tip and 0.9° (1.0°–1.5°) about the screw trajectory. Deformable 3D–2D registration significantly outperformed conventional rigid registration (p < 0.05), which exhibited device registration errors of 2.1 mm (0.8–4.1 mm) and 4.1° (1.2°–9.5°). Cadaver studies verified performance under realistic conditions, demonstrating patient registration error of 1.6 mm (0.9–2.1 mm); MThK within −4.2° ± 6.8° and LL within 1.7° ± 3.5°; and device registration error of 0.8 mm (0.5–1.9 mm) and 0.7° (0.4°–1.2°) for the multi‐scale deformable method, compared to 2.5 mm (1.0–7.9 mm) and 2.3° (1.6°–8.1°) for rigid registration (p < 0.05). Conclusion The deformable 3D–2D registration framework leverages long‐length intraoperat...

Multi-modality registration of preoperative MR and intraoperative long-length tomosynthesis using GAN synthesis and 3D-2D registration

“…Recognizing the potential for deformations, we will employ a locally rigid registration approach (for each vertebra) to account for changes in spinal curvature. 8 This approach will be combined with automatic initialization using CNN-based vertebrae labeling presented in our early work 9,10 to extend the capture range, parallelize registrations, and reduce algorithm runtime.…”

A Review of 3D-2D Registration Methods and Applications based on Medical Images

“…To avoid repeated contrast injections, the system reduces the burden on the physician by fusing real-time images from the interventional phase with a 2D panoramic view of the peripheral arterial system from the diagnostic phase [56]. Zhang et al [57] developed a multiscale, deformable 3D-2D registration method applicable to spinal deformities. The method first transforms the vertebral labels and planning information in the preoperative CT images using a multiscale mask [58], and then evaluates the registration of the spine using a spline curve [59] matched with the registration labels, and the registration results are shown in Figure 13.…”

Artificial Intelligence in Scoliosis: Current Applications and Future Directions

“…The intraoperative findings of this technique were completely consistent with the preoperative 3D reconstruction results, which improved the accuracy of pedicle screw insertion in complex scoliosis surgery. Zhang et al [58] constructed a deformable 3D−2D registration framework based on preoperative CT and intraoperative long cross-sectional images. This method could automatically evaluate the overall spinal alignment and contribute to the accurate insertion of pedicle screws in the case of spinal deformation.…”