Accurate Interactive Visualization of Large Deformations and Variability in Biomedical Image Ensembles

Abstract

Large image deformations pose a challenging problem for the visualization and statistical analysis of 3D image ensembles which have a multitude of applications in biology and medicine. Simple linear interpolation in the tangent space of the ensemble introduces artifactual anatomical structures that hamper the application of targeted visual shape analysis techniques. In this work we make use of the theory of stationary velocity fields to facilitate interactive non-linear image interpolation and plausible extrapolation for high quality rendering of large deformations and devise an efficient image warping method on the GPU. This does not only improve quality of existing visualization techniques, but opens up a field of novel interactive methods for shape ensemble analysis. Taking advantage of the efficient non-linear 3D image warping, we showcase four visualizations: 1) browsing on-the-fly computed group mean shapes to learn about shape differences between specific classes, 2) interactive reformation to investigate complex morphologies in a single view, 3) likelihood volumes to gain a concise overview of variability and 4) streamline visualization to show variation in detail, specifically uncovering its component tangential to a reference surface. Evaluation on a real world dataset shows that the presented method outperforms the state-of-the-art in terms of visual quality while retaining interactive frame rates. A case study with a domain expert was performed in which the novel analysis and visualization methods are applied on standard model structures, namely skull and mandible of different rodents, to investigate and compare influence of phylogeny, diet and geography on shape. The visualizations enable for instance to distinguish (population-)normal and pathological morphology, assist in uncovering correlation to extrinsic factors and potentially support assessment of model quality.

Bladder Runner: Visual Analytics for the Exploration of RT‐Induced Bladder Toxicity in a Cohort Study

“…With respect to the quantification and exploration of the organ shape variation, Hermann et al [HSSK16] covered the topic of visualization of anatomic covariances in ensembles of data. They also published a state of the art report with future prospects on the visual analysis of shapes [HK15], which we took into consideration during the design phase of the Bladder Runner.…”

VAPOR: Visual Analytics for the Exploration of Pelvic Organ Variability in Radiotherapy

“…In shape space analysis, Hermann et al [27,28,29] investigate anatomic covariances in ensembles of data, providing also a state of the art report with prospects on the visual analysis of shapes [30]. Busking et al [31] propose to use a 2D scatter plot to represent the distribution of elements inside a cohort and to synthesize additional arbitrary objects in the shape space.…”

Visualization of Human Spine Biomechanics for Spinal Surgery

“…A common theme in research on medical imaging and visualization are techniques for spatial comparison of 3D data, which may also be time-varying, i.e., spatio-temporal. Hermann et al [28] demonstrated how image warping can be used to show variability in ensembles of biomedical images and Raidou et al [50] proposed a tool for visual exploration of bladder shape variation during prostate cancer radiotherapy. Another approach is to merge data captured at different time steps to, for example, display a static overview, allowing direct comparison [21].…”