We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large datasets or rich deformation models. In contrast to this approach, and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images. We parameterize the function via a convolutional neural network (CNN), and optimize the parameters of the neural network on a set of images. Given a new pair of scans, VoxelMorph rapidly computes a deformation field by directly evaluating the function. In this work, we explore two different training strategies. In the first (unsupervised) setting, we train the model to maximize standard image matching objective functions that are based on the image intensities. In the second setting, we leverage auxiliary segmentations available in the training data. We demonstrate that the unsupervised model's accuracy is comparable to state-of-the-art methods, while operating orders of magnitude faster. We also show that VoxelMorph trained with auxiliary data improves registration accuracy at test time, and evaluate the effect of training set size on registration. Our method promises to speed up medical image analysis and processing pipelines, while facilitating novel directions in learning-based registration and its applications. Our code is freely available at http://voxelmorph.csail.mit.edu.

We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be timeconsuming for large data. We define registration as a parametric function, and optimize its parameters given a set of images from a collection of interest. Given a new pair of scans, we can quickly compute a registration field by directly evaluating the function using the learned parameters. We model this function using a convolutional neural network (CNN), and use a spatial transform layer to reconstruct one image from another while imposing smoothness constraints on the registration field. The proposed method does not require supervised information such as ground truth registration fields or anatomical landmarks. We demonstrate registration accuracy comparable to stateof-the-art 3D image registration, while operating orders of magnitude faster in practice. Our method promises to significantly speed up medical image analysis and processing pipelines, while facilitating novel directions in learningbased registration and its applications. Our code is available at https://github.com/balakg/voxelmorph.

Resting-state functional magnetic resonance imaging (rs-fMRI) offers the opportunity to delineate individual-specific brain networks. A major question is whether individual-specific network topography (i.e., location and spatial arrangement) is behaviorally relevant. Here, we propose a multi-session hierarchical Bayesian model (MS-HBM) for estimating individual-specific cortical networks and investigate whether individual-specific network topography can predict human behavior. The multiple layers of the MS-HBM explicitly differentiate intra-subject (within-subject) from inter-subject (between-subject) network variability. By ignoring intra-subject variability, previous network mappings might confuse intra-subject variability for inter-subject differences. Compared with other approaches, MS-HBM parcellations generalized better to new rs-fMRI and task-fMRI data from the same subjects. More specifically, MS-HBM parcellations estimated from a single rs-fMRI session (10 min) showed comparable generalizability as parcellations estimated by 2 state-of-the-art methods using 5 sessions (50 min). We also showed that behavioral phenotypes across cognition, personality, and emotion could be predicted by individual-specific network topography with modest accuracy, comparable to previous reports predicting phenotypes based on connectivity strength. Network topography estimated by MS-HBM was more effective for behavioral prediction than network size, as well as network topography estimated by other parcellation approaches. Thus, similar to connectivity strength, individual-specific network topography might also serve as a fingerprint of human behavior.

No abstract

Traditional deformable registration techniques achieve impressive results and offer a rigorous theoretical treatment, but are computationally intensive since they solve an optimization problem for each image pair. Recently, learning-based methods have facilitated fast registration by learning spatial deformation functions. However, these approaches use restricted deformation models, require supervised labels, or do not guarantee a diffeomorphic (topology-preserving) registration. Furthermore, learning-based registration tools have not been derived from a probabilistic framework that can offer uncertainty estimates. In this paper, we present a probabilistic generative model and derive an unsupervised learning-based inference algorithm that makes use of recent developments in convolutional neural networks (CNNs). We demonstrate our method on a 3D brain registration task, and provide an empirical analysis of the algorithm. Our approach results in state of the art accuracy and very fast runtimes, while providing diffeomorphic guarantees and uncertainty estimates. Our implementation is available online at https://github.com/voxelmorph/voxelmorph.

Linking human behavior to resting-state brain function is a central question in systems neuroscience. In particular, the functional timescales at which different types of behavioral factors are encoded remain largely unexplored. The behavioral counterparts of static functional connectivity (FC), at the resolution of several minutes, have been studied but behavioral correlates of dynamic measures of FC at the resolution of a few seconds remain unclear. Here, using resting-state fMRI and 58 phenotypic measures from the Human Connectome Project, we find that dynamic FC captures task-based phenotypes (e.g., processing speed or fluid intelligence scores), whereas self-reported measures (e.g., loneliness or life satisfaction) are equally well explained by static and dynamic FC. Furthermore, behaviorally relevant dynamic FC emerges from the interconnections across all resting-state networks, rather than within or between pairs of networks. Our findings shed new light on the timescales of cognitive processes involved in distinct facets of behavior.

No abstract

Resting-state functional magnetic resonance imaging (rs-fMRI) offers the opportunity to delineate individual-specific brain networks. A major question is whether individual-specific network topography (i.e., location and spatial arrangement) is behaviorally relevant. Here, we propose a multi-session hierarchical Bayesian model (MS-HBM) for estimating individualspecific cortical networks and investigate whether individual-specific network topography can predict human behavior. The multiple layers of the MS-HBM explicitly differentiate intra-subject (within-subject) from inter-subject (between-subject) network variability. By ignoring intra-subject variability, previous network mappings might confuse intra-subject variability for inter-subject differences. Compared with other approaches, MS-HBM parcellations generalized better to new rs-fMRI and task-fMRI data from the same subjects.More specifically, MS-HBM parcellations estimated from a single rs-fMRI session (10 minutes) showed comparable generalizability as parcellations estimated by two state-of-theart methods using five sessions (50 minutes). We also showed that behavioral phenotypes across cognition, personality and emotion could be predicted by individual-specific network topography with modest accuracy, comparable to previous reports predicting phenotypes based on connectivity strength. Network topography estimated by MS-HBM was more effective for behavioral prediction than network size, as well as network topography estimated by other parcellation approaches. Thus, similar to connectivity strength, individualspecific network topography might also serve as a fingerprint of human behavior. substantially across participants (Harrison et al., 2015;Laumann et al., 2015;Wang et al., 2015;Glasser et al., 2016;Gordon et al., 2017aGordon et al., , 2017bGordon et al., , 2017cBraga and Buckner, 2017).Yet, the possible behavioral relevance of individual differences in network size and network topography (location and spatial arrangement) remains unknown.We proposed a multi-session hierarchical Bayesian model (MS-HBM) for estimating individual-specific network parcellations of the cerebral cortex and investigated whether individual-specific network topography and size are associated with human behavior. The multiple layers of the MS-HBM allowed explicit separation of inter-subject (betweensubject) and intra-subject (within-session) functional connectivity variability. Previous individual-specific network mappings only accounted for inter-subject variability, but not intra-subject variability. However, inter-subject and intra-subject RSFC variability can be markedly different across regions (Mueller et al., 2013;Chen et al., 2015;Laumann et al., 2015). For example, the motor cortex exhibits high intra-subject functional connectivity variability, but low inter-subject functional connectivity variability .Therefore, observed RSFC variability in the motor cortex might be incorrectly attributed to inter-subject spatial variability of brain networks, rather than just intra-...