Using Make for Reproducible and Parallel Neuroimaging Workflow and Quality-Assurance

Abstract

The contribution of this paper is to describe how we can program neuroimaging workflow using Make, a software development tool designed for describing how to build executables from source files. A makefile (or a file of instructions for Make) consists of a set of rules that create or update target files if they have not been modified since their dependencies were last modified. These rules are processed to create a directed acyclic dependency graph that allows multiple entry points from which to execute the workflow. We show that using Make we can achieve many of the features of more sophisticated neuroimaging pipeline systems, including reproducibility, parallelization, fault tolerance, and quality assurance reports. We suggest that Make permits a large step toward these features with only a modest increase in programming demands over shell scripts. This approach reduces the technical skill and time required to write, debug, and maintain neuroimaging workflows in a dynamic environment, where pipelines are often modified to accommodate new best practices or to study the effect of alternative preprocessing steps, and where the underlying packages change frequently. This paper has a comprehensive accompanying manual with lab practicals and examples (see Supplemental Materials) and all data, scripts, and makefiles necessary to run the practicals and examples are available in the “makepipelines” project at NITRC.

Salience network response to changes in emotional expressions of others is heightened during early adolescence: relevance for social functioning

“…Pre‐processing and statistical analysis of fMRI data was performed in a pipeline using Make, a software development tool designed for describing how to build executables from source files that can be used to create neuroimaging workflows that rely on multiple software packages (Askren et al., ). Simultaneous motion and slice‐time correction was performed in NiPy (Roche, ).…”

Empirical Comparison of Diffusion Kurtosis Imaging and Diffusion Basis Spectrum Imaging Using the Same Acquisition in Healthy Young Adults

“…The processing pipeline was implemented using GNU Make (26), and scripts and Makefiles to implement these analyses are available from the first author. Additionally, the workflow is documented in Supplementary Material.…”

A practical guide for improving transparency and reproducibility in neuroimaging research

“…There are many frameworks that help design and efficiently run neuroimaging analyses in automated fashion. Those include, but are not limited to: Nipype [27] , PSOM [28] , aa [29] , and make [30] . As an example, for our recent work on the MyConnectome project [31] we created a fully automated analysis pipeline, which we implemented using a virtual machine .…”