Opportunities for increased reproducibility and replicability of developmental neuroimaging

Abstract

Recently, many workflows and tools that aim to increase the reproducibility and replicability of research findings have been suggested. In this review, we discuss the opportunities that these efforts offer for the field of developmental cognitive neuroscience. We focus on issues broadly related to statistical power and to flexibility and transparency in data analyses. Critical considerations relating to statistical power include challenges in recruitment and testing of young populations, how to increase the value of studies with small samples, and the opportunities and challenges related to working with large-scale datasets. Developmental studies also involve challenges such as choices about age groupings, modelling across the lifespan, the analyses of longitudinal changes, and neuroimaging data that can be processed and analyzed in a multitude of ways. Flexibility in data acquisition, analyses and description may thereby greatly impact results. We discuss methods for improving transparency in developmental cognitive neuroscience, and how preregistration of studies can improve methodological rigor in the field. While outlining challenges and issues that may arise before, during, and after data collection, solutions and resources are highlighted aiding to overcome some of these. Since the number of useful tools and techniques is ever-growing, we highlight the fact that many practices can be implemented stepwise.

How to capture developmental brain dynamics: gaps and solutions

“…A fifth recurrent issue throughout the workshop was the need for reproducible research, with specific challenges for the field of developmental cognitive neuroscience 68 . In discussing “Gap and solution 2”, the importance of using large and representative samples to improve reproducibility in developmental cognitive neuroscience 49 was already mentioned.…”

Neural indicators of food cue reactivity, regulation, and valuation and their associations with body composition and daily eating behavior

“…Specifically, we employed specification curve analysis (SCA; Simonsohn et al, 2015) to assess how analytic decisions and inclusion of covariates affected associations between criterion variables and univariate and multivariate neural indicators related to reactivity, regulation, and valuation. This approach has been used within psychological research on technology use (Orben & Przybylski, 2019a, 2019b, and recent work in cognitive neuroscience has highlighted the utility of SCA applications to neuroimaging research (Klapwijk et al, 2019;Pfeifer et al, 2019). We argue that SCA is especially useful in translational contexts because it provides an explicit framework to test the effect of analytic decisions, which otherwise undisclosed might lead to increased false positives and lower overall translational value within the literature.…”

A Neglected Topic in Neuroscience: Replicability of fMRI Results With Specific Reference to ANOREXIA NERVOSA

“…Two studies may be considered to have replicated if they obtain consistent results given the level of uncertainty inherent in the system under study." Other studies in the field also refer to this definition (15,17,20) and this publication adheres to it, too. In addition to exact definitions, the precise description of study protocols, data, and results is of importance (21).…”