Activation likelihood estimation (ALE) meta-analyses were used to examine the neural correlates of prediction error in reinforcement learning. The findings are interpreted in the light of current computational models of learning and action selection. In this context, particular consideration is given to the comparison of activation patterns from studies using instrumental and Pavlovian conditioning, and where reinforcement involved rewarding or punishing feedback. The striatum was the key brain area encoding for prediction error, with activity encompassing dorsal and ventral regions for instrumental and Pavlovian reinforcement alike, a finding which challenges the functional separation of the striatum into a dorsal 'actor' and a ventral 'critic'. Prediction error activity was further observed in diverse areas of predominantly anterior cerebral cortex including medial prefrontal cortex and anterior cingulate cortex. Distinct patterns of prediction error activity were found for studies using rewarding and aversive reinforcers; reward prediction errors were observed primarily in the striatum while aversive prediction errors were found more widely including insula and habenula.

No abstract

BackgroundLong duration spaceflight (i.e., 22 days or longer) has been associated with changes in sensorimotor systems, resulting in difficulties that astronauts experience with posture control, locomotion, and manual control. The microgravity environment is an important causal factor for spaceflight induced sensorimotor changes. Whether spaceflight also affects other central nervous system functions such as cognition is yet largely unknown, but of importance in consideration of the health and performance of crewmembers both in- and post-flight. We are therefore conducting a controlled prospective longitudinal study to investigate the effects of spaceflight on the extent, longevity and neural bases of sensorimotor and cognitive performance changes. Here we present the protocol of our study.Methods/designThis study includes three groups (astronauts, bed rest subjects, ground-based control subjects) for which each the design is single group with repeated measures. The effects of spaceflight on the brain will be investigated in astronauts who will be assessed at two time points pre-, at three time points during-, and at four time points following a spaceflight mission of six months. To parse out the effect of microgravity from the overall effects of spaceflight, we investigate the effects of seventy days head-down tilted bed rest. Bed rest subjects will be assessed at two time points before-, two time points during-, and three time points post-bed rest. A third group of ground based controls will be measured at four time points to assess reliability of our measures over time. For all participants and at all time points, except in flight, measures of neurocognitive performance, fine motor control, gait, balance, structural MRI (T1, DTI), task fMRI, and functional connectivity MRI will be obtained. In flight, astronauts will complete some of the tasks that they complete pre- and post flight, including tasks measuring spatial working memory, sensorimotor adaptation, and fine motor performance. Potential changes over time and associations between cognition, motor-behavior, and brain structure and function will be analyzed.DiscussionThis study explores how spaceflight induced brain changes impact functional performance. This understanding could aid in the design of targeted countermeasures to mitigate the negative effects of long-duration spaceflight.

Age-related behavioral declines may be the result of deterioration of white matter tracts, affecting brain structural (SC) and functional connectivity (FC) during resting state. To date, it is not clear if the combination of SC and FC data could better predict cognitive/motor performance than each measure separately. We probed these relationships in the cingulum bundle, a major white matter pathway of the default mode network. We aimed to attain deeper knowledge about: (a) the relationship between age and the cingulum's SC and FC strength, (b) the association between SC and FC, and particularly (c) how the cingulum's SC and FC are related to cognitive/motor performance separately and combined. We examined these associations in a healthy and well-educated sample of 165 older participants (aged 64-85). SC and FC were acquired using probabilistic tractography to derive measures to capture white matter integrity within the cingulum bundle (fractional anisotropy, mean, axial and radial diffusivity) and a seed-based resting-state functional MRI correlation approach, respectively. Participants performed cognitive tests measuring processing speed, memory and executive functions, and motor tests measuring motor speed and grip force. Our data revealed that only SC but not resting state FC was significantly associated with age. Further, the cingulum's SC and FC showed no relation. Different relationships between cognitive/motor performance and SC/FC separately were found, but no additive effect of the combined analysis of cingulum's SC and FC for predicting cognitive/motor performance was apparent.

No abstract