SummaryFast internally generated sequences of neural representations are suggested to support learning and online planning. However, these sequences have only been studied in the context of spatial tasks and never in humans. Here, we recorded magnetoencephalography (MEG) while human subjects performed a novel non-spatial reasoning task. The task required selecting paths through a set of six visual objects. We trained pattern classifiers on the MEG activity elicited by direct presentation of the visual objects alone and tested these classifiers on activity recorded during periods when no object was presented. During these object-free periods, the brain spontaneously visited representations of approximately four objects in fast sequences lasting on the order of 120 ms. These sequences followed backward trajectories along the permissible paths in the task. Thus, spontaneous fast sequential representation of states can be measured non-invasively in humans, and these sequences may be a fundamental feature of neural computation across tasks.

Subjects routinely control the vigor with which they emit motoric responses. However, the bulk of formal treatments of decision-making ignores this dimension of choice. A recent theoretical study suggested that action vigor should be influenced by experienced average reward rate and that this rate is encoded by tonic dopamine in the brain. We previously examined how average reward rate modulates vigor as exemplified by response times and found a measure of agreement with the first suggestion. In the current study, we examined the second suggestion, namely the potential influence of dopamine signaling on vigor. Ninety healthy subjects participated in a double-blind experiment in which they received one of the following: placebo, L-DOPA (which increases dopamine levels in the brain), or citalopram (which has a selective, if complex, effect on serotonin levels). Subjects performed multiple trials of a rewarded odd-ball discrimination task in which we varied the potential reward over time in order to exercise the putative link between vigor and average reward rate. Replicating our previous findings, we found that a significant fraction of the variance in subjects' responses could be explained by our experimentally manipulated changes in average reward rate. Crucially, this relationship was significantly stronger under L-Dopa than under Placebo, suggesting that the impact of average reward levels on action vigor is indeed subject to a dopaminergic influence.

Mindfulness training, which involves observing thoughts and feelings without judgment or reaction, has been shown to improve aspects of psychosocial well-being when delivered via in-person training programs such as mindfulness-based stress reduction (MBSR) and mindfulness-based cognitive therapy (MBCT). Less is known about the efficacy of digital training mediums, such as smartphone apps, which are rapidly rising in popularity. In this study, novice meditators were randomly allocated to an introductory mindfulness meditation program or to a psychoeducational audiobook control featuring an introduction to the concepts of mindfulness and meditation. The interventions were delivered via the same mindfulness app, were matched across a range of criteria, and were presented to participants as well-being programs. Affect, irritability, and two distinct components of stress were measured immediately before and after each intervention in a cohort of healthy adults. While both interventions were effective at reducing stress associated with personal vulnerability, only the mindfulness intervention had a significant positive impact on irritability, affect, and stress resulting from external pressure (between group Cohen’s d = 0.44, 0.47, 0.45, respectively). These results suggest that brief mindfulness training has a beneficial impact on several aspects of psychosocial well-being, and that smartphone apps are an effective delivery medium for mindfulness training.

BackgroundPrevious evidence suggests that mindfulness training may improve aspects of psychosocial well-being. Whilst mindfulness is traditionally taught in person, consumers are increasingly turning to mindfulness-based smartphone apps as an alternative delivery medium for training. Despite this growing trend, few studies have explored whether mindfulness delivered via a smartphone app can enhance psychosocial well-being within the general public.MethodsThe present pilot randomised controlled trial compared the impact of engaging with the self-guided mindfulness meditation (MM) app ‘Headspace’ (n = 38) for a period of 10 or 30 days, to a wait-list (WL) control (n = 36), using a cohort of adults from the general population. The Satisfaction with Life Scale, Perceived Stress Scale, and Wagnild Resilience Scale were administered online at baseline and after 10 and 30 days of the intervention.ResultsTwelve participants (MM n = 9, WL n = 3) were lost to follow-up for unknown reasons. Relative to the WL control, the MM app positively impacted self-reported satisfaction with life, stress, and resilience at day 10, with further improvements emerging at day 30 (Cohen’s d = 0.57, 1.42, 0.63 respectively). The rate of improvement was largest at the 10-day assessment point, dropping moderately by day 30. Participants that rated the MM app as easy to engage with experienced the largest self-reported benefits. Moreover, the MM app was able to protect against an unexpected increase in perceived stress that emerged in the control group.ConclusionsThis pilot randomised controlled trial shows that self-reported improvements in psychosocial outcomes can be achieved at low cost through short-term engagement with a mindfulness-based smartphone app, and should be followed up with more substantive studies.Trial registrationISRCTN ISRCTN34618894.

RationaleDecision-making involves two fundamental axes of control namely valence, spanning reward and punishment, and action, spanning invigoration and inhibition. We recently exploited a go/no-go task whose contingencies explicitly decouple valence and action to show that these axes are inextricably coupled during learning. This results in a disadvantage in learning to go to avoid punishment and in learning to no-go to obtain a reward. The neuromodulators dopamine and serotonin are likely to play a role in these asymmetries: Dopamine signals anticipation of future rewards and is also involved in an invigoration of motor responses leading to reward, but it also arbitrates between different forms of control. Conversely, serotonin is implicated in motor inhibition and punishment processing.ObjectiveTo investigate the role of dopamine and serotonin in the interaction between action and valence during learning.MethodsWe combined computational modeling with pharmacological manipulation in 90 healthy human volunteers, using levodopa and citalopram to affect dopamine and serotonin, respectively.ResultsWe found that, after administration of levodopa, action learning was less affected by outcome valence when compared with the placebo and citalopram groups. This highlights in this context a predominant effect of levodopa in controlling the balance between different forms of control. Citalopram had distinct effects, increasing participants’ tendency to perform active responses independent of outcome valence, consistent with a role in decreasing motor inhibition.ConclusionsOur findings highlight the rich complexities of the roles played by dopamine and serotonin during instrumental learning.Electronic supplementary materialThe online version of this article (doi:10.1007/s00213-013-3313-4) contains supplementary material, which is available to authorized users.

Correlative evidence provides support for the idea that brain oscillations underpin neural computations. Recent work using rhythmic stimulation techniques in humans provide causal evidence but the interactions of these external signals with intrinsic rhythmicity remain unclear. Here, we show that sensorimotor cortex follows externally applied rhythmic TMS (rTMS) stimulation in the beta-band but that the elicited responses are strongest at the intrinsic individual beta peak frequency. While these entrainment effects are of short duration, even subthreshold rTMS pulses propagate through the network and elicit significant cortico-spinal coupling, particularly when stimulated at the individual beta-frequency.Our results show that externally enforced rhythmicity interacts with intrinsic brain rhythms such that the individual peak frequency determines the effect of rTMS. The observed downstream spinal effect at the resonance frequency provides evidence for the causal role of brain rhythms for signal propagation.

Model-based and model-free reinforcement learning (RL) have been suggested as algorithmic realizations of goal-directed and habitual action strategies. Model-based RL is more flexible than model-free but requires sophisticated calculations using a learnt model of the world. This has led model-based RL to be identified with slow, deliberative processing, and model-free RL with fast, automatic processing. In support of this distinction, it has recently been shown that model-based reasoning is impaired by placing subjects under cognitive load—a hallmark of non-automaticity. Here, using the same task, we show that cognitive load does not impair model-based reasoning if subjects receive prior training on the task. This finding is replicated across two studies and a variety of analysis methods. Thus, task familiarity permits use of model-based reasoning in parallel with other cognitive demands. The ability to deploy model-based reasoning in an automatic, parallelizable fashion has widespread theoretical implications, particularly for the learning and execution of complex behaviors. It also suggests a range of important failure modes in psychiatric disorders.

Background Depression is one of the most common mental health disorders and severely impacts one’s physical, psychological, and social functioning. To address access barriers to care, we developed Ascend—a smartphone-delivered, therapist-supported, 8-week intervention based on several evidence-based psychological treatments for depression and anxiety. A previous feasibility study with 102 adults with elevated depression reported that Ascend is associated with a postintervention reduction in depression symptoms. Objective We aimed to examine whether Ascend is associated with a reduction in symptoms of anxiety, and importantly, whether reductions in symptoms of depression and anxiety are maintained up to 12-months postintervention. Methods We assessed whether the previously reported, end-of-treatment improvements seen in the 102 adults with elevated symptoms of depression extended up to 12 months posttreatment for depression symptoms (measured by the Patient Health Questionnaire-9 [PHQ-9]) and up to 6 months posttreatment for anxiety symptoms (added to the intervention later and measured using the Generalized Anxiety Disorder-7 [GAD-7] scale). We used linear mixed effects models with Tukey contrasts to compare time points and reported intention-to-treat statistics with a sensitivity analysis. Results The intervention was associated with reductions in symptoms of depression that were maintained 12 months after the program (6.67-point reduction in PHQ-9 score, 95% CI 5.59-7.75; P<.001; Hedges g=1.14, 95% CI 0.78-1.49). A total of 60% of the participants with PHQ-9 scores above the cutoff for major depression at baseline (PHQ≥10) reported clinically significant improvement at the 12-month follow-up (at least 50% reduction in PHQ-9 score and postprogram score <10). Participants also reported reductions in symptoms of anxiety that were maintained for at least 6 months after the program (4.26-point reduction in GAD-7 score, 95% CI 3.14-5.38; P<.001; Hedges g=0.91, 95% CI 0.54-1.28). Conclusions There is limited evidence on whether outcomes associated with smartphone-based interventions for common mental health problems are maintained posttreatment. Participants who enrolled in Ascend experienced clinically significant reductions in symptoms of depression and anxiety that were maintained for up to 1 year and 6 months after the intervention, respectively. Future randomized trials are warranted to test Ascend as a scalable solution to the treatment of depression and anxiety.