Background. Reward-based decision-making is impaired in patients with schizophrenia (PSZ) as reflected by increased choice switching. The underlying cognitive and motivational processes as well as associated neural signatures remain unknown.Reinforcement Learning (RL) and hierarchical Bayesian learning account for choice switching in different ways. We hypothesized that enhanced choice switching, as seen in PSZ during reward-based decision-making, relates to higher-order beliefs about environmental volatility and examined the associated neural activity.Methods. 46 medicated PSZ and 43 healthy controls (HC) performed a reward-based decision-making task requiring flexible responses to changing action-outcome contingencies during functional Magnetic Resonance Imaging (fMRI). Detailed computational modeling of choice data was performed, including RL and the hierarchical Gaussian filter (HGF). Trajectories of learning from computational modeling informed the analysis of fMRI data.Results. A three-level HGF accounted best for the observed choice data. This model revealed a heightened initial belief about environmental volatility and a stronger influence of volatility on lower-level learning of action-outcome contingencies in PSZ as compared to HC. This was replicated in an independent sample of non-medicated PSZ. Beliefs about environmental volatility were reflected by higher activity in dorsolateral prefrontal cortex of PSZ as compared to HC.Conclusions. Our study suggests that PSZ inferred the environment as overly volatile, which may explain increased choice switching. In PSZ, activity in dorsolateral prefrontal cortex was more strongly related to beliefs about environmental volatility. Our computational phenotyping approach may provide useful information to dissect clinical heterogeneity and could improve prediction of outcome..

Higher aberrant salience attribution in schizophrenia patients is related to reduced vmPFC activation during self-referential judgments suggesting that aberrant relevance coding is reflected in decreased neural self-referential processing as well as in aberrant salience attribution.

Recent theories of cortical function construe the brain as performing hierarchical Bayesian inference. According to these theories, the precision of prediction errors plays a key role in learning and decision-making, is controlled by dopamine and contributes to the pathogenesis of psychosis. To test these hypotheses, we studied learning with variable outcome-precision in healthy individuals after dopaminergic modulation with a placebo, a dopamine receptor agonist bromocriptine or a dopamine receptor antagonist sulpiride (dopamine study n = 59) and in patients with early psychosis (psychosis study n = 74: 20 participants with first-episode psychosis, 30 healthy controls and 24 participants with at-risk mental state attenuated psychotic symptoms). Behavioural computational modelling indicated that precision weighting of prediction errors benefits learning in health and is impaired in psychosis. FMRI revealed coding of unsigned prediction errors, which signal surprise, relative to their precision in superior frontal cortex (replicated across studies, combined n = 133), which was perturbed by dopaminergic modulation, impaired in psychosis and associated with task performance and schizotypy (schizotypy correlation in 86 healthy volunteers). In contrast to our previous work, we did not observe significant precision-weighting of signed prediction errors, which signal valence, in the midbrain and ventral striatum in the healthy controls (or patients) in the psychosis study. We conclude that healthy people, but not patients with first-episode psychosis, take into account the precision of the environment when updating beliefs. Precision weighting of cortical prediction error signals is a key mechanism through which dopamine modulates inference and contributes to the pathogenesis of psychosis.

In schizophrenia, increased aberrant salience to irrelevant events and reduced learning of relevant information may relate to an underlying deficit in relevance detection. So far, subjective estimates of relevance have not been probed in schizophrenia patients. The mechanisms underlying belief formation about relevance and their translation into decisions are unclear. Using novel computational methods, we investigated relevance detection during implicit learning in 42 schizophrenia patients and 42 healthy individuals. Participants underwent functional magnetic resonance imaging while detecting the outcomes in a learning task. These were preceded by cues differing in color and shape, which were either relevant or irrelevant for outcome prediction. We provided a novel definition of relevance based on Bayesian precision and modeled reaction times as a function of relevance weighted unsigned prediction errors (UPE). For aberrant salience, we assessed responses to subjectively irrelevant cue manifestations. Participants learned the contingencies and slowed down their responses following unexpected events. Model selection revealed that individuals inferred the relevance of cue features and used it for behavioral adaption to the relevant cue feature. Relevance weighted UPEs correlated with dorsal anterior cingulate cortex activation and hippocampus deactivation. In patients, the aberrant salience bias to subjectively task-irrelevant information was increased and correlated with decreased striatal UPE activation and increased negative symptoms. This study shows that relevance estimates based on Bayesian precision can be inferred from observed behavior. This underscores the importance of relevance detection as an underlying mechanism for behavioral adaptation in complex environments and enhances the understanding of aberrant salience in schizophrenia.

The striatum is known to play a key role in reinforcement learning, specifically in the encoding of teaching signals such as reward prediction errors (RPEs). It has been proposed that aberrant salience attribution is associated with impaired coding of RPE and heightened dopamine turnover in the striatum, and might be linked to the development of psychotic symptoms. However, the relationship of aberrant salience attribution, RPE coding, and dopamine synthesis capacity has not been directly investigated. Here we assessed the association between a behavioral measure of aberrant salience attribution, the salience attribution test, to neural correlates of RPEs measured via functional magnetic resonance imaging while healthy participants (n ϭ 58) performed an instrumental learning task. A subset of participants (n ϭ 27) also underwent positron emission tomography with the radiotracer [18 F]fluoro-L-DOPA to quantify striatal presynaptic dopamine synthesis capacity. Individual variability in aberrant salience measures related negatively to ventral striatal and prefrontal RPE signals and in an exploratory analysis was found to be positively associated with ventral striatal presynaptic dopamine levels. These data provide the first evidence for a specific link between the constructs of aberrant salience attribution, reduced RPE processing, and potentially increased presynaptic dopamine function.

Increased striatal dopamine synthesis capacity has consistently been reported in patients with schizophrenia. However, the mechanism translating this into behavior and symptoms remains unclear. It has been proposed that heightened striatal dopamine may blunt dopaminergic reward prediction error signaling during reinforcement learning. In this study, we investigated striatal dopamine synthesis capacity, reward prediction errors, and their association in unmedicated schizophrenia patients (n = 19) and healthy controls (n = 23). They took part in FDOPA-PET and underwent functional magnetic resonance imaging (fMRI) scanning, where they performed a reversal-learning paradigm. The groups were compared regarding dopamine synthesis capacity (Kicer), fMRI neural prediction error signals, and the correlation of both. Patients did not differ from controls with respect to striatal Kicer. Taking into account, comorbid alcohol abuse revealed that patients without such abuse showed elevated Kicer in the associative striatum, while those with abuse did not differ from controls. Comparing all patients to controls, patients performed worse during reversal learning and displayed reduced prediction error signaling in the ventral striatum. In controls, Kicer in the limbic striatum correlated with higher reward prediction error signaling, while there was no significant association in patients. Kicer in the associative striatum correlated with higher positive symptoms and blunted reward prediction error signaling was associated with negative symptoms. Our results suggest a dissociation between striatal subregions and symptom domains, with elevated dopamine synthesis capacity in the associative striatum contributing to positive symptoms while blunted prediction error signaling in the ventral striatum related to negative symptoms.

Appetitive Pavlovian conditioning is a learning mechanism of fundamental biological and pathophysiological significance. Nonetheless, its exploration in humans remains sparse, which is partly attributed to the lack of an established psychophysiological parameter that aptly represents conditioned responding. This study evaluated pupil diameter and other ocular response measures (gaze dwelling time, blink duration and count) as indices of conditioning. Additionally, a learning model was used to infer participants’ learning progress on the basis of their pupil dilation. Twenty‐nine healthy volunteers completed an appetitive differential delay conditioning paradigm with a primary reward, while the ocular response measures along with other psychophysiological (heart rate, electrodermal activity, postauricular and eyeblink reflex) and behavioral (ratings, contingency awareness) parameters were obtained to examine the relation among different measures. A significantly stronger increase in pupil diameter, longer gaze duration and shorter eyeblink duration was observed in response to the reward‐predicting cue compared to the control cue. The Pearce‐Hall attention model best predicted the trial‐by‐trial pupil diameter. This conditioned response was corroborated by a pronounced heart rate deceleration to the reward‐predicting cue, while no conditioning effect was observed in the electrodermal activity or startle responses. There was no discernible correlation between the psychophysiological response measures. These results highlight the potential value of ocular response measures as sensitive indices for representing appetitive conditioning.

Suspecting significance behind ordinary events is a common feature in psychosis and it is assumed to occur due to aberrant salience attribution. The Salience Attribution Test (SAT; Roiser et al., 2009) measures aberrant salience as a bias towards one out of two equally reinforced cue features as opposed to adaptive salience towards features indicating high reinforcement. This is the first study to validate the latent constructs involved in salience attribution in patients. Forty-nine schizophrenia patients and forty-four healthy individuals completed the SAT, a novel implicit salience paradigm (ISP), a reversal learning task and a neuropsychological test battery. First, groups were compared on raw measures. Second and within patients, these were correlated and then used for a principal component analysis (PCA). Third, sum scores matching the correlation and component pattern were correlated with psychopathology. Compared to healthy individuals, patients exhibited more implicit aberrant salience in the SAT and ISP and less implicit and explicit adaptive salience attribution in the SAT. Implicit aberrant salience from the SAT and ISP positively correlated with each other and negatively with reversal learning. Whereas explicit aberrant salience was associated with cognition, implicit and explicit adaptive salience were positively correlated. A similar pattern emerged in the PCA and implicit aberrant salience was associated with negative symptoms. Taken together, implicit aberrant salience from the SAT and ISP seems to reflect an automatic process that is independent from deficient salience ascription to relevant events. Its positive correlation with negative symptoms might reflect motivational deficits present in chronic schizophrenia patients.