Video games are an exciting part of new media. Although game play has been intensively studied, the underlying neurobiology is still poorly understood. Flow theory is a well-established model developed to describe subjective game experience. In 13 healthy male subjects, we acquired fMRI data during free play of a video game and analyzed brain activity based on the game content. In accordance with flow theory, we extracted the following factors from the game content: (i) balance between ability and challenge; (ii) concentration and focus; (iii) direct feedback of action results; (iv) clear goals; and (v) control over the situation/activity. We suggest that flow is characterized by specific neural activation patterns and that the latter can be assessed-at least partially-by content factors contributing to the emergence of flow. Each of the content factors was characterized by specific and distinguishable brain activation patterns, encompassing reward-related midbrain structures, as well as cognitive and sensorimotor networks. The activation of sensory and motor networks in the conjunction analyses underpinned the central role of simulation for flow experience. Flow factors can be validated with functional brain imaging which can improve the understanding of human emotions and motivational processes during media entertainment.

Supramodal representation of emotion and its neural substrates have recently attracted attention as a marker of social cognition. However, the question whether perceptual integration of facial and vocal emotions takes place in primary sensory areas, multimodal cortices, or in affective structures remains unanswered yet. Using novel computer-generated stimuli, we combined emotional faces and voices in congruent and incongruent ways and assessed functional brain data (fMRI) during an emotional classification task. Both congruent and incongruent audiovisual stimuli evoked larger responses in thalamus and superior temporal regions compared with unimodal conditions. Congruent emotions were characterized by activation in amygdala, insula, ventral posterior cingulate (vPCC), temporo-occipital, and auditory cortices; incongruent emotions activated a frontoparietal network and bilateral caudate nucleus, indicating a greater processing load in working memory and emotion-encoding areas. The vPCC alone exhibited differential reactions to congruency and incongruency for all emotion categories and can thus be considered a central structure for supramodal representation of complex emotional information. Moreover, the left amygdala reflected supramodal representation of happy stimuli. These findings document that emotional information does not merge at the perceptual audiovisual integration level in unimodal or multimodal areas, but in vPCC and amygdala.

Mental imagery is a complex cognitive process that resembles the experience of perceiving an object when this object is not physically present to the senses. It has been shown that, depending on the sensory nature of the object, mental imagery also involves correspondent sensory neural mechanisms. However, it remains unclear which areas of the brain subserve supramodal imagery processes that are independent of the object modality, and which brain areas are involved in modality-specific imagery processes. Here, we conducted a functional magnetic resonance imaging study to reveal supramodal and modality-specific networks of mental imagery for auditory and visual information. A common supramodal brain network independent of imagery modality, two separate modality-specific networks for imagery of auditory and visual information, and a common deactivation network were identified. The supramodal network included brain areas related to attention, memory retrieval, motor preparation and semantic processing, as well as areas considered to be part of the default-mode network and multisensory integration areas. The modality-specific networks comprised brain areas involved in processing of respective modality-specific sensory information. Interestingly, we found that imagery of auditory information led to a relative deactivation within the modality-specific areas for visual imagery, and vice versa. In addition, mental imagery of both auditory and visual information widely suppressed the activity of primary sensory and motor areas, for example deactivation network. These findings have important implications for understanding the mechanisms that are involved in generation of mental imagery.

Cognitive functioning is impaired in patients with schizophrenia, leading to significant disabilities in everyday functioning. Its improvement is an important treatment target. Neurofeedback (NF) seems a promising method to address the neural dysfunctions underlying those cognitive impairments. The anterior cingulate cortex (ACC), a central hub for cognitive processing, is one of the brain regions known to be dysfunctional in schizophrenia. Here we conducted NF training based on real-time functional magnetic resonance imaging (fMRI) in patients with schizophrenia to enable them to control their ACC activity. Training was performed over 3 days in a group of 11 patients with schizophrenia and 11 healthy controls. Social feedback was provided in accordance with the evoked activity in the selected region of interest (ROI). Neural and cognitive strategies were examined off-line. Both groups learned to control the activity of their ACC but used different neural strategies: patients activated the dorsal and healthy controls the rostral subdivision. Patients mainly used imagination of music to elicit activity and the control group imagination of sports. In a stepwise regression analysis, the difference in neural control did not result from the differences in cognitive strategies but from diagnosis alone. Based on social reinforcers, patients with schizophrenia can learn to regulate localized brain activity. However, cognitive strategies and neural network location differ from healthy controls. These data emphasize that for therapeutic interventions in patients with schizophrenia compensatory strategies may emerge. Specific cognitive skills or specific dysfunctional networks should be addressed to train impaired skills. Social NF based on fMRI may be one method to accomplish precise learning targets.

No abstract

BackgroundViolent content in video games evokes many concerns but there is little research concerning its rewarding aspects. It was demonstrated that playing a video game leads to striatal dopamine release. It is unclear, however, which aspects of the game cause this reward system activation and if violent content contributes to it. We combined functional Magnetic Resonance Imaging (fMRI) with individual affect measures to address the neuronal correlates of violence in a video game.ResultsThirteen male German volunteers played a first-person shooter game (Tactical Ops: Assault on Terror) during fMRI measurement. We defined success as eliminating opponents, and failure as being eliminated themselves. Affect was measured directly before and after game play using the Positive and Negative Affect Schedule (PANAS). Failure and success events evoked increased activity in visual cortex but only failure decreased activity in orbitofrontal cortex and caudate nucleus. A negative correlation between negative affect and responses to failure was evident in the right temporal pole (rTP).ConclusionsThe deactivation of the caudate nucleus during failure is in accordance with its role in reward-prediction error: it occurred whenever subject missed an expected reward (being eliminated rather than eliminating the opponent). We found no indication that violence events were directly rewarding for the players. We addressed subjective evaluations of affect change due to gameplay to study the reward system. Subjects reporting greater negative affect after playing the game had less rTP activity associated with failure. The rTP may therefore be involved in evaluating the failure events in a social context, to regulate the players' mood.

Neurofeedback (NF) based on real-time functional magnetic resonance imaging (rt-fMRI) allows voluntary regulation of the activity in a selected brain region. For the training of this regulation, a well-designed feedback system is required. Social reward may serve as an effective incentive in NF paradigms, but its efficiency has not yet been tested. Therefore, we developed a social reward NF paradigm and assessed it in comparison with a typical visual NF paradigm (moving bar). We trained twenty-four healthy participants, on three consecutive days, to control activation in dorsal anterior cingulate cortex (ACC) with fMRI-based NF. In the social feedback group, an avatar gradually smiled when ACC activity increased, whereas in the standard feedback group, a moving bar indicated the activation level. In order to assess a transfer of the NF training both groups were asked to up-regulate their brain activity without receiving feedback immediately before and after the NF training (pre- and post-test). Finally, the effect of the acquired NF training on ACC function was evaluated in a cognitive interference task (Simon task) during the pre- and post-test. Social reward led to stronger activity in the ACC and reward-related areas during the NF training when compared to standard feedback. After the training, both groups were able to regulate ACC without receiving feedback, with a trend for stronger responses in the social feedback group. Moreover, despite a lack of behavioral differences, significant higher ACC activations emerged in the cognitive interference task, reflecting a stronger generalization of the NF training on cognitive interference processing after social feedback. Social reward can increase self-regulation in fMRI-based NF and strengthen its effects on neural processing in related tasks, such as cognitive interference. A particular advantage of social feedback is that a direct external reward is provided as in natural social interactions, opening perspectives for implicit learning paradigms.

The current study provides further evidence for a general age and gender effect on emotion recognition; the advantage of females seems to be age- and stimulus modality-dependent.