Learning about the world is critical to survival and success. In social animals, learning about others is a necessary component of navigating the social world, ultimately contributing to increasing evolutionary fitness. How humans and nonhuman animals represent the internal states and experiences of others has long been a subject of intense interest in the developmental psychology tradition, and, more recently, in studies of learning and decision making involving self and other. In this review, we explore how psychology conceptualizes the process of representing others, and how neuroscience has uncovered correlates of reinforcement learning signals to explore the neural mechanisms underlying social learning from the perspective of representing reward-related information about self and other. In particular, we discuss self-referenced and other-referenced types of reward prediction errors across multiple brain structures that effectively allow reinforcement learning algorithms to mediate social learning. Predictionbased computational principles in the brain may be strikingly conserved between self-referenced and other-referenced information.npj Science of Learning (2017) 2:8 ; doi:10.1038/s41539-017-0009-2 HISTORICAL PERSPECTIVES ON REPRESENTING OTHERLearning about the world and making adaptive decisions is a critical feature of cognition. This important link allows human and nonhuman animals to manipulate their environment and survive. Decision-making takes on more complex dynamics when an animal is not solitary, but lives in a community with other members of its own species. We know much about how human and nonhuman animals learn from their own actions and outcomes, and where such self-referenced information is represented in the brain. However, much less is known about the computations underlying how we learn about others. In this review, we examine the presence of other-referenced prediction errors in the brain that represent other's actions and reward outcomes.One of the first academic disciplines to attempt to understand how we develop a concept of others is developmental psychology, in which researchers often explore how babies come to understand the world.

Interpersonal interaction is the essence of human social behavior. However, conventional neuroimaging techniques have tended to focus on social cognition in single individuals rather than on dyads or groups. As a result, relatively little is understood about the neural events that underlie face-to-face interaction. We resolved some of the technical obstacles inherent in studying interaction using a novel imaging modality and aimed to identify neural mechanisms engaged both within and across brains in an ecologically valid instance of interpersonal competition. Functional near-infrared spectroscopy was utilized to simultaneously measure hemodynamic signals representing neural activity in pairs of subjects playing poker against each other (human–human condition) or against computer opponents (human–computer condition). Previous fMRI findings concerning single subjects confirm that neural areas recruited during social cognition paradigms are individually sensitive to human–human and human–computer conditions. However, it is not known whether face-to-face interactions between opponents can extend these findings. We hypothesize distributed effects due to live processing and specific variations in across-brain coherence not observable in single-subject paradigms. Angular gyrus (AG), a component of the temporal-parietal junction (TPJ) previously found to be sensitive to socially relevant cues, was selected as a seed to measure within-brain functional connectivity. Increased connectivity was confirmed between AG and bilateral dorsolateral prefrontal cortex (dlPFC) as well as a complex including the left subcentral area (SCA) and somatosensory cortex (SS) during interaction with a human opponent. These distributed findings were supported by contrast measures that indicated increased activity at the left dlPFC and frontopolar area that partially overlapped with the region showing increased functional connectivity with AG. Across-brain analyses of neural coherence between the players revealed synchrony between dlPFC and supramarginal gyrus (SMG) and SS in addition to synchrony between AG and the fusiform gyrus (FG) and SMG. These findings present the first evidence of a frontal-parietal neural complex including the TPJ, dlPFC, SCA, SS, and FG that is more active during human-to-human social cognition both within brains (functional connectivity) and across brains (across-brain coherence), supporting a model of functional integration of socially and strategically relevant information during live face-to-face competitive behaviors.

To provide new preclinical evidence toward improving the efficacy of oxytocin (OT) in treating social dysfunction, we tested the benefit of administering OT under simultaneously induced opioid antagonism during dyadic gaze interactions in monkeys. OT coadministered with a μ-opioid receptor antagonist, naloxone, invoked a supralinear enhancement of prolonged and selective social attention, producing a stronger effect than the summed effects of each administered separately. These effects were consistently observed when averaging over entire sessions, as well as specifically following events of particular social importance, including mutual eye contact and mutual reward receipt. Furthermore, attention to various facial regions was differentially modulated depending on social context. Using the Allen Institute's transcriptional atlas, we further established the colocalization of μ-opioid and κ-opioid receptor genes and OT genes at the OT-releasing sites in the human brain. These data across monkeys and humans support a regulatory relationship between the OT and opioid systems and suggest that administering OT under opioid antagonism may boost the therapeutic efficacy of OT for enhancing social cognition.T he efficacy of oxytocin (OT) in improving social abilities is under debate, largely due to frequently observed weak effect sizes and problems with replicability (1-3). Clinical trials of OT in autistic patients are ongoing, yet several studies have produced inconclusive results (4-8), demanding improvements to the efficacy and reliability of OT-based therapeutics. One strategy is to take advantage of existing physiological pathways in the brain that regulate OT activity to combinatorially enhance the oxytocinergic effects on social functions. In this regard, a promising candidate is the opioid system.In addition to the evolutionarily conserved OT system (9), the opioid system has been implicated in regulating social behavior. Excessive opioid activity in the brain has been discussed with respect to the development of early childhood autism (10). Abnormalities in central opioid levels have been observed in some individuals with autism, and clinical trials with predominantly μ-opioid blockers, such as naltrexone or naloxone (NAL), have yielded promising results in ameliorating both social and nonsocial deficits (11). Specifically, μ-opioid receptors have been studied in relation to reward, emotion, and behavior in the social domain (12) and are strongly expressed in reward-related regions of the primate brain (13). In rhesus macaques, carrying the G allele of the μ-opioid receptor gene OPRM1, compared with homozygous C alleles, is associated with stronger maternal attachment in infants (14) and more effective prevention of infant separation in mothers (15). Additionally, opioid agonists, such as morphine, decrease physical contact between social partners, whereas NAL administration increases solicitation for social contact, such as grooming and proximity (16)(17)(18)(19).The physiological relationship between the opi...

Few studies have addressed the neural computations underlying decisions made for others despite the importance of this ubiquitous behavior. Using participant-specific behavioral modeling with univariate and multivariate fMRI approaches, we investigated the neural correlates of decision-making for self and other in two independent tasks, including intertemporal and risky choice. Modeling subjective valuation indicated that participants distinguished between themselves and others with dissimilar preferences. Activity in the dorsomedial prefrontal cortex (dmPFC) and ventromedial prefrontal cortex (vmPFC) was consistently modulated by relative subjective value. Multi-voxel pattern analysis indicated that activity in the dmPFC uniquely encoded relative subjective value and generalized across self and other and across both tasks. Furthermore, agent cross-decoding accuracy between self and other in the dmPFC was related to self-reported social attitudes. These findings indicate that the dmPFC emerges as a medial prefrontal node that utilizes a task-invariant mechanism for computing relative subjective value for self and other.

The dynamic interaction of gaze between individuals is a hallmark of social cognition. However, very few studies have examined social gaze dynamics after mutual eye contact during real-time interactions. We used a highly quantifiable paradigm to assess social gaze dynamics between pairs of monkeys and modeled these dynamics using an exponential decay function to investigate sustained attention after mutual eye contact. When monkeys were interacting with real partners compared with static images and movies of the same monkeys, we found a significant increase in the proportion of fixations to the eyes and a smaller dispersion of fixations around the eyes, indicating enhanced focal attention to the eye region. Notably, dominance and familiarity between the interacting pairs induced separable components of gaze dynamics that were unique to live interactions. Gaze dynamics of dominant monkeys after mutual eye contact were associated with a greater number of fixations to the eyes, whereas those of familiar pairs were associated with a faster rate of decrease in this eye-directed attention. Our findings endorse the notion that certain key aspects of social cognition are only captured during interactive social contexts and dependent on the elapsed time relative to socially meaningful events.