How do humans learn from raw sensory experience? Throughout life, but most obviously in infancy, we learn without explicit instruction. We propose a detailed biological mechanism for the widely embraced idea that learning is driven by the differences between predictions and actual outcomes (i.e., predictive error-driven learning). Specifically, numerous weak projections into the pulvinar nucleus of the thalamus generate top–down predictions, and sparse driver inputs from lower areas supply the actual outcome, originating in Layer 5 intrinsic bursting neurons. Thus, the outcome representation is only briefly activated, roughly every 100 msec (i.e., 10 Hz, alpha), resulting in a temporal difference error signal, which drives local synaptic changes throughout the neocortex. This results in a biologically plausible form of error backpropagation learning. We implemented these mechanisms in a large-scale model of the visual system and found that the simulated inferotemporal pathway learns to systematically categorize 3-D objects according to invariant shape properties, based solely on predictive learning from raw visual inputs. These categories match human judgments on the same stimuli and are consistent with neural representations in inferotemporal cortex in primates.

Standard methods in deep learning for natural language processing fail to capture the compositional structure of human language that allows for systematic generalization outside of the training distribution. However, human learners readily generalize in this way, e.g. by applying known grammatical rules to novel words. Inspired by work in cognitive science suggesting a functional distinction between systems for syntactic and semantic processing, we implement a modification to an existing approach in neural machine translation, imposing an analogous separation between alignment and translation. The resulting architecture substantially outperforms standard recurrent networks on the SCAN dataset, a compositional generalization task, without any additional supervision. Our work suggests that learning to align and to translate in separate modules may be a useful heuristic for capturing compositional structure.

A hallmark of human intelligence is the ability to adapt to new situations by applying learned rules to new content (systematicity) and thereby enabling an open-ended number of inferences and actions (generativity). Here, we propose that the human brain accomplishes these feats through pathways in the parietal cortex that encode the abstract structure of space, events, and tasks and pathways in the temporal cortex that encode information about specific people, places, and things (content). Recent neural network models show how the separation of structure and content might emerge through a combination of architectural biases and learning, and these networks show dramatic improvements over previous models in the ability to capture systematic, generative behavior. We close by considering how the hippocampal formation may form integrative memories that enable rapid learning of new structure and content representations.

Fragile X syndrome (FXS) is caused by silencing of the FMR1 gene and consequent absence of its protein product, fragile X mental retardation protein (FMRP). FMRP is an RNA‐binding protein that can suppress translation. The absence of FMRP leads to symptoms of FXS including intellectual disability and has been proposed to lead to abnormalities in synaptic plasticity. Synaptic plasticity, protein synthesis, and cellular growth pathways have been studied extensively in hippocampal slices from a mouse model of FXS (Fmr1 KO). Enhanced metabotropic glutamate receptor 5 (mGluR5)‐dependent long‐term depression (LTD), increased rates of protein synthesis, and effects on signaling molecules have been reported. These phenotypes were found under amino acid starvation, a condition that has widespread, powerful effects on activation and translation of proteins involved in regulating protein synthesis. We asked if this non‐physiological condition could have effects on Fmr1 KO phenotypes reported in hippocampal slices. We performed hippocampal slice experiments in the presence and absence of amino acids. We measured rates of incorporation of a radiolabeled amino acid into protein to determine protein synthesis rates. By means of western blots, we assessed relative levels of total and phosphorylated forms of proteins involved in signaling pathways regulating translation. We measured evoked field potentials in area CA1 to assess the strength of the long‐term depression response to mGluR activation. In the absence of amino acids, we replicate many of the reported findings in Fmr1 KO hippocampal slices, but in the more physiological condition of inclusion of amino acids in the medium, we did not find evidence of enhanced mGluR5‐dependent LTD. Activation of mGluR5 increased protein synthesis in both wild type and Fmr1 KO. Moreover, mGluR5 activation increased eIF2α phosphorylation and decreased phosphorylation of p70S6k in slices from Fmr1 KO. We propose that the eIF2α response is a cellular attempt to compensate for the lack of regulation of translation by FMRP. Our findings call for a re‐examination of the mGluR theory of FXS.