Mammals adapt to a rapidly changing world because of the sophisticated cognitive functions that are supported by the neocortex. The neocortex, which forms almost 80% of the human brain, seems to have arisen from repeated duplication of a stereotypical microcircuit template with subtle specializations for different brain regions and species. The quest to unravel the blueprint of this template started more than a century ago and has revealed an immensely intricate design. The largest obstacle is the daunting variety of inhibitory interneurons that are found in the circuit. This review focuses on the organizing principles that govern the diversity of inhibitory interneurons and their circuits.

A key challenge for neural modeling is to explain how a continuous stream of multimodal input from a rapidly changing environment can be processed by stereotypical recurrent circuits of integrate-and-fire neurons in real time. We propose a new computational model for real-time computing on time-varying input that provides an alternative to paradigms based on Turing machines or attractor neural networks. It does not require a task-dependent construction of neural circuits. Instead, it is based on principles of high-dimensional dynamical systems in combination with statistical learning theory and can be implemented on generic evolved or found recurrent circuitry. It is shown that the inherent transient dynamics of the high-dimensional dynamical system formed by a sufficiently large and heterogeneous neural circuit may serve as universal analog fading memory. Readout neurons can learn to extract in real time from the current state of such recurrent neural circuit information about current and past inputs that may be needed for diverse tasks. Stable internal states are not required for giving a stable output, since transient internal states can be transformed by readout neurons into stable target outputs due to the high dimensionality of the dynamical system. Our approach is based on a rigorous computational model, the liquid state machine, that, unlike Turing machines, does not require sequential transitions between well-defined discrete internal states. It is supported, as the Turing machine is, by rigorous mathematical results that predict universal computational power under idealized conditions, but for the biologically more realistic scenario of real-time processing of time-varying inputs. Our approach provides new perspectives for the interpretation of neural coding, the design of experiments and data analysis in neurophysiology, and the solution of problems in robotics and neurotechnology.

VIDEO ABSTRACT.

Although signaling between neurons is central to the functioning of the brain, we still do not understand how the code used in signaling depends on the properties of synaptic transmission. Theoretical analysis combined with patch clamp recordings from pairs of neocortical pyramidal neurons revealed that the rate of synaptic depression, which depends on the probability of neurotransmitter release, dictates the extent to which firing rate and temporal coherence of action potentials within a presynaptic population are signaled to the postsynaptic neuron. The postsynaptic response primarily reflects rates of firing when depression is slow and temporal coherence when depression is fast. A wide range of rates of synaptic depression between different pairs of pyramidal neurons was found, suggesting that the relative contribution of rate and temporal signals varies along a continuum. We conclude that by setting the rate of synaptic depression, release probability is an important factor in determining the neural code.

The nature of information stemming from a single neuron and conveyed simultaneously to several hundred target neurons is not known. Triple and quadruple neuron recordings revealed that each synaptic connection established by neocortical pyramidal neurons is potentially unique. Specifically, synaptic connections onto the same morphological class differed in the numbers and dendritic locations of synaptic contacts, their absolute synaptic strengths, as well as their rates of synaptic depression and recovery from depression. The same axon of a pyramidal neuron innervating another pyramidal neuron and an interneuron mediated frequency-dependent depression and facilitation, respectively, during high frequency discharges of presynaptic action potentials, suggesting that the different natures of the target neurons underlie qualitative differences in synaptic properties. Facilitating-type synaptic connections established by three pyramidal neurons of the same class onto a single interneuron, were all qualitatively similar with a combination of facilitation and depression mechanisms. The time courses of facilitation and depression, however, differed for these convergent connections, suggesting that different prepostsynaptic interactions underlie quantitative differences in synaptic properties. Mathematical analysis of the transfer functions of frequency-dependent synapses revealed supralinear, linear, and sub-linear signaling regimes in which mixtures of presynaptic rates, integrals of rates, and derivatives of rates are transferred to targets depending on the precise values of the synaptic parameters and the history of presynaptic action potential activity. Heterogeneity of synaptic transfer functions therefore allows multiple synaptic representations of the same presynaptic action potential train and suggests that these synaptic representations are regulated in a complex manner. It is therefore proposed that differential signaling is a key mechanism in neocortical information processing, which can be regulated by selective synaptic modifications.Neuronal signaling in the neocortex has been the subject of extensive debate (1-3). One approach to this problem is to determine how frequency-dependent changes in synaptic transmission dictate which features of action potentials (APs) trains are transmitted effectively to the postsynaptic neuron (4-6). This characterization of the input (AP) and the output (synaptic response) properties allows assessment of the transfer function of synaptic connections. It has been reported in several nonmammalian systems that synaptic responses via the same axon onto different types of targets can display different frequency-dependent properties (7-12). Dual recordings in the neocortex have revealed that synaptic connections from pyramidal neurons onto some classes of interneurons can display frequency-dependent facilitation whereas transmission onto pyramidal neurons typically displays depression (13-14), suggesting that differential transmission is also likely in mammalian neocortex...

of the contacts of a connection varied between 80 and 585 ,um (mean, 147 /sm; median, 105 ,um). The correlation between EPSP amplitude and the number of morphologically determined synaptic contacts or the mean geometric distances from the soma was only weak (correlation coefficients were 0-2 and 0-26, respectively).7. Compartmental models constructed from camera lucida drawings of eight target neurones showed that synaptic contacts were located at mean electrotonic distances between 0 07 and 0 33 from the soma (mean, 0-13). Simulations of unitary EPSPs, assuming quantal conductance changes with fast rise time and short duration, indicated that amplitudes of quantal EPSPs at the soma were attenuated, on average, to < 10% of dendritic EPSPs and varied in amplitude up to 10-fold depending on the dendritic location of synaptic contacts. The inferred quantal peak conductance increase varied between 1.5 and 5.5 nS (mean, 3 nS).8. The combined physiological and morphological measurements in conjunction with EPSP simulations indicated that the 20-fold range in efficacy of the synaptic connections between thick tufted pyramidal neurones, which have their synaptic contacts preferentially located on basal and apical oblique dendrites, was due to differences in transmitter release probability of the projecting neurones and, to a lesser extent, to differences in the number of release sites per bouton or quantal size. 9. The continuum of efficacies in their synaptic connections implies that layer 5 pyramidal neurones can be recruited to ensemble electrical activity via their axon collaterals if as few as five of the strongly and reliably connected neighbouring neurones are active synchronously, whereas coincident APs of as many as 100 of the weakly connected pyramidal neurones are necessary.

Transmission across neocortical synapses depends on the frequency of presynaptic activity (Thomson & Deuchars, 1994). Interpyramidal synapses in layer V exhibit fast depression of synaptic transmission, while other types of synapses exhibit facilitation of transmission. To study the role of dynamic synapses in network computation, we propose a unified phenomenological model that allows computation of the postsynaptic current generated by both types of synapses when driven by an arbitrary pattern of action potential (AP) activity in a presynaptic population. Using this formalism, we analyze different regimes of synaptic transmission and demonstrate that dynamic synapses transmit different aspects of the presynaptic activity depending on the average presynaptic frequency. The model also allows for derivation of mean-field equations, which govern the activity of large, interconnected networks. We show that the dynamics of synaptic transmission results in complex sets of regular and irregular regimes of network activity.

Reliable activation of inhibitory pathways is essential for maintaining the balance between excitation and inhibition during cortical activity. Little is known, however, about the activation of these pathways at the level of the local neocortical microcircuit. We report a disynaptic inhibitory pathway among neocortical pyramidal cells (PCs). Inhibitory responses were evoked in layer 5 PCs following stimulation of individual neighboring PCs with trains of action potentials. The probability for inhibition between PCs was more than twice that of direct excitation, and inhibitory responses increased as a function of rate and duration of presynaptic discharge. Simultaneous somatic and dendritic recordings indicated that inhibition originated from PC apical and tuft dendrites. Multineuron whole-cell recordings from PCs and interneurons combined with morphological reconstructions revealed the mediating interneurons as Martinotti cells. Martinotti cells received facilitating synapses from PCs and formed reliable inhibitory synapses onto dendrites of neighboring PCs. We describe this feedback pathway and propose it as a central mechanism for regulation of cortical activity.