Primates recognize complex objects such as faces with remarkable speed and reliability. Here, we reveal the brain's code for facial identity. Experiments in macaques demonstrate an extraordinarily simple transformation between faces and responses of cells in face patches. By formatting faces as points in a high-dimensional linear space, we discovered that each face cell's firing rate is proportional to the projection of an incoming face stimulus onto a single axis in this space, allowing a face cell ensemble to encode the location of any face in the space. Using this code, we could precisely decode faces from neural population responses and predict neural firing rates to faces. Furthermore, this code disavows the long-standing assumption that face cells encode specific facial identities, confirmed by engineering faces with drastically different appearance that elicited identical responses in single face cells. Our work suggests that other objects could be encoded by analogous metric coordinate systems. PAPERCLIP.
For efficient coding, sensory systems need to adapt to the distribution of signals to which they are exposed. In vision, natural scenes above and below the horizon differ in the distribution of chromatic and achromatic features. Consequently, many species differentially sample light in the sky and on the ground using an asymmetric retinal arrangement of short- (S, "blue") and medium- (M, "green") wavelength-sensitive photoreceptor types. Here, we show that in mice this photoreceptor arrangement provides for near-optimal sampling of natural achromatic contrasts. Two-photon population imaging of light-driven calcium signals in the synaptic terminals of cone-photoreceptors expressing a calcium biosensor revealed that S, but not M cones, preferred dark over bright stimuli, in agreement with the predominance of dark contrasts in the sky but not on the ground. Therefore, the different cone types do not only form the basis of "color vision," but in addition represent distinct (achromatic) contrast-selective channels.
Retinal specializations such as cone-photoreceptor opsin-expression gradients, as found in several vertebrate species, are intuitively considered detrimental to color vision. In mice, the majority of cones coexpress both "blue" and "green" opsin. The coexpression ratio changes along the dorsoventral axis, resulting in a "green"-dominant dorsal and a "blue"-dominant ventral retina. Here, we asked how these specializations affect chromatic processing, especially with respect to the opsin transitional zone, the band where opsin coexpression shifts from "green" to "blue." Using electrophysiology, modeling, and calcium imaging, we found that "alpha-like" retinal ganglion cells, which previously have not been implicated in chromatic processing, display color-opponent responses when located in the vicinity of the opsin transitional zone. Moreover, direction-selective ganglion cells within this zone respond differentially to color sequences. Our data suggest that the dorsoventral opsin distribution, in combination with conventional spatiotemporal processing, renders mouse ganglion cell responses color-opponent without requiring cone-type selective connectivity.
What is the range of stimuli encoded by face-selective regions of the brain? We asked how electrical microstimulation of face patches in macaque inferotemporal cortex affects perception of faces and objects. We found that microstimulation strongly distorted face percepts and that this effect depended on precise targeting to the center of face patches. While microstimulation had no effect on the percept of many non-face objects, it did affect the percept of some, including non-face objects whose shape is consistent with a face (for example, apples) as well as somewhat facelike abstract images (for example, cartoon houses). Microstimulation even perturbed the percept of certain objects that did not activate the stimulated face patch at all. Overall, these results indicate that representation of facial identity is localized to face patches, but activity in these patches can also affect perception of face-compatible non-face objects, including objects normally represented in other parts of inferotemporal cortex.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.