No abstract

No abstract

We used ERPs to investigate neural correlates of face learning. At learning, participants viewed video clips of unfamiliar people, which were presented either with or without voices providing semantic information. In a subsequent face-recognition task (four trial blocks), learned faces were repeated once per block and presented interspersed with novel faces. To disentangle face from image learning, we used different images for face repetitions. Block effects demonstrated that engaging in the face-recognition task modulated ERPs between 170 and 900 msec poststimulus onset for learned and novel faces. In addition, multiple repetitions of different exemplars of learned faces elicited an increased bilateral N250. Source localizations of this N250 for learned faces suggested activity in fusiform gyrus, similar to that found previously for N250r in repetition priming paradigms [Schweinberger, S. R., Pickering, E. C., Jentzsch, I., Burton, A. M., & Kaufmann, J. M. Event-related brain potential evidence for a response of inferior temporal cortex to familiar face repetitions. Cognitive Brain Research, 14, 398-409, 2002]. Multiple repetitions of learned faces also elicited increased central-parietal positivity between 400 and 600 msec and caused a bilateral increase of inferior-temporal negativity (>300 msec) compared with novel faces. Semantic information at learning enhanced recognition rates. Faces that had been learned with semantic information elicited somewhat less negative amplitudes between 700 and 900 msec over left inferior-temporal sites. Overall, the findings demonstrate a role of the temporal N250 ERP in the acquisition of new face representations across different images. They also suggest that, compared with visual presentation alone, additional semantic information at learning facilitates postperceptual processing in recognition but does not facilitate perceptual analysis of learned faces.

Participants are more accurate at remembering faces of their own relative to another ethnic group (own-race bias, ORB). This phenomenon has been explained by reduced perceptual expertise, or alternatively, by the categorization of other-race faces into social out-groups and reduced effort to individuate such faces. We examined event-related potential (ERP) correlates of the ORB, testing recognition memory for Asian and Caucasian faces in Caucasian and Asian participants. Both groups demonstrated a significant ORB in recognition memory. ERPs revealed more negative N170 amplitudes for other-race faces in both groups, probably reflecting more effortful structural encoding. Importantly, the ethnicity effect in left-hemispheric N170 during learning correlated significantly with the behavioral ORB. Similarly, in the subsequent N250, both groups demonstrated more negative amplitudes for other-race faces, and during test phases, this effect correlated significantly with the ORB. We suggest that ethnicity effects in the N170 reflect an early categorization of other-race faces into a social out-group, resulting in less efficient encoding and thus decreased memory. Moreover, ethnicity effects in the N250 may represent the "tagging" of other-race faces as perceptually salient, which hampers the recognition of these faces.

Face recognition is a remarkable human ability, which underlies a great deal of our social behaviour. We can recognize family members, friends and acquaintances over a very large range of conditions, and yet the processes by which we do this remain poorly understood, despite decades of research. Although a detailed understanding remains elusive, face recognition is widely thought to rely on Ôconfigural processingÕ, specifically an analysis of spatial relations between facial features (so-called second-order configurations). In this paper, we challenge this traditional view, raising four problems: (i) configural theories are underspecified; (ii) large configural changes leave recognition unharmed; (iii) recognition is harmed by non-configural changes; (iv) in separate analyses of face-shape and face-texture, identification tends to be dominated by texture. We review evidence from a variety of sources and suggest that failure to acknowledge the impact of familiarity on facial representations may have led to an overgeneralization of the configural account. We argue instead that second-order configural information is remarkably unimportant for familiar face recognition.

Face recognition has been assumed to be independent of facial expression. We used familiar and unfamiliar faces that were morphed from a happy to an angry expression within a given identity. Participants performed speeded two-choice decisions according to whether or not a face was familiar. Consistent with earlier findings, reaction times for classifications of unfamiliar faces were independent of facial expressions. In contrast, expression clearly influenced the recognition of familiar faces. with fastest recognition for moderately happy expressions. This suggests that representations of familiar faces for recognition preserve some information about typical emotional expressions.

Perceptual aftereffects following adaptation to simple stimulus attributes (e.g., motion, color) have been studied for hundreds of years. A striking recent discovery was that adaptation also elicits contrastive aftereffects in visual perception of complex stimuli and faces [1-6]. Here, we show for the first time that adaptation to nonlinguistic information in voices elicits systematic auditory aftereffects. Prior adaptation to male voices causes a voice to be perceived as more female (and vice versa), and these auditory aftereffects were measurable even minutes after adaptation. By contrast, crossmodal adaptation effects were absent, both when male or female first names and when silently articulating male or female faces were used as adaptors. When sinusoidal tones (with frequencies matched to male and female voice fundamental frequencies) were used as adaptors, no aftereffects on voice perception were observed. This excludes explanations for the voice aftereffect in terms of both pitch adaptation and postperceptual adaptation to gender concepts and suggests that contrastive voice-coding mechanisms may routinely influence voice perception. The role of adaptation in calibrating properties of high-level voice representations indicates that adaptation is not confined to vision but is a ubiquitous mechanism in the perception of nonlinguistic social information from both faces and voices.

While audiovisual integration is well known in speech perception, faces and speech are also informative with respect to speaker recognition. To date, audiovisual integration in the recognition of familiar people has never been demonstrated. Here we show systematic benefits and costs for the recognition of familiar voices when these are combined with time-synchronized articulating faces, of corresponding or noncorresponding speaker identity, respectively. While these effects were strong for familiar voices, they were smaller or nonsignificant for unfamiliar voices, suggesting that the effects depend on the previous creation of a multimodal representation of a person's identity. Moreover, the effects were reduced or eliminated when voices were combined with the same faces presented as static pictures, demonstrating that the effects do not simply reflect the use of facial identity as a "cue" for voice recognition. This is the first direct evidence for audiovisual integration in person recognition.