Neural Representations of Faces are Tuned to Eye Movements

Stacchi, Lisa; Ramon, Meike; Lao, Junpeng; Caldara, Roberto

doi:10.1101/402263

Cited by 10 publications

(11 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…2a), we found significant individual differences in the oculomotor response to familiarity in our data (see the example in Fig. 3, see also 43 ). Using these individual oculomotor functions as a reference for comparison could be useful for two reasons.…”

Section: Discussionsupporting

confidence: 63%

Concealed information revealed by involuntary eye movements on the fringe of awareness in a mock terror experiment

Rosenzweig

Bonneh

2020

Sci Rep

View full text Add to dashboard Cite

personal knowledge, without a report, to prevent deception, and to bypass an inability to report. During CIT, subjects are exposed to repeated serial stimuli, including both natural stimuli and personally significant items (termed "probes"), while their physiological response is measured and averaged in order to detect oddball effects in response to the probes (CIT Protocol). It is assumed that the probes elicit an orienting response due to their deviant appearance as familiar and significant 19-21. In addition to orienting, there is evidence of an arousal inhibition effect that is applied by the subjects to conceal their orienting activity, and its measure is used for detecting deception 22. Typically, CIT measures physiological responses such as heart rate and skin conductance 19 , neural responses, primarily the P300 brain wave 23 , as well as eye movements, eye blinks, and pupil dilation 24-27. These measures typically require a serial repetitive presentation for averaging; as a result, false positives could occur due to an arbitrary orienting and to the observer's fatigue as well as biological noise, affecting the signal-to-noise ratio (SNR) as in the P300 BCI methods 28. This suggests that a possible tradeoff exists between accuracy and susceptibility to deception using CIT methods, as ways to increase the SNR such as longer exposures or more repetitions for averaging, could provide more opportunities for deception (e.g. 29).

show abstract

Section: Discussionsupporting

confidence: 63%

Concealed information revealed by involuntary eye movements on the fringe of awareness in a mock terror experiment

Rosenzweig

Bonneh

2020

Sci Rep

View full text Add to dashboard Cite

show abstract

“…The reliability of the (right) occipito‐temporal topography of the FI response was also tested by Stacchi, Ramon, Lao, and Caldara (2019), after an even longer interval, 6 months, between recording sessions. These authors additionally manipulated the fixation position across various locations of the face (e.g., left eye, right eye, nose) to take into account idiosyncrasies in preferred fixation position during face identity processing (e.g., Peterson & Eckstein, 2013).…”

Section: Advantages Of the Approachmentioning

confidence: 99%

“…The FI response varies substantially across individuals in terms of scalp EEG amplitude (e.g., Dzhelyova et al, 2019; Liu‐Shuang et al., 2014; Stacchi, Liu‐Shuang, Ramon, & Caldara, 2019; Stacchi, Ramon, et al, 2019; Xu et al., 2017; Figures 7d and 12a), ranging between ~0.25 and 4 µV in our large‐scale group analysis ( N = 130; again, see Appendix S1). Thus, individuals can have up to over tenfold differences in their FI response amplitude.…”

Section: Insights Into Face Individuationmentioning

confidence: 99%

“…For example, we have mostly used color stimuli in our studies, but how this factor contributes to the FI response is unclear and should be evaluated in future studies. Similarly, we regularly enforce nasion fixation (in line with Peterson & Eckstein, 2012), but this may not be necessary, or perhaps may even be suboptimal for some individuals (Blais, Jack, Scheepers, Fiset, & Caldara, 2008; Peterson & Eckstein, 2013; Stacchi, Ramon, et al, 2019). As mentioned above, introducing variability to the base and oddball face images, for example, in terms of viewpoint, would enable testing the extent of generalization of FI for unfamiliar faces (Damon et al., 2020).…”

Section: Conclusion and Future Applicationsmentioning

confidence: 99%

See 1 more Smart Citation

Understanding human individuation of unfamiliar faces with oddball fast periodic visual stimulation and electroencephalography

Rossion

Retter

Liu‐Shuang³

2020

Eur J of Neuroscience

View full text Add to dashboard Cite

To investigate face individuation (FI), a critical brain function in the human species, an oddball fast periodic visual stimulation (FPVS) approach was recently introduced (Liu‐Shuang et al., Neuropsychologia, 2014, 52, 57). In this paradigm, an image of an unfamiliar “base” facial identity is repeated at a rapid rate F (e.g., 6 Hz) and different unfamiliar “oddball” facial identities are inserted every nth item, at a F/n rate (e.g., every 5th item, 1.2 Hz). This stimulation elicits FI responses at F/n and its harmonics (2F/n, 3F/n, etc.), reflecting neural discrimination between oddball versus base facial identities, which is quantified in the frequency domain of the electroencephalogram (EEG). This paradigm, used in 20 published studies, demonstrates substantial advantages for measuring FI in terms of validity, objectivity, reliability, and sensitivity. Human intracerebral recordings suggest that this FI response originates from neural populations in the lateral inferior occipital and fusiform gyri, with a right hemispheric dominance consistent with the localization of brain lesions specifically affecting facial identity recognition (prosopagnosia). Here, we summarize the contributions of the oddball FPVS framework toward understanding FI, including its (a)typical development, with early studies supporting the application of this technique to clinical testing (e.g., autism spectrum disorder). This review also includes an in‐depth analysis of the paradigm's methodology, with guidelines for designing future studies. A large‐scale group analysis compiling data across 130 observers provides insights into the oddball FPVS FI response properties. Overall, we recommend the oddball FPVS paradigm as an alternative approach to behavioral or traditional event‐related potential EEG measures of face individuation.

show abstract

“…Computational models show that the theoretically optimal alignment occurs when fixation is directed toward a region between the eyes and the nose tip (Or et al, 2015;Peterson & Eckstein, 2012Tsank & Eckstein, 2017). NT individuals preferentially fixate this region, and both recognition performance (de Haas & Schwarzkopf, 2018;Or et al, 2015;Peterson & Eckstein, 2012Peterson et al, 2016) and the response of face-selective cortical regions (de Haas et al, 2016;Zerouali, Lina, & Jemel, 2013;Stacchi, Ramon, Lao, & Caldara, 2019) are maximized when fixating near the theoretical optimum location. The Poor Information Hypothesis holds that individuals with DP fixate outside the optimal region, directly impairing face recognition accuracy through a reduction in the quality of information entering cortex.…”

Section: Poor Information Hypothesismentioning

confidence: 99%

Eye movements and retinotopic tuning in developmental prosopagnosia

et al. 2019

View full text Add to dashboard Cite

Despite extensive investigation, the causes and nature of developmental prosopagnosia (DP)-a severe face identification impairment in the absence of acquired brain injury-remain poorly understood. Drawing on previous work showing that individuals identified as being neurotypical (NT) show robust individual differences in where they fixate on faces, and recognize faces best when the faces are presented at this location, we defined and tested four novel hypotheses for how atypical face-looking behavior and/or retinotopic face encoding could impair face recognition in DP: (a) fixating regions of poor information, (b) inconsistent saccadic targeting, (c) weak retinotopic tuning, and (d) fixating locations not matched to the individual's own face tuning. We found no support for the first three hypotheses, with NTs and DPs consistently fixating similar locations and showing similar retinotopic tuning of their face perception performance. However, in testing the fourth hypothesis, we found preliminary evidence for two distinct phenotypes of DP: (a) Subjects characterized by impaired face memory, typical face perception, and a preference to look high on the face, and (b) Subjects characterized by profound impairments to both face memory and perception and a preference to look very low on the face. Further, while all NTs and upper-looking DPs performed best when faces were presented near their preferred fixation location, this was not true for lower-looking DPs. These results suggest that face recognition deficits in a substantial proportion of people with DP may arise not from aberrant face gaze or compromised retinotopic tuning, but from the suboptimal matching of gaze to tuning.

show abstract

Neural Representations of Faces are Tuned to Eye Movements

Cited by 10 publications

References 32 publications

Concealed information revealed by involuntary eye movements on the fringe of awareness in a mock terror experiment

Concealed information revealed by involuntary eye movements on the fringe of awareness in a mock terror experiment

Understanding human individuation of unfamiliar faces with oddball fast periodic visual stimulation and electroencephalography

Eye movements and retinotopic tuning in developmental prosopagnosia

Contact Info

Product

Resources

About