Facial expressions yielding Context-Dependent Effect: The additive contribution of eye movements

Vakil, Eli; McDonald, Skye; Allen, Samantha K.; Vardi-Shapiro, Noa

doi:10.1016/j.actpsy.2018.11.008

Cited by 2 publications

(9 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The study included three groups: participants who studied faces with a neutral, angry, or happy expression, while at test, some of the faces were presented with the same expression as in the study, and some of the expressions were changed. It was found that maintaining the same facial expression in the study and the test was associated with better performance than changing the facial expression (Vakil et al, 2019a). These findings suggest that there is a CDE and support the approach that there is an interaction between facial identity recognition and facial expression recognition, as argued by Yankouskaya et al (2012).…”

Section: Introductionsupporting

confidence: 55%

“…Furthermore, we expected to find a difference in eye movement patterns, so that DT towards faces that were recognized correctly will be longer in the study and test phases in the two groups, as found in previous studies (Chanon & Hopfinger, 2008;Chen & Lee, 2015;Hannula et al, 2007;Ryan et al, 2007). Finally, as found in the study by Vakil et al (2019a), we expected to find a correlation between DT toward the different parts of the face and memory (d' measure).…”

Section: Introductionmentioning

confidence: 52%

“…In order to ensure that attention was directed entirely at the face, the model's hair, ears, and neck were covered with a black oval frame. This method of framing was used in a previous study (Vakil et al, 2019a). The selected faces had the required emotions (see Appendix 1, a neutral, happy, and angry face, from left to right), and did not feature distracting facial details like beards.…”

Section: Instrumentsmentioning

confidence: 99%

“…A context-dependent effect (CDE) is said to occur when memory performance is improved by the presence of a contextual stimulus. CDE have been widely documented in the human memory literature in various cognitive tasks (Peterson & Kramer, 2001;Vakil, McDonald, Allen, & Vardi-Shapiro, 2019a). This effect is considered as an implicit memory measure of context (Vakil, 2005).…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

The Effect of Facial Expressions on the Process of Learning, and Memory of Face Images among Healthy Participants and Individuals with Traumatic Brain Injury (TBI): Examination Using Eye Movements

Lugasi,

Sachar,

Vakil

2023

PSYCH

Self Cite

View full text Add to dashboard Cite

Objective: Context-Dependent Effect (CDE) is a process by which restoring at test the original learning context enhances memory. We examined the CDE of facial expressions through behavioral and eye movement measures. Participants and Method: Twenty-three healthy individuals and 23 patients with moderate-to-severe TBI individuals participated in the current study. Participants were exposed to pictures of faces with neutral expression and were asked to remember them for a subsequent memory test. In the testing session, they were asked to determine whether or not the faces presented to them had appeared before, under two conditions: 1) where the context remains constant (facial expression remained neutral-the Repeat condition); 2) where the context changes (facial expression changed to angry or happy expressionthe Re-pair condition). Results: While memory of the individuals with TBI was poorer than that of the control group, both groups exhibited CDE, that is consistency of facial expressions between study and test facilitated face recognition. In both groups, there is a relationship between Dwell Time on the faces and face recognition. This effect appeared in the study and test phases. Conclusions: This research supports previous studies showing evidence for CDE in the TBI group and extends our comprehension of the relationship between eye movements, memory, and context of facial expression.

show abstract

Section: Introductionsupporting

confidence: 55%

Section: Introductionmentioning

confidence: 52%

Section: Instrumentsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

The Effect of Facial Expressions on the Process of Learning, and Memory of Face Images among Healthy Participants and Individuals with Traumatic Brain Injury (TBI): Examination Using Eye Movements

Lugasi,

Sachar,

Vakil

2023

PSYCH

Self Cite

View full text Add to dashboard Cite

show abstract

“…Some past studies set the Areas of Interest (AOI) at the forehead, both eyes, and the mouth ( 36 ); others set them at both eyes, the nose, the mouth, and the contour ( 37 ). Figure 3 shows how AOI is set to the eyes, nose, and mouth.…”

Section: Discussionmentioning

confidence: 99%

Eye-movement analysis on facial expression for identifying children and adults with neurodevelopmental disorders

Iwauchi

Tanaka²,

Okazaki³

et al. 2023

Front. Digit. Health

View full text Add to dashboard Cite

Experienced psychiatrists identify people with autism spectrum disorder (ASD) and schizophrenia (Sz) through interviews based on diagnostic criteria, their responses, and various neuropsychological tests. To improve the clinical diagnosis of neurodevelopmental disorders such as ASD and Sz, the discovery of disorder-specific biomarkers and behavioral indicators with sufficient sensitivity is important. In recent years, studies have been conducted using machine learning to make more accurate predictions. Among various indicators, eye movement, which can be easily obtained, has attracted much attention and various studies have been conducted for ASD and Sz. Eye movement specificity during facial expression recognition has been studied extensively in the past, but modeling taking into account differences in specificity among facial expressions has not been conducted. In this paper, we propose a method to detect ASD or Sz from eye movement during the Facial Emotion Identification Test (FEIT) while considering differences in eye movement due to the facial expressions presented. We also confirm that weighting using the differences improves classification accuracy. Our data set sample consisted of 15 adults with ASD and Sz, 16 controls, and 15 children with ASD and 17 controls. Random forest was used to weight each test and classify the participants as control, ASD, or Sz. The most successful approach used heat maps and convolutional neural networks (CNN) for eye retention. This method classified Sz in adults with 64.5% accuracy, ASD in adults with up to 71.0% accuracy, and ASD in children with 66.7% accuracy. Classifying of ASD result was significantly different (p<.05) by the binomial test with chance rate. The results show a 10% and 16.7% improvement in accuracy, respectively, compared to a model that does not take facial expressions into account. In ASD, this indicates that modeling is effective, which weights the output of each image.

show abstract

Facial expressions yielding Context-Dependent Effect: The additive contribution of eye movements

Cited by 2 publications

References 44 publications

The Effect of Facial Expressions on the Process of Learning, and Memory of Face Images among Healthy Participants and Individuals with Traumatic Brain Injury (TBI): Examination Using Eye Movements

The Effect of Facial Expressions on the Process of Learning, and Memory of Face Images among Healthy Participants and Individuals with Traumatic Brain Injury (TBI): Examination Using Eye Movements

Eye-movement analysis on facial expression for identifying children and adults with neurodevelopmental disorders

Contact Info

Product

Resources

About