Object identification in cerebral visual impairment characterized by gaze behavior and image saliency analysis

Manley, Claire E.; Walter, Kerri; Micheletti, Serena; Tietjen, Matthew; Cantillon, Emily; Fazzi, Elisa; Bex, Peter J.; Merabet, Lotfi B.

doi:10.1016/j.braindev.2023.05.001

Cited by 3 publications

(3 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…lower associated ROC scores) for the image semantics (GloVe) model compared to controls, given that the image semantics are assumed to be driven by higher-order processing cues. Accordingly, we also expected image salience (GBVS) predictions would be worse, as previous work by our group has demonstrated that individuals with CVI used image salience cues significantly less compared to controls when identifying familiar objects 51 . In this study, we found that controls had higher ROC scores for both the image salience and image semantic predictions.…”

Section: Discussionmentioning

confidence: 92%

“…The process included a 7-point calibration task (screen positions: top-left, top-center, top-right, bottom-left, bottom-center, bottom-right, and center-center) followed by a 9-point post calibration verification (i.e., the same 7 calibration points plus center-left and center-right positions). Accuracy criterion was defined by gaze fixation falling within a 2.25 arc degree radius around each of the 9 screen positions and confirmed by visual inspection prior to data collection (testing procedure description taken from previous studies by our group 46 , 47 , 51 ).…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Visual search patterns during exploration of naturalistic scenes are driven by saliency cues in individuals with cerebral visual impairment

Walter,

Manley,

Bex

et al. 2024

Sci Rep

Self Cite

View full text Add to dashboard Cite

We investigated the relative influence of image salience and image semantics during the visual search of naturalistic scenes, comparing performance in individuals with cerebral visual impairment (CVI) and controls with neurotypical development. Participants searched for a prompted target presented as either an image or text cue. Success rate and reaction time were collected, and gaze behavior was recorded with an eye tracker. A receiver operating characteristic (ROC) analysis compared the distribution of individual gaze landings based on predictions of image salience (using Graph-Based Visual Saliency) and image semantics (using Global Vectors for Word Representations combined with Linguistic Analysis of Semantic Salience) models. CVI participants were less likely and were slower in finding the target. Their visual search behavior was also associated with a larger visual search area and greater number of fixations. ROC scores were also lower in CVI compared to controls for both model predictions. Furthermore, search strategies in the CVI group were not affected by cue type, although search times and accuracy showed a significant correlation with verbal IQ scores for text-cued searches. These results suggest that visual search patterns in CVI are driven mainly by image salience and provide further characterization of higher-order processing deficits observed in this population.

show abstract

Section: Discussionmentioning

confidence: 92%

Section: Methodsmentioning

confidence: 99%

Visual search patterns during exploration of naturalistic scenes are driven by saliency cues in individuals with cerebral visual impairment

Walter,

Manley,

Bex

et al. 2024

Sci Rep

Self Cite

View full text Add to dashboard Cite

show abstract

“…: impairment in one or multiple visual functions, including visual acuity, contrast sensitivity, color recognition, oculomotor functions (pursuits, saccades), and visual fields; 10 and impairment in higher-order visual perceptual functions such object identification, visuospatial processing, visual attention and visually guided reach). 4,11 Therefore, clinical assessment typically includes examination of ocular function, preferential-looking tests of acuity and contrast sensitivity, and structured history-taking and clinical observation. 12 Additionally, CVI can present varying degrees of deficit across different visual functions, 13 and there are few standardized methods for quantifying these variations in visual functions for this population.…”

Section: Introductionmentioning

confidence: 99%

A Quantitative Assessment of Visual Function for Young and Medically Complex Children With Cerebral Visual Impairment: Development and Inter-Rater Reliability

Weden,

Barstow,

Oster

et al. 2024

Preprint

View full text Add to dashboard Cite

Background. Cerebral Visual Impairment (CVI) is the most common cause of low vision in children. Standardized, quantifiable measures of visual function are needed. Objective. This study developed and evaluated a new method for quantifying visual function in young and medically complex children with CVI using remote videoconferencing. Methods. Children diagnosed with CVI who had been unable to complete clinic-based recognition acuity tests were recruited from a low-vision rehabilitation clinic(n=22)Video-based Visual Function Assessment (VFA) was implemented using videoconference technology. Three low-vision rehabilitation clinicians independently scored recordings of each childs VFA. Interclass correlations for inter-rater reliability was analyzed using intraclass correlations (ICC). Correlations were estimated between the video-based VFA scores and both clinically obtained acuity measures and childrens cognitive age equivalence. Results: Inter-rater reliability was analyzed using intraclass correlations (ICC). Correlations were estimated between the VFA scores, clinically obtained acuity measures, and cognitive age equivalence. ICCs showed good agreement (ICC and 95% CI 0.835 (0.701-0.916)) on VFA scores across raters and agreement was comparable to that from previous, similar studies. VFA scores strongly correlated (r= -0.706, p=0.002) with clinically obtained acuity measures. VFA scores and the cognitive age equivalence were moderately correlated (r= 0.518, p=0.005), with notable variation in VFA scores for participants below a ten month cognitive age-equivalence. The variability in VFA scores among children with lowest cognitive age-equivalence may have been an artifact of the studys scoring method, or may represent existent variability in visual function for children with the lowest cognitive age-equivalence. Conclusions: Our new VFA is a reliable, quantitative measure of visual function for young and medically complex children with CVI. Future study of the VFA intrarater reliability and validity is warranted.

show abstract

Visual Search Patterns During Exploration of Naturalistic Scenes are Driven by Saliency Cues in Individuals with Cerebral Visual Impairment

Walter,

Manley,

Bex

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

Two main sources of information have been identified to explain what image features guide gaze behavior, namely, image salience (associated with bottom-up processing) and image semantics (influenced by top-down processing). In this study, we compared the relative influence of these two factors while subjects searched for a predetermined target in a naturalistic scene. We also compared visual search performance in individuals with neurotypical development and those with cerebral visual impairment (CVI); a neurodevelopmental condition associated with higher-order visual processing deficits. Participants searched for the prompted target (presented as either an image or text cue) in a series of indoor and outdoor naturalistic scenes. Gaze behavior was recorded with an eye tracker, and behavioral outcomes were success rate, reaction time, visual search area, and number of fixations. A receiver operating characteristic (ROC) analysis was performed to compare the distribution of individual eye gaze patterns based on predictions of image salience (using Graph-Based Visual Saliency) and image semantics (using Global Vectors for Word Representations combined with Linguistic Analysis of Semantic Salience) models. We found that overall, CVI participants were less likely and were slower to find the target than controls. Visual search behavior in CVI was also associated with a larger visual search area and a greater number of fixations. ROC-based analysis revealed that saliency scores were lower in CVI than controls for both the image salience and image semantics model predictions. Furthermore, search strategies in the CVI group were not affected by cue type, although search times and accuracy were correlated with Verbal IQ scores for text-cued searches. Collectively, these results suggest that individuals with CVI do not utilize image or semantic information as readily as controls, in line with their associated deficits related to higher-order processing.

show abstract

Object identification in cerebral visual impairment characterized by gaze behavior and image saliency analysis

Cited by 3 publications

References 41 publications

Visual search patterns during exploration of naturalistic scenes are driven by saliency cues in individuals with cerebral visual impairment

Visual search patterns during exploration of naturalistic scenes are driven by saliency cues in individuals with cerebral visual impairment

A Quantitative Assessment of Visual Function for Young and Medically Complex Children With Cerebral Visual Impairment: Development and Inter-Rater Reliability

Visual Search Patterns During Exploration of Naturalistic Scenes are Driven by Saliency Cues in Individuals with Cerebral Visual Impairment

Contact Info

Product

Resources

About