Semantic consistency versus perceptual salience in visual scenes: Findings from change detection

Spotorno, Sara; Tatler, Benjamin W.; Faure, Sylvane

doi:10.1016/j.actpsy.2012.12.009

Cited by 28 publications

(38 citation statements)

References 63 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This advantage was greater when two changes had to be detected than when only one had to be detected, supporting our suggestion that higher cognitive load enhances reliance on the scene's gist. In previous work, we found better detection of diagnostic than inconsistent changes for highly salient additions or, regardless of salience, for deletions (Spotorno et al, 2013). In contrast, semantic effects of prioritisation of diagnostic over inconsistent objects emerged only for low salience objects in the present study.…”

Section: Discussioncontrasting

confidence: 69%

“…To our knowledge, only one study has compared high consistency/diagnosticity and inconsistency systematically within the same task (Spotorno et al, 2013). Using a change detection paradigm with coloured drawings, some advantage was found for diagnosticity, however this was in the context of a complex pattern of findings, which appeared affected by the type of change (addition or deletion), and without directly contrasting diagnosticity and inconsistency within the same scene in the same trial.…”

Section: Figure 1 About Herementioning

confidence: 99%

“…We also used four scenes for practice selected from the same image database (see Spotorno et al, 2013). All the scenes were sized 19 ×14 cm, 610 × 440 pixels, and were presented in the centre of the screen on a medium grey background (127, 127, 127) on a DELL CRT screen (37.7 x 30.3 cm, 1024 x 768 pixels, resolution 85 Hz).…”

Section: Materials and Apparatusmentioning

confidence: 99%

See 2 more Smart Citations

The elephant in the room: Inconsistency in scene viewing and representation.

Spotorno

Tatler

2017

Journal of Experimental Psychology: Human Perception and Perfor

Self Cite

View full text Add to dashboard Cite

We examined the extent to which semantic informativeness, consistency with expectations and perceptual salience contribute to object prioritisation in scene viewing and representation. In scene viewing (Experiments 1-2), semantic guidance overshadowed perceptual guidance in determining fixation order, with the greatest prioritisation for objects that were diagnostic of the scene's depicted event. Perceptual properties affected selection of consistent objects (regardless of their informativeness) but not of inconsistent objects. Semantic and perceptual properties also interacted in influencing foveal inspection, as inconsistent objects were fixated longer than low but not high salience diagnostic objects. While not studied in direct competition with each other (each studied in competition with diagnostic objects), we found that inconsistent objects were fixated earlier and for longer than consistent but marginally informative objects. In change detection (Experiment 3), perceptual guidance overshadowed semantic guidance, promoting detection of highly salient changes. A residual advantage for diagnosticity over inconsistency emerged only when selection prioritisation could not be based on low-level features. Overall these findings show that semantic inconsistency is not prioritised within a scene when competing with other relevant information that is essential to scene understanding and respects observers' expectations. Moreover, they reveal that the relative dominance of semantic or perceptual properties during selection depends on ongoing task requirements. Keywords:Semantic Consistency, Perceptual Salience, Scene Viewing, Change Detection, Eye Movements THE ELEPHANT IN THE ROOM 3 Public significance statement There has been long-standing debate about whether we look sooner at objects that are unexpected for the scene (i.e., semantically inconsistent objects). The present study shows that they are not prioritised over the most expected and informative objects for the event depicted in the scene (i.e., diagnostic objects), especially when these objects also stand out visually from their surroundings. Unexpected objects are looked at later, and when they are perceptually salient they slow down how quickly we select the most expected and informative objects in the scene.This study also shows that the impacts of object perceptual salience and object-scene semantic associations are task-dependent: semantics appear the most important source of guidance when viewers explore the scene for memorisation, whereas perceptual salience has a greater impact when changes have to be found. These findings provide new key insights into the roles of highand low-level factors in how we view and remember scenes. THE ELEPHANT IN THE ROOM 4The Elephant in the Room: Inconsistency in Scene Viewing and Representation Information selection during both online processing and memory representation is one of our fundamental and most striking abilities. Fundamental, because selection of a few, key aspects enables us to adapt and act fle...

show abstract

Section: Discussioncontrasting

confidence: 69%

Section: Figure 1 About Herementioning

confidence: 99%

See 1 more Smart Citation

The elephant in the room: Inconsistency in scene viewing and representation.

Spotorno

Tatler

2017

Journal of Experimental Psychology: Human Perception and Perfor

Self Cite

View full text Add to dashboard Cite

show abstract

“…An object can attract the perception of the observer by its natural or distinctive features (Vargas and Lahera, 2011), but it also depends on the interaction of its basic features with respect to other objects (Gapp, 1995;Hoffman and Singh, 1997;Spotorno et al, 2013;Stoia, 2007). The model of saliency should be able to measure both the intrinsic and the contextual saliency of each object, at the same time that allows the identification of the most salient object in a scenario.…”

Section: Part Ii: Contributions 4 Computational Model Of Perceptual Smentioning

confidence: 99%

“… The visual saliency of an object depends on the interaction of its basic features, color, size, and shape mainly (Gapp, 1995;Hoffman and Singh, 1997;Spotorno et al, 2013;Stoia, 2007), with respect to other objects.…”

Section: Perceptual Saliencymentioning

confidence: 99%

Modelo computacional para la generación de indicaciones en la localización de objetos en entornos virtuales : aspectos espaciales y perceptivos

López¹

View full text Add to dashboard Cite

Parietal cortex integrates contextual and saliency signals during the encoding of natural scenes in working memory

Santangelo

Francesco

Mastroberardino

et al. 2015

Human Brain Mapping

View full text Add to dashboard Cite

The Brief presentation of a complex scene entails that only a few objects can be selected, processed indepth, and stored in memory. Both low-level sensory salience and high-level context-related factors (e.g., the conceptual match/mismatch between objects and scene context) contribute to this selection process, but how the interplay between these factors affects memory encoding is largely unexplored. Here, during fMRI we presented participants with pictures of everyday scenes. After a short retention interval, participants judged the position of a target object extracted from the initial scene. The target object could be either congruent or incongruent with the context of the scene, and could be located in a region of the image with maximal or minimal salience. Behaviourally, we found a reduced impact of saliency on visuospatial working memory performance when the target was out-of-context. Encoding-related fMRI results showed that context-congruent targets activated dorsoparietal regions, while context-incongruent targets de-activated the ventroparietal cortex. Saliency modulated activity both in dorsal and ventral regions, with larger context-related effects for salient targets. These findings demonstrate the joint contribution of knowledge-based and saliency-driven attention for memory encoding, highlighting a dissociation between dorsal and ventral parietal regions.

show abstract

Semantic consistency versus perceptual salience in visual scenes: Findings from change detection

Cited by 28 publications

References 63 publications

The elephant in the room: Inconsistency in scene viewing and representation.

The elephant in the room: Inconsistency in scene viewing and representation.

Modelo computacional para la generación de indicaciones en la localización de objetos en entornos virtuales : aspectos espaciales y perceptivos

Parietal cortex integrates contextual and saliency signals during the encoding of natural scenes in working memory

Contact Info

Product

Resources

About