From Empirical Studies to Visual Narrative Organization

Bateman, John A.; Beckmann, Alexia; Varela, Rocío Inés

doi:10.4324/9781315185354-7

Cited by 18 publications

(3 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other comics use more complex and varying features of layout (Bateman, Veloso, Wildfeuer, Cheung, & Guo, ; Cohn, ), involving vertical columns, staggering of panels, inset panels placed inside of other panels, and other decorative features. Negotiating the reading‐path across these features involves constraints that go beyond those in writing systems (Bateman, Beckmann, & Varela, ; Cohn, ), and are certainly not learned through interactions in the real world.…”

Section: Aspects Of Visual Narrativesmentioning

confidence: 99%

Editors’ Introduction and Review: Visual Narrative Research: An Emerging Field in Cognitive Science

Cohn

Magliano

2019

Topics in Cognitive Science

View full text Add to dashboard Cite

Drawn sequences of images are among our oldest records of human intelligence, appearing on cave paintings, wall carvings, and ancient pottery, and they pervade across cultures from instruction manuals to comics. They also appear prevalently as stimuli across Cognitive Science, for studies of temporal cognition, event structure, social cognition, discourse, and basic intelligence. Yet, despite this fundamental place in human expression and research on cognition, the study of visual narratives themselves has only recently gained traction in Cognitive Science. This work has suggested that visual narrative comprehension requires cultural exposure across a developmental trajectory and engages with domain-general processing mechanisms shared by visual perception, attention, event cognition, and language, among others. Here, we review the relevance of such research for the broader Cognitive Science community, and make the case for why researchers should join the scholarship of this ubiquitous but understudied aspect of human expression.

show abstract

Section: Aspects Of Visual Narrativesmentioning

confidence: 99%

Editors’ Introduction and Review: Visual Narrative Research: An Emerging Field in Cognitive Science

Cohn

Magliano

2019

Topics in Cognitive Science

View full text Add to dashboard Cite

show abstract

“…VLFI scores correlate with many aspects of visual narrative processing, as in Table 2, such as ERP effects to image sequences (Cohn & Kutas, 2015;Cohn & Maher, 2015;Cohn, Paczynski, Jackendoff, Holcomb, & Kuperberg, 2012), response times to target images (Cohn et al, 2012), self-paced viewing times (Cohn & Maher, 2015;Cohn & Wittenberg, 2015), comprehension ratings (Cohn, Murthy, & Foulsham, 2016;Cohn & Wittenberg, 2015), accuracy judgements (Hagmann & Cohn, 2016), eye movements (Bateman, Beckmann, & Varela, 2018;Kirtley, Murray, Vaughan, & Tatler, 2018), and segmentation of narrative constituent structure (Cohn & Bender, 2017). Expertise also modulates participants' preferences for reading order within comic page layouts (Cohn, 2013a;Cohn & Campbell, 2015) Some research suggests that specific visual narrative patterns can modulate processing beyond a general "fluency."…”

Section: Visual Language Fluency Index (Vlfi)mentioning

confidence: 99%

“…Children with ASD also provide shorter narrations of picture stories than typically developing children (Tager-Flusberg, 1995). Finally, an ERP study found that semantic processing (the N400) was attenuated for (2016) AccuracyNarrative structure Greater tolerance of incongruity for greater fluency Cohn et al (2016) Ratings Morphological familiarity and interpretations Less tolerance of incongruity for greater fluency Bateman et al (2018) Eye movements Layout More fluency associated with more consistent reading paths across panels Kirtley et al (2018) Eye movements Text-image relationships Larger saccades within panels for greater fluency incongruities in both verbal and visual narratives for individuals with ASD compared to neurotypical controls (Coderre et al, 2018).…”

Section: Autism Spectrum Disordermentioning

confidence: 99%

Visual narrative comprehension: Universal or not?

Cohn

2019

Psychon Bull Rev

View full text Add to dashboard Cite

Visual narratives of sequential imagesas found in comics, picture stories, and storyboardsare often thought to provide a fairly universal and transparent message that requires minimal learning to decode. This perceived transparency has led to frequent use of sequential images as experimental stimuli in the cognitive and psychological sciences to explore a wide range of topics. In addition, it underlines efforts to use visual narratives in science and health communication and as educational materials in both classroom settings and across developmental, clinical, and non-literate populations. Yet, combined with recent studies from the linguistic and cognitive sciences, decades of research suggest that visual narratives involve greater complexity and decoding than widely assumed. This review synthesizes observations from cross-cultural and developmental research on the comprehension and creation of visual narrative sequences, as well as findings from clinical psychology (e.g., autism, developmental language disorder, aphasia). Altogether, this work suggests that understanding the visual languages found in comics and visual narratives requires a fluency that is contingent on exposure and practice with a graphic system.

show abstract

Information design and multimodality

Bateman¹

2019

IDJ

View full text Add to dashboard Cite

Despite a long association between information design and semiotics, connections remain limited in many respects. This contribution argues that one reason for this is the traditionally weak connection between semiotics and empirical methods. To counter this, a model of multimodal communication is introduced in which theoretical description and empirical research are tightly bound methodologically. Several illustrations of the relevance of the model for information design are offered.

show abstract

From Empirical Studies to Visual Narrative Organization

Cited by 18 publications

References 1 publication

Editors’ Introduction and Review: Visual Narrative Research: An Emerging Field in Cognitive Science

Editors’ Introduction and Review: Visual Narrative Research: An Emerging Field in Cognitive Science

Visual narrative comprehension: Universal or not?

Information design and multimodality

Contact Info

Product

Resources

About