Cross-Codal Integration of Bridging Event Information in Narrative Understanding

Huff, Markus; Rosenfelder, Dina; Oberbeck, Maria; Merkt, Martin; Papenmeier, Frank; Meitz, Tino

doi:10.31234/osf.io/r5w68

Cited by 2 publications

(5 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Evidence of inferential processing appeared at the subsequent panel where the viewing times of panels following inferential techniques were all longer than following the original event panel (Cohn & Kutas, 2015; Cohn & Wittenberg, 2015; Huff et al, 2020). Here again, viewing times differed between inferential techniques.…”

Section: Discussionmentioning

confidence: 99%

“…Some work has also examined substitutions of text for events. Huff et al (2020) compared textual descriptions of events to visually explicit or omitted events within a visual narrative sequence. The text required longer viewing times than the visuals, suggesting that switching modalities may require more effort than unimodal sequences.…”

Section: Experiments 1: Comparing Inferential Techniquesmentioning

confidence: 99%

“…We predicted that techniques with an [explicit] feature would lead to slower viewing times at the critical panel, based on the cost of accessing event structures by explicit cues, but which would then speed up viewing times for the subsequent panel (Cohn, 2019; Cohn & Kutas, 2015; Cohn & Paczynski, 2013). Due to the costs for switching modalities (Huff et al, 2020), [text] features may slow down readers at both the critical and subsequent panels. Then, based on SPECT, [framing] may imply a reduction of visual features, which could lead to reduced fixations in front-end processing, ultimately leading to faster viewing times at the critical panel.…”

Section: Experiments 1: Comparing Inferential Techniquesmentioning

confidence: 99%

“…Adding onomatopoeias to panels makes them multimodal. Switching modalities to a fully textual panel may incur costs to recode information to fit the visually based mental model of the rest of the sequence (Huff et al, 2020). However, this effect appeared for phrasal descriptions of events rather than single word sound effects.…”

Section: Experiments 2: Comparing Combinations Of Techniquesmentioning

confidence: 99%

See 3 more Smart Citations

Picture perfect peaks: comprehension of inferential techniques in visual narratives

Klomberg

Cohn

2022

Lang. cogn.

View full text Add to dashboard Cite

The ability to reconstruct a missing event to create a coherent interpretation – bridging inference – is central to understanding both real-world events and visual narratives like comics. Most previous work on visual narrative inferencing has focused on fully omitted events, yet few have compared inference generation when climactic events become replaced with a panel employing numerous inferential techniques (e.g., action stars or onomatopoeia). These techniques implicitly express the unseen event while balancing several underlying features that describe their informativeness. Here, we examine whether processing and inference resolution differ across inferential techniques in two self-paced reading experiments. Experiment 1 directly compared five distinct types, and Experiment 2 explored the effect of combining techniques. In both experiments, differences in processing arise both between inferential techniques themselves, and at subsequent panels allowing the bridging inference to be resolved. Analysis of inferential features suggested that the explicitness of the inferential technique led to greater demand in processing, which later facilitated inference generation and comprehensibility. The findings reinforce the necessity of discussing the diversity of narrative patterns motivating bridging inferences within visual narratives.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Experiments 1: Comparing Inferential Techniquesmentioning

confidence: 99%

Section: Experiments 1: Comparing Inferential Techniquesmentioning

confidence: 99%

Section: Experiments 2: Comparing Combinations Of Techniquesmentioning

confidence: 99%

See 2 more Smart Citations

Picture perfect peaks: comprehension of inferential techniques in visual narratives

Klomberg

Cohn

2022

Lang. cogn.

View full text Add to dashboard Cite

show abstract

“…The aim of a narrative is to guide the recipients through complex information, to provide them an interpretation, so that they are not required "to take on the entire cognitive load of unguided discovery." (Dove & Jones, 2012, p. 1) The recipients should be attracted by and drawn into the narrative, so that they can follow the information without having to apply a large cognitive load (Huff et al, 2014;Huff et al, 2020).…”

Section: The Potential Of Narrative Visualizationsmentioning

confidence: 99%

The Effect of Narrative Visualizations on Public Risk Perception of Magnetic Fields Emanating from High Voltage Power Lines – and the Role of Anxiety

Leidecker-Sandmann¹,

Kohler²

2022

Preprint

View full text Add to dashboard Cite

People’s acceptance level for high voltage power lines (HVPL) is generally low. Among others, they suspect potential health risks arising from magnetic fields (MF) associated with HVPL, although there are only very few, scientifically proven health risks originating from them. It is therefore crucial to inform the public about this misconception. Studies in risk communication have already tested whether certain presentation formats are perceived as easier to understand than others. The results are inconclusive. A special problem is that the mere provision of information often leads to an increase in risk perception, regardless of the content. Thus, our study focuses on recipients’ risk perception rather than on the understandability of information. We ask whether the degree of narrative visualizations that a presentation format contains has an impact on citizens’ risk perception of HPVL. We conducted an experimental study of 274 participants (representative of the German population) to test three different presentation formats (video, infographic, diagram). It emerged that presentation formats involving strong narrativity and visualization (e.g., video) led to lower risk perception than presentation formats involving less narrativity and visualization (e.g., diagram). Overall, our results also indicate that some people exhibit increased risk perception after reception of the stimuli. Therefore, we further investigated whether the personality traits skepticism and anxiety might affect recipients’ risk perception. In the latter case, this proved to be true. Our study sheds light on how information campaigns on HVPL and MF might reduce risk perception and which individual traits might prove a hindrance.

show abstract

Cross-Codal Integration of Bridging Event Information in Narrative Understanding

Cited by 2 publications

References 38 publications

Picture perfect peaks: comprehension of inferential techniques in visual narratives

Picture perfect peaks: comprehension of inferential techniques in visual narratives

The Effect of Narrative Visualizations on Public Risk Perception of Magnetic Fields Emanating from High Voltage Power Lines – and the Role of Anxiety

Contact Info

Product

Resources

About