Gaze behavior in single-page monomodal and cross-modal switches as affected by Event construal

Abstract

This paper proposes Event-modelling Framework (EMF) to explore the systemic Event construal effects onto gaze. In two eye tracking experiments examining monomodal and cross-modal switches with a total number of 898 gaze probes of Text and Picture Areas of Interest (AOIs), we investigated gaze behavior variations produced by Event construal registered in 61 parameters of Referent, Event Frame and Perspective construal. 5 non-aliased gaze metrics served to assess the significance of Event construal effects and scale them. The results contribute to the research field of ergonomic optimization in visual and reading tasks.

Text and metatext event in the gaze behavior of impulsive and reflective readers

“…These three groups allow describe any event in any semiotic system, be it either text or image. The developed Event Construal Protocol has already been tested in multiple experimental studies (Kiose, Rzheshevskaya, 2021;Kiose et al, 2022) Centrality, Event Centrality (for further details see Kiose, 2022). However, to be incorporated into the pilot corpus MultiCORText, a trial version of protocol was developed applicable to texts and metatexts, in which Referents, Event Frame, Perspective within a discursive act are considered within linguistic representations.…”