A visual interactive reading system based on eye tracking technology to improve digital reading performance

Abstract

Purpose Developing attention-aware systems and interfaces based on eye tracking technology could revolutionize mainstream human–computer interaction to make the interaction between human beings and computers more intuitive, effective and immersive than can be achieved traditionally using a computer mouse. This paper aims to propose an eye-controlled interactive reading system (ECIRS) that uses human eyes instead of the traditional mouse to control digital text to support screen-based digital reading. Design/methodology/approach This study uses a quasi-experimental design to examine the effects of an experimental group and a control group of learners who, respectively, used the ECIRS and a mouse-controlled interactive reading system (MCIRS) to conduct their reading of two types of English-language text online – pure text and Q&A-type articles on reading comprehension, cognitive load, technology acceptance, and reading behavioural characteristics. Additionally, the effects of learners with field-independent (FI) and field-dependence (FD) cognitive styles who, respectively, used the ECIRS and MCIRS to conduct their reading of two types of English-language text online – pure text and Q&A-type articles on reading comprehension are also examined. Findings Analytical results reveal that the reading comprehension of learners in the experimental group significantly exceeded those in the control group for the Q&A article, but the difference was insignificant for the pure text article. Moreover, the ECIRS improved the reading comprehension of field-independent learners more than it did that of field-dependent learners. Moreover, neither the cognitive loads of the two groups nor their acceptance of the technology differed significantly, whereas the reading time of the experimental group significantly exceeded that of the control group. Interestingly, for all articles, the control group of learners read mostly from top to bottom without repetition, whereas most of the learners in the experimental group read most paragraphs more than once. Clearly, the proposed ECIRS supports deeper digital reading than does the MCIRS. Originality/value This study proposes an emerging ECIRS that can automatically provide supplementary information to a reader and control a reading text based on a reader’s eye movement to replace the widely used mouse-controlled reading system on a computer screen to effectively support digital reading for English language learning. The implications of this study are that the highly interactive reading patterns of digital text with ECIRS support increase motivation and willingness to learn while giving learners a more intuitive and natural reading experience as well as reading an article online with ECIRS support guides learners’ attention in deeper digital reading than does the MCIRS because of simultaneously integrating perceptual and cognitive processes of selection, awareness and control based on human eye movement.

Design of Digital Interactive Encyclopedia “Palembang Songket Decoration” as Media Education Introduction Wastra Indonesia

“…Human-computer interaction provides interaction between humans and computers more intuitive, deep and effective than using a computer mouse [11]. Multimedia applications are an effective way to provide Education material because multimedia provides information in a variety of media, in an interactive way and creates a multi-sensory learning environment [12].…”

GazePrompt: Enhancing Low Vision People's Reading Experience with Gaze-Aware Augmentations

“…Cheng et al [15] has designed a gaze-based reading annotation system that summarizes and shares a teacher's reading characteristics, such as reading speed, transitions between sections, and frequency of re-reading, to improve their students' reading comprehension. Moreover, other than inferring readers' behaviors or intent, researchers also use gaze as direct control to replace traditional input methods, such as mouse and keyboard [14,53,91]. For example, Shakil et al [91] has developed a system that allows a user to use gaze to control code navigation, such as performing "Go to Definition" by dwelling on a color square on the side of the screen, and found that gaze control can improve code reading efficiency.…”

Associations between Social Learning Environments and Students’ Reading Comprehension Skills: An Analysis of PISA’s Saudi Arabia Dataset

“…Understanding involves knowledge and information, concepts and ideas, practical skills and intuition (Allen & McNamara, 2020). Fundamentally, it involves integrating and applying all of these in ways that are appropriate to the learner's needs Several studies have found that the use of technology enhances students' reading comprehension skills(e.g., (Alanazi, 2016;Alanazi, 2019;Chen, Wang, & Lin, 2019;Handayani, Mantra, & Suwandi, 2019;Korkmaz & Öz, 2021;Moon, Francom, & Wold, 2021)). Digital reading has several advantages over textbook reading, such as interactivity, the coverage of media and the feasibility of accessing information (Liu, 2012); in addition, reading aloud from e-books enhances performance (Davidson, Danby, Ekberg, & Thorpe, 2020).…”