Using Interactive E-Book User Log Variables to Track Reading Processes and Predict Digital Learning Outcomes

Abstract

Stealth assessment has been successfully embedded in educational games to measure students’ learning in an unobtrusive and supportive way. This study explored the possibility of applying stealth assessment in a digital reading platform and sought to identify potential in-system indicators of students’ digital learning outcomes. Utilizing the user log data from third- to fifth-grade students ( n = 573) who read an interactive Word Knowledge E-Book, we examined various user log variables and their associations with word knowledge and strategic reading outcomes. Descriptive analysis provided a depiction of the real-time reading processes and behaviors in which students engaged while digitally reading. Multiple regression analysis with classroom fixed effects demonstrated that user log variables relevant to answering questions and making decisions (i.e., percentage of embedded questions answered correctly; number of attempts to answer the questions; and making implausible decisions) were significantly associated with students’ word knowledge and strategic reading outcomes. Variables indicating reading time and frequency, however, were not significantly associated with these outcomes. This study highlights the potential of interactive e-books as another digital learning environment to establish stealth assessment, which may allow researchers and educators to track students’ reading processes and predict reading outcomes while supporting digital learning.

Which log variables significantly predict academic achievement? A systematic review and meta‐analysis

“…AI techniques have been applied to different assessment tasks and evidence, such as electronic assessment platforms, stealth assessment, latent knowledge estimation and learning processes. By analyzing data generated from these approaches, previous research has investigated the following: test‐taken behaviors (eg, time‐on‐task, answering and revising behavior during exams) (Lee et al, 2019), formative assessment using stealth methods (Yang et al, 2021), knowledge tracing (Molenaar et al, 2021) and analyzing multichannel data (eg, clickstreams, eye‐tracking, mouse movements) in multimodal LA with different AI techniques such as process mining and network analysis (de Marcos et al, 2016; Saqr et al, 2020). A wealth of such research has made student academic performance analysis and prediction become two widely explored research topics in LA.…”

Interactive Design Psychology and Artificial Intelligence-Based Innovative Exploration of Anglo-American Traumatic Narrative Literature

“…Interactive design psychology modifies mostly the page structure and the rhythm of the selected fragments. Compared with the original version, the revision looks briefer, tidier, and better overall impression, so the likability score has increased slightly compared with the AI-modified version ( Yang et al, 2021 ). Nevertheless, the revision is a far cry from the original text.…”

Knowledge in digital environments: A systematic review of literature

“…In Martin and Quan-Haase (2013) study, an e-book is accepted as a digital environment. It is essential for e-books to include interactive features, as stated by Yang et al (2021), in order to successfully deliver digital learning outcomes. It is not believed to be adequate to transfer merely the written content to electronic media.…”