Predicting Reading Performance based on Eye Movement Analysis with Hidden Markov Models

Zheng, Yueyuan; Que, Ying; Hu, Xiao; Hsiao, Janet H.

doi:10.1109/icalt55010.2022.00058

Cited by 1 publication

(1 citation statement)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…EMHMM also has contributed to learning technology development. For example, in passage reading, we found that eye movement consistency uniquely predicted readers’ comprehension performance beyond traditional reading/language ability and eye movement measures, and thus could be used to continuously monitor readers’ comprehension without interrupting natural mental processes of reading (Zheng, Que, Hu, & Hsiao, 2022).…”

Section: Attention Strategymentioning

confidence: 99%

Understanding Human Cognition Through Computational Modeling

Hsiao

2024

Topics in Cognitive Science

View full text Add to dashboard Cite

One important goal of cognitive science is to understand the mind in terms of its representational and computational capacities, where computational modeling plays an essential role in providing theoretical explanations and predictions of human behavior and mental phenomena. In my research, I have been using computational modeling, together with behavioral experiments and cognitive neuroscience methods, to investigate the information processing mechanisms underlying learning and visual cognition in terms of perceptual representation and attention strategy. In perceptual representation, I have used neural network models to understand how the split architecture in the human visual system influences visual cognition, and to examine perceptual representation development as the results of expertise. In attention strategy, I have developed the Eye Movement analysis with Hidden Markov Models method for quantifying eye movement pattern and consistency using both spatial and temporal information, which has led to novel findings across disciplines not discoverable using traditional methods. By integrating it with deep neural networks (DNN), I have developed DNN+HMM to account for eye movement strategy learning in human visual cognition. The understanding of the human mind through computational modeling also facilitates research on artificial intelligence's (AI) comparability with human cognition, which can in turn help explainable AI systems infer humans’ belief on AI's operations and provide human‐centered explanations to enhance human−AI interaction and mutual understanding. Together, these demonstrate the essential role of computational modeling methods in providing theoretical accounts of the human mind as well as its interaction with its environment and AI systems.

show abstract

Section: Attention Strategymentioning

confidence: 99%

Understanding Human Cognition Through Computational Modeling

Hsiao

2024

Topics in Cognitive Science

View full text Add to dashboard Cite

show abstract

Predicting Reading Performance based on Eye Movement Analysis with Hidden Markov Models

Cited by 1 publication

References 23 publications

Understanding Human Cognition Through Computational Modeling

Understanding Human Cognition Through Computational Modeling

Contact Info

Product

Resources

About