How Far Are We From Quantifying Visual Attention in Mobile HCI?

Abstract

With an ever-increasing number of mobile devices competing for our attention, quantifying when, how often, or for how long users visually attend to their devices has emerged as a core challenge in mobile human-computer interaction. Encouraged by recent advances in automatic eye contact detection using machine learning and device-integrated cameras, we provide a fundamental investigation into the feasibility of quantifying visual attention during everyday mobile interactions. We identify core challenges and sources of errors associated with sensing attention on mobile devices in the wild, including the impact of face and eye visibility, the importance of robust head pose estimation, and the need for accurate gaze estimation. Based on this analysis, we propose future research directions and discuss how eye contact detection represents the foundation for exciting new applications towards next-generation pervasive attentive user interfaces.

I Cannot See Students Focusing on My Presentation; Are They Following Me? Continuous Monitoring of Student Engagement through "Stungage"

“…Additionally, in the absence of the instructor's expression, the attendees can give different expressions irrespective of engaged or non-engaged. To address these limitations, some studies explores the gaze-based visual attention [7,8,25,29] for finding the attentiveness of the attendees. In [8], Bace et al quantified the visual attention by checking whether the attendee was looking at the frontal screen.…”

“…On the other side, Table 1 shows the average responses for the questions focuses on the evaluation of the platform and the understandability of the student by the instructor as well as well-accustomed participants 7 , respectively.…”

“…In a classroom, such eye contacts significantly help the instructor gauge the students' learning pace and understand whether the students are engaged with the topic being taught. In the era of pandemic, a large number of studies [2,7,23,24,34,41,54] have highlighted this requirement. Consequently, several works have utilized signals like video captured from the front camera [8,21,25] or utilized specialized devices like smart glasses, thermal cameras, eye-trackers, etc.…”

Innovative Research on the Development of Online Education Mode of Internet Thinking Based on the Discrimination of Learning Attention under the Analysis of Head Posture

“…In recent years, more and more researchers began to study the problem of visual LAG recognition. Bce et al study the problem of students' LAG recognition in a small round table environment, in which an omnidirectional camera is placed on the conference table [9]. Later, they studied the method of identifying LAG in the environment of multiple remote cameras [4].…”

Eyewear 2021 The Forth Workshop on Eyewear Computing – Augmenting Social Situations and Democratizing Tools

“…reading, walking, detection of fatigue, cognitive load) enable applications on areas like quantified self for the mind [16,19]. And with increasing ubiquity of the technology, new opportunities arise for applications that track social behaviours and interactions between groups of people in real-world settings [3,23]. The workshop is a continuation of the first three EyeWear workshops at UbiComp (2016 in Heidelberg, 2018 in Singapore, and 2019 in London).…”