GazeChat: Enhancing Virtual Conferences with Gaze-aware 3D Photos

He, Zhenyi; Wang, Keru; Feng, Brandon Y.; Du, Ruofei; Perlin, Ken

doi:10.1145/3472749.3474785

Cited by 20 publications

(12 citation statements)

References 61 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[37], [43], [45], [48], [50], [59], [62], [63], [76], [83], [84], [86] Controller 8 16 [34], [35], [39], [42], [46], [57], [70], [80] Place annotations 5 10…”

Section: Extended Reality Technologymentioning

confidence: 99%

“…14% [61], [62], [67], [68], [79], [80], [83] Behavior awareness 7 14% [35], [36], [40], [42], [52], [63], [66] Target Identification 6 12% [25], [26], [38], [44], [48], [69] Interactional Gaze 3 6% [35], [70], [79] Table 9. Approaches to utilizing shared gaze…”

Section: # % Sourcesmentioning

confidence: 99%

“…Almost every study was included in some aspect of collaboration & communication. This category was broken down into six subcategories, the most common were general collaboration & communication (60%, n=30 [25]- [27], [34], [36], [37], [39]- [41], [43], [45], [46], [48], [50]- [52], [56], [57], [61]- [63], [65], [68], [69], [71], [75]- [77], [80], [83] Non-verbal cues 9 18% [40], [46], [48], [56], [61]- [63], [65], [75] Teleconferencing & meetings 5 10% [57], [61], [75], [77], [83] Avatar visualization 3 6% [61], [68], [80] Wide-area awareness 1 2% [25] Collaborative writing 1 2% [27] Gaming All Gaming 8 16% [27], [44], [51], [53],…”

Section: Research Study Characteristicsmentioning

confidence: 99%

“…[27], [42], [44], [49], [58], [61], [83] Guidance & Training 5 10% [46], [51], [54], [59], [65] Conversation simulation 5…”

Section: Task Type # % Sourcesmentioning

confidence: 99%

See 3 more Smart Citations

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

Kathryn¹,

Arturo²,

Lydia³

et al. 2022

View full text Add to dashboard Cite

We present a state of the art and scoping review of the literature to examine embodied information behaviors, as reflected in shared gaze interactions, within co-present extended reality experiences. Recent proliferation of consumer-grade head-mounted XR displays, situated at multiple points along the Reality-Virtuality Continuum, has increased their application in social, collaborative, and analytical scenarios that utilize data and information at multiple scales. Shared gaze represents a modality for synchronous interaction in these scenarios, yet there is a lack of understanding of the implementation of shared eye gaze within co-present extended reality contexts. We use gaze behaviors as a proxy to examine embodied information behaviors. This review examines the application of eye tracking technology to facilitate interaction in multiuser XR by sharing a user's gaze, identifies salient themes within existing research since 2013 in this context, and identifies patterns within these themes relevant to embodied information behavior in XR. We review a corpus of 50 research papers that investigate the application of shared gaze and gaze tracking in XR generated using the SALSA framework and searches in multiple databases. The publications were reviewed for study characteristics, technology types, use scenarios, and task types. We construct a state-of-the field and highlight opportunities for innovation and challenges for future research directions.

show abstract

“…[37], [43], [45], [48], [50], [59], [62], [63], [76], [83], [84], [86] Controller 8 16 [34], [35], [39], [42], [46], [57], [70], [80] Place annotations 5 10…”

Section: Extended Reality Technologymentioning

confidence: 99%

Section: # % Sourcesmentioning

confidence: 99%

Section: Research Study Characteristicsmentioning

confidence: 99%

“…[27], [42], [44], [49], [58], [61], [83] Guidance & Training 5 10% [46], [51], [54], [59], [65] Conversation simulation 5…”

Section: Task Type # % Sourcesmentioning

confidence: 99%

See 2 more Smart Citations

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

Kathryn¹,

Arturo²,

Lydia³

et al. 2022

View full text Add to dashboard Cite

show abstract

“…In the era of pandemic, a large number of studies [2,7,23,24,34,41,54] have highlighted this requirement. Consequently, several works have utilized signals like video captured from the front camera [8,21,25] or utilized specialized devices like smart glasses, thermal cameras, eye-trackers, etc. [1,22,47,54,56] to capture the eye dynamics of the students to analyze how they interact with the computer during a live lecture.…”

Section: Introductionmentioning

confidence: 99%

I Cannot See Students Focusing on My Presentation; Are They Following Me? Continuous Monitoring of Student Engagement through "Stungage"

Das,

Chakraborty,

Mitra

2022

Preprint

View full text Add to dashboard Cite

Monitoring students' engagement and understanding their learning pace in a virtual classroom becomes challenging in the absence of direct eye contact between the students and the instructor. Continuous monitoring of eye gaze and gaze gestures may produce inaccurate outcomes when the students are allowed to do productive multitasking, such as taking notes or browsing relevant content.This paper proposes Stungage -a software wrapper over existing online meeting platforms to monitor students' engagement in real-time by utilizing the facial video feeds from the students and the instructor coupled with a local on-device analysis of the presentation content. The crux of Stungage is to identify a few opportunistic moments when the students should visually focus on the presentation content if they can follow the lecture. We investigate these instances and analyze the students' visual, contextual, and cognitive presence to assess their engagement during the virtual classroom while not directly sharing the video captures of the participants and their screens over the web. Our system achieves an overall F2-score of 0.88 for detecting student engagement. Besides, we obtain 92 responses from the usability study with an average SU score of 74.18.

show abstract

Pseudo‐mutual gazing enhances interbrain synchrony during remote joint attention tasking

Chuang

Hsu

2023

Brain and Behavior

View full text Add to dashboard Cite

IntroductionMutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in‐person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize.MethodsTo address these questions, we conducted a study using eye trackers to create a pseudo‐mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player‐observer, collaborative, and competitive modes.ResultsOur results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low‐frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS.ConclusionThese results provide insight into the neurological mechanisms underlying remote interaction through the pseudo‐mutual gaze channel and have significant implications for developing effective online communication environments.

show abstract

GazeChat: Enhancing Virtual Conferences with Gaze-aware 3D Photos

Cited by 20 publications

References 61 publications

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

A state of the art and scoping review of embodied information behavior in shared, co-present extended reality experiences

I Cannot See Students Focusing on My Presentation; Are They Following Me? Continuous Monitoring of Student Engagement through "Stungage"

Pseudo‐mutual gazing enhances interbrain synchrony during remote joint attention tasking

Contact Info

Product

Resources

About