Accuracy of Deictic Gestures to Support Telepresence on Wall-sized Displays

Abstract

International audienceWe present a controlled experiment assessing how accurately a user can interpret the video feed of a remote user showing a shared object on a large wall-sized display by looking at it or by looking and pointing at it. We analyze distance and angle errors and how sensitive they are to the relative position between the remote viewer and the video feed. We show that users can accurately determine the target, that eye gaze alone is more accurate than when combined with the hand, and that the relative position between the viewer and the video feed has little effect on accuracy. These findings can inform the design of future telepresence systems for wall-sized displays

Remote Deictic Communication: Simulating Deictic Pointing Gestures across Distances Using Electro Muscle Stimulation

“…Wong and Gutwin (2010) looked at how people produce and understand pointing gestures when interacting with collaborative virtual environments. Avellino et al (2015) also investigated how accurately users can understand remote pointing from video footage on a large wallsized display. Systems such as HyperMirror try to allow deictic communication using a mirror metaphor that places local and remote partners in a joint "mirror" space (cf.…”

GazeLens: Guiding Attention to Improve Gaze Interpretation in Hub-Satellite Collaboration

“…They also compared this technique with the a 3D virtual environment of GAZE [1]. Finally, Avellino et al [31] showed that video can be used to convey gaze and deictic gestures toward shared digital content in large wall-sized displays.…”

“…Twelve participants (7 male), aged 22 to 33 (median = 25), with backgrounds from computer science, interaction design, and social science participated in the study. This sample size is the average one reported in CHI studies [38] and also used in related work [17,31]. Pilot studies determined that effects are strong enough to be observed with this sample size.…”

Deictic Communication across Distances: Visualising Remote Pointing Gestures on Mobile Devices

“…Wong and Gutwin (2010) looked at how people produce and understand pointing gestures when interacting with collaborative virtual environments. Avellino et al (2015) investigated how accurately users can understand remote pointing from video footage on a large wall-sized display. Systems such as HyperMirror try to tackle issues such as deictic communication by using a mirror metaphor that places local and remote partners in a joint 'mirror' space (cf.…”