Gesture combinations during collaborative decision-making at wall displays

Abstract

This paper describes an empirical user study with 24 participants during collaborative decision-making at large wall displays. The main objective of the user study is to analyze combinations of mid-air pointing gestures with other gestures or gaze. Particularly, we investigate gesture sequences (having pointing gestures as an initiator gesture) and gaze-pointing gesture misalignments. Our results show that most pointing gestures are part of gesture sequences and more precise gestures lead to touch gestures on the wall display, likely because they are associated with precise concepts. Regarding combinations of pointing gestures and gaze, misalignments often happen when users touch the display to make a change and want to observe the effect of that change on another display. The analyses conducted as part of this study clarify which natural awareness cues are more frequent in face-to-face collaboration, so that appropriate choices can be made regarding the transmission of equivalent cues to a remote location.