Visual similarity of pen gestures

Abstract

+ 1 -5 1 0 -6 4 3 -7 1 0 6 h t t p : / / w w w . c s . b e r k e l e y . e d u / -{ allanl,landay, r o w e } ABSTRACT Pen-based user interfaces are becoming ever more popular. G e s t u r e s (i.e., m a r k s made with a pen to i n v o k e a command) are a valuable aspect of pen-based UIs, but they also have drawbacks. The challenge in designing good gestures is to make them easy for people to learn and remember. With the goal of better gesture design, we performed a pair of experiments to determine why users find gestures similar. From these experiments, we have derived a computational model for predicting perceived gesture similarity that correlates 0.56 with observation. We will incorporate the results of these experiments into a gesture design tool, which will aid the pen-based UI designer in creating gesture sets that are easier to learn and more memorable. KeywordsPen-based user interfaces, pen gestures, multi-dimensional scaling, similarity, perception el=iv ::a'OOO CHI Letters volume 2 • issue 1

SimpleFlow: Enhancing Gestural Interaction with Gesture Prediction, Abbreviation and Autocompletion

“…Entering gestures accurately and quickly can be challenging [3,32,26]. Some of the challenges arise because of the need for algorithms that accurately recognise gestures [32,25].…”

“…Related to modeling gestures is research around measuring and modeling the complexity of gestures [26], which could be applied to quantifying the predictability of gestures.…”

Intelligent Interfaces to Empower People with Disabilities

“…The issue of gesture similarity arises for anybody who designs a gesture alphabet [67]. An advantage of SYMBOLDESIGN is that users find out during training of the interface if they inadvertently proposed movement patterns that are too similar for the classifier to distinguish reliably.…”

“…113,37,36]. Environments that enable users to create their own gesture alphabets have been shown to be particularly appreciated by users [67,14,97].…”

User Interfaces for On-Line Diagram Recognition

“…In trials on nine novice users, only 74% of 269 erasing gestures were effective; surprisingly, this did not discourage the users, who always chose to gesture when they had a choice between gesture and menu for erasing. There is need for standardization of gestures for common operations; existing software uses various gestures for the same operation [18].…”