User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts

Chen, Zhen; Ma, Xin; Peng, Zeya; Zhou, Ying; Yao, Mengge; Ma, Zheng; Wang, Ci; Gao, Zaifeng; Shen, Mowei

doi:10.1080/10447318.2017.1342943

Cited by 48 publications

(16 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…After understanding the idea of registration, many users asked to change their initial proposals, and two of them mentioned that it would be helpful to have a kind of feedback from the device (such as a green light) as long as the user is registered indicating that motion tracking has been activated. The majority of the participants came up with arbitrary gestures with low agreement rates, confirming the association of abstract referents and arbitrary gestures [4,11,[37][38][39].…”

Section: User-defined Gesture Setmentioning

confidence: 76%

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Vogiatzidakis

Koutsabasis

2019

Informatics

View full text Add to dashboard Cite

If mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. This paper investigates a user-defined gesture vocabulary for basic control of a smart home device ecosystem, consisting of 7 devices and a total of 55 referents (commands for device) that can be grouped to 14 commands (that refer to more than one device). The elicitation study was conducted in a frame (general scenario) of use of all devices to support contextual relevance; also, the referents were presented with minimal affordances to minimize widget-specific proposals. In addition to computing agreement rates for all referents, we also computed the internal consistency of user proposals (single-user agreement for multiple commands). In all, 1047 gestures from 18 participants were recorded, analyzed, and paired with think-aloud data. The study reached to a mid-air gesture vocabulary for a smart-device ecosystem, which includes several gestures with very high, high and medium agreement rates. Furthermore, there was high consistency within most of the single-user gesture proposals, which reveals that each user developed and applied her/his own mental model about the whole set of interactions with the device ecosystem. Thus, we suggest that mid-air interaction support for smart homes should not only offer a built-in gesture set but also provide for functions of identification and definition of personalized gesture assignments to basic user commands.

show abstract

Section: User-defined Gesture Setmentioning

confidence: 76%

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Vogiatzidakis

Koutsabasis

2019

Informatics

View full text Add to dashboard Cite

show abstract

“…Referents can be presented to the participants in various ways. Depending on the type and maturity of the prototype used, referents were either demonstrated through GUI animations [41,54], described as a text message on the screen, or verbally [4,28,37,61], presented as a video [51,61] or still images [19,24,34,55], or presented by manipulating the actual artefact [7,45].…”

Section: Referent Presentationmentioning

confidence: 99%

“…Many other dimensions of the appropriateness of a mid-air gesture were examined, such as comfort [11,23,27,36,44,60], perceived fatigue [24,36,40,50], discoverability [34,55,58] learnability (how easy gestures can be learned) [24,27,50], gesture simplicity [26,45,61], body parts suitability [19,73], concurrent gestures during intense gameplay [19] and unimanual or bimanual gestures [48,53]. Finally, a few studies (7 out of 47, 14.9%) did not mentioned any specific focus of the gestures proposed.…”

Section: On Gesture "Appropriateness"mentioning

confidence: 99%

“…The Level of agreement was initially introduced by Wobbrock in 2005 [62] and was refined by Vatavu and Wobbrock in 2015 [74] which is called "Agreement Rate". Even though Agreement rate was claimed as an improved version of the Level of agreement, only half of the papers that were published after 2015 (8 out of 15, 53.3%) have utilized it [24,28,30,31,[38][39][40]44].…”

Section: Metricsmentioning

confidence: 99%

“…As expected, the level of agreement on gesture proposals is the metric most often used in elicitation studies. However, we have identified that some studies attempt to go further than agreement scores and assess gesture appropriateness on other grounds, like measured usability [54] and measured physiological risk [24]. In addition, other measures of fatigue that may be integrated to elicitation studies like consumed endurance [81] and the distance measured by hands [82], which can be automatically calculated provided an interactive system with gesture sensing capabilities is in-place.…”

Section: On the Dimensions Of Gesture Appropriateness User Evaluatiomentioning

confidence: 99%

See 2 more Smart Citations

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Vogiatzidakis

Koutsabasis

2018

MTI

View full text Add to dashboard Cite

Mid-air interaction involves touchless manipulations of digital content or remote devices, based on sensor tracking of body movements and gestures. There are no established, universal gesture vocabularies for mid-air interactions with digital content or remote devices based on sensor tracking of body movements and gestures. On the contrary, it is widely acknowledged that the identification of appropriate gestures depends on the context of use, thus the identification of mid-air gestures is an important design decision. The method of gesture elicitation is increasingly applied by designers to help them identify appropriate gesture sets for mid-air applications. This paper presents a review of elicitation studies in mid-air interaction based on a selected set of 47 papers published within 2011-2018. It reports on: (1) the application domains of mid-air interactions examined; (2) the level of technological maturity of systems at hand; (3) the gesture elicitation procedure and its variations; (4) the appropriateness criteria for a gesture; (5) participants number and profile; (6) user evaluation methods (of the gesture vocabulary); (7) data analysis and related metrics. This paper confirms that the elicitation method has been applied extensively but with variability and some ambiguity and discusses under-explored research questions and potential improvements of related research.Multimodal Technologies and Interact. 2018, 2, 65 2 of 21 such thing as a universal gesture vocabulary for every application" [15]. Thus, the identification of appropriate gestures for mid-air user interactions in terms of criteria like discoverability, memorability, performance, reliability and comfort, is an important design decision. This must be made at the early stages of system development and it severely affects the development course of every mid-air application project as well as the user experience (UX) of intended users.Emerging from the field of participatory design, gesture elicitation studies have been widely applied to help designers select the most appropriate gesture set for a given application. Although the method does not have a strict procedure, the main approach is to first define what operations (called "referents") have to be executed through gestures, then ask the end users to propose at least one gesture that they find preferable for each referent and finally to extract the gesture vocabulary after analysing the collected data [16]. The goal of a gesture elicitation study is to extract "good" gestures, which according to Morris et al. [17] are "gestures that meet certain design criteria such as discoverability, ease-of-performance, memorability, or reliability."Over the last few years, several elicitation studies have been conducted to identify mid-air gesture vocabularies for many different application domains and contexts, devices, types of digital content and tracking technologies subsumed. A survey of elicitation studies of mid-air interaction is useful to HCI researchers and interaction designers for deepening th...

show abstract

How Using of WeChat Impacts Individual Loneliness and Health?

Yin

2018

Smart Health

View full text Add to dashboard Cite

User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts

Cited by 48 publications

References 27 publications

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Gesture Elicitation Studies for Mid-Air Interaction: A Review

How Using of WeChat Impacts Individual Loneliness and Health?

Contact Info

Product

Resources

About