A Gesture Based System for Context – Sensitive Interaction with Smart Homes

Neßelrath, Robert; Lu, Chensheng; Schulz, Christian; Frey, Jochen; Alexandersson, Jan

doi:10.1007/978-3-642-18167-2_15

Cited by 33 publications

(20 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…They conclude that 65% of the top gestures selected in the first experiment were changed in the second, which indicates that there is variability in top gesture proposals even if the same users are involved in subsequent experiments. In [12], the design of a gesture-based prototype for context-sensitive interaction with smart homes is presented for 7 commands and 4 devices; their work did not involve gesture elicitation but prototype development with designer-defined interaction techniques and usability testing. Ng et al [13] also present a prototype for home automation for 5 devices and 2 commands only (switch on/off).…”

Section: Elicitation Studies For Control Of Smart Home Devicesmentioning

confidence: 99%

“…Thus, if mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. A few studies have investigated mid-air interactions for a smart home device ecosystem; most of them employ gestures created by system designers [6,[11][12][13] in contrast to a single study with user elicitation [14].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Vogiatzidakis

Koutsabasis

2019

Informatics

View full text Add to dashboard Cite

If mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. This paper investigates a user-defined gesture vocabulary for basic control of a smart home device ecosystem, consisting of 7 devices and a total of 55 referents (commands for device) that can be grouped to 14 commands (that refer to more than one device). The elicitation study was conducted in a frame (general scenario) of use of all devices to support contextual relevance; also, the referents were presented with minimal affordances to minimize widget-specific proposals. In addition to computing agreement rates for all referents, we also computed the internal consistency of user proposals (single-user agreement for multiple commands). In all, 1047 gestures from 18 participants were recorded, analyzed, and paired with think-aloud data. The study reached to a mid-air gesture vocabulary for a smart-device ecosystem, which includes several gestures with very high, high and medium agreement rates. Furthermore, there was high consistency within most of the single-user gesture proposals, which reveals that each user developed and applied her/his own mental model about the whole set of interactions with the device ecosystem. Thus, we suggest that mid-air interaction support for smart homes should not only offer a built-in gesture set but also provide for functions of identification and definition of personalized gesture assignments to basic user commands.

show abstract

Section: Elicitation Studies For Control Of Smart Home Devicesmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Vogiatzidakis

Koutsabasis

2019

Informatics

View full text Add to dashboard Cite

show abstract

“…Due to the increased accessibility of low cost sensors like the Microsoft Kinect and other depth cameras, the vision of a ubiquitous gestural interface for smart homes increasingly becomes a reality. Accordingly, mid air interaction has been a big topic in recent research [1,4,6,10,12,13,14,16,19,20,23]. However, all the aforementioned projects have in common that they focus on gestures performed with the complete or at least part of the arm.…”

Section: Introductionmentioning

confidence: 99%

Better Than You Think: Head Gestures for Mid Air Input

Plaumann

Ehlers²,

Geiselhart

et al. 2015

Human-Computer Interaction – INTERACT 2015

View full text Add to dashboard Cite

“…The authors conducted a questionnaire-based usability evaluation of a prototype with ten participants using a Likert scale with questions of effectiveness, efficiency, experience and satisfaction. Another application that uses the Wiimote was developed by Neßelrath et al [29] for gestural interaction with three appliances: kitchen hood, room lighting and TV. The main concern of the authors was to find a small set of commands for the application.…”

Section: Non-perceptual Technologiesmentioning

confidence: 99%

“…Following this principle, the gestural vocabulary would become more intuitive, easing the learning curve of users. Some solutions acknowledge this principle [13,29], but do not take into account whether the gestures are ambiguous regarding the target population, since ambiguity is intrinsically related to the cultural aspects of the population. As an example of the problem of not considering the interdependency of gestural ambiguity with cultural aspects, the application in [39] uses only deictic gestures (pointing gestures).…”

Section: Socio-technical Aspects Of Gestural Interaction: Framework Amentioning

confidence: 99%

Gesture-Based Interaction in Domotic Environments: State of the Art and HCI Framework Inspired by the Diversity

Correia

Miranda

Hornung

2013

Human-Computer Interaction – INTERACT 2013

View full text Add to dashboard Cite

Abstract. Applications for the control and automation of residential environments (domotics) are an emerging area of study within HumanComputer Interaction (HCI). One of the related challenges is to design gestural interaction with these applications. This paper explores socio-technical aspects of gestural interaction in intelligent domotic environments. An analysis of literature in the area revealed that some HCI-related aspects are treated in a restricted manner that neglects socio-technical dimensions. We propose a framework for discussing related challenges in an integrated manner, considering the dimensions people, gestural mode of interaction, and domotics. Some of these challenges are addressed by literature outside the area of domotics. Many open research questions remain, e.g. how to design gestural vocabularies that minimize ambiguity and consider cultural and social aspects. The proposed framework might contribute to answering these questions thus to designing meaningful interaction that is intuitive and easy to learn.

show abstract

A Gesture Based System for Context – Sensitive Interaction with Smart Homes

Cited by 33 publications

References 3 publications

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

Better Than You Think: Head Gestures for Mid Air Input

Gesture-Based Interaction in Domotic Environments: State of the Art and HCI Framework Inspired by the Diversity

Contact Info

Product

Resources

About