Multimodal Interaction for Accessible Smart Homes

Almeida, Nuno; Silva, Samuel; Teixeira, António; Ketsmur, Maksym; Guimarães, Diogo; Fonseca, Emanuel

doi:10.1145/3218585.3218595

Cited by 8 publications

(2 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Voice assistants are accessible to people with vision and/or motor difficulties, but cannot be used by the speech-impaired, for example. A possible solution for smart homes that are more accessible to all is multimodal interaction [ 9 , 41 , 42 ], i.e., interaction through different redundant input/output modalities, which allows the users to choose the most adequate for them and the current context.…”

Section: Background and Related Workmentioning

confidence: 99%

“…An architecture and framework for multimodal interaction was proposed and demonstrated through proof-of-concept applications in smart environments, including smart homes [ 19 , 41 ]. In another contribution, a multimodal interaction system based on three different modalities (eye blinking, speech, and touch) was implemented with the aim of allowing people with limited physical mobility to control the devices and appliances of a smart home [ 43 ].…”

Section: Background and Related Workmentioning

confidence: 99%

See 1 more Smart Citation

An Accessible Smart Home Based on Integrated Multimodal Interaction

Rocha

Ketsmur

Almeida

et al. 2021

Sensors

Self Cite

View full text Add to dashboard Cite

Our homes are becoming increasingly sensorized and smarter. However, they are also becoming increasingly complex, making accessing them and their advantages difficult. Assistants have the potential for improving the accessibility of smart homes, by providing everyone with an integrated, natural, and multimodal way of interacting with the home’s ecosystem. To demonstrate this potential and contribute to more environmentally friendly homes, in the scope of the project Smart Green Homes, a home assistant highly integrated with an ICT (Information and communications technology) home infrastructure was developed, deployed in a demonstrator, and evaluated by seventy users. The users’ global impression of our home assistant is in general positive, with 61% of the participants rating it as good or excellent overall and 51% being likely or very likely to recommend it to others. Moreover, most think that the assistant enhances interaction with the smart home’s multiple devices and is easy to use by everyone. These results show that a home assistant providing an integrated view of a smart home, through natural, multimodal, and adaptive interaction, is a suitable solution for enhancing the accessibility of smart homes and thus contributing to a better living ambient for all of their inhabitants.

show abstract

Section: Background and Related Workmentioning

confidence: 99%

Section: Background and Related Workmentioning

confidence: 99%