Mobile Interaction for Augmentative and Alternative Communication: a Systematic Mapping

Abstract

Verbal communication is essential for socialization, meaning construction and knowledge sharing in a society. When verbal communication does not occur naturally because of constraints in people’s and environments capabilities, it is necessary to design alternative means. Augmentative and Alternative Communication (AAC) aims to complement or replace speech to compensate difficulties of verbal expression. AAC systems can provide technological support for people with speech disorders, assisting in the inclusion, learning and sharing of experiences. This paper presents a systematic mapping of the literature to identify research initiatives regarding the use of mobile devices and AAC solutions. The search identified 1366 potentially eligible scientific articles published between 2006 and 2016, indexed by ACM, IEEE, Science Direct, and Springer databases and by the SBC Journal on Interactive Systems. From the retrieved papers, 99 were selected and categorized into themes of research interest: games, autism, usability, assistive technology, AAC, computer interfaces, interaction in mobile devices, education, among others. Most of papers (57 out of 99) presented some form of interaction via mobile devices, and 46 papers were related to assistive technology, from which 14 were related to AAC. The results offer an overview on the applied research on mobile devices for AAC, pointing out to opportunities and challenges in this research domain, with emphasis on the need to promoting the use and effective adoption of assistive technology.

Pictogram Prediction in Alternative Communication Boards: a Mapping Study

“…Although various mapping studies and systematic reviews investigate the effect of high-tech AAC on users' communication [Ascari et al 2018, Aydin and Diken 2020, Dada et al 2022, we found no similar research regarding the use of pictogram prediction in AAC systems, and its effect in users' communication. In this paper, we systematically map the literature searching for the strategies used for pictogram prediction in high-tech AAC systems and the methods used to evaluate them.…”

LAIR - Language As Intermediate Representation

“…Technical AAC solutions for symbol-based communication range from simple concatenation of symbols for needs-based, functional communication with small vocabularies to complex (commercial) systems (see, e.g., Lancioni et al (2019) for a detailed survey). Currently, technical AAC solutions are evolving rapidly and are increasingly available on mainstream devices like smartphones and tablets (Light and McNaughton, 2012;Ascari et al, 2018;Farzana et al, 2021).…”

Redesign of user interface for e-government application using usability testing method

“…La CAA incorpora una amplia gama de procesos que aumentan, complementan o reemplazan el habla de individuos con necesidades complejas de comunicación (Cook & Polgar, 2014;Schultz Ascari et al, 2018). En el amplio contexto del habla y el lenguaje, el habla a menudo se asocia con los movimientos motores responsables de la producción de palabras habladas, mientras que el lenguaje se asocia con las habilidades de procesamiento cognitivo de la comunicación.…”