Development of an interactive artifact for cognitive rehabilitation based on augmented reality

Abstract

Cognitive rehabilitation, which uses software applications (multimedia), advanced physical devices (PDAs, cellular phones, etc.) or virtual reality applications, presents limitations of several types related to: workspace, realistic representation, intuitive interaction, dexterity demand, availability, devices dependency, user-friendly interface, customization, multi-sensory input/output, complexity, etc. Recently, the technological evolution has allowed the development of artifacts based on augmented reality that overcome most of the weaknesses of the applications implemented with the previous technology. In this way, this paper presents and discusses the development of an interactive artifact based on augmented reality, which makes possible intuitive tangible interactions, multi-sensory feedback, customization, simplicity and the implementation of cognitive exercises. Ten users evaluated cognitive applications running over the interactive artifact under the point-of-view of augmented reality, giving their impressions. Finally, we discuss the potential of the interactive artifact, pointing out directions to improve its structure and utilization by cognitive disabled people.

Realidade Aumentada e Gamificação na Educação: uma aplicação para auxiliar no processo de aprendizagem de alunos com deficiência intelectual

“…Nos últimos anos, diversos aplicativos de software (com recursos de multimídia e/ou de Realidade Virtual -RV) vêm sendo propostos como recursos alternativos aos métodos tradicionais de ensino (quadro, livro, caderno, entre outros), com o intuito de neutralizar as barreiras causadas pela deficiência e promover a inclusão dos mesmos, 1 http://aaidd.org/ independentemente de suas diferenças [26,31]. Entretanto, embora apresentem resultados promissores, várias instituições filantrópicas, entre elas a Associação de Pais e Amigos dos Excepcionais (APAE), que oferecem atendimento às pessoas com necessidades educacionais especiais, encontram dificuldades na aquisição e emprego dessas tecnologias em seus métodos educacionais.…”

Using Smartphones to Assist People with Down Syndrome in Their Labour Training and Integration: A Case Study

“…Thus, we found projects such as Artifact-AR [16], an augmented reality system for cognitive rehabilitation. It uses a three-dimensional structure with tags and pointers to work on memory, sequencing, and images identification.…”

A Survey of Multimodal Systems and Techniques for Motor Learning

“…VR systems are rarely used in home environments, due to high complexity, maintenance requirements and very high costs [13]. As an alternative, some augmented reality (AR) systems, where the real world is augmented with the presence of virtual objects and information, have been employed [14,15]. However, there is insufficient testing to promote AR-based approaches as effective mechanisms for home exercise.…”