Multi-Touch Collaborative Gesture Recognition Based User Interfaces as Behavioral Interventions for Children with Autistic Spectrum Disorder: A Review

Hassan, Ahmed; Shafi, Muhammad; Khattak, Muhammad Irfan

doi:10.22581/muet1982.1604.06

Cited by 5 publications

(5 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To ensure the naturalness of a VE, the interface of a VR application should be consistent and coordinated [6]. Interactions by the traditional interactive tools like keyboard and mouse are insufficient and lag behind to completely involve the users [7][8] in interactive 3D VE. As hand gestures are adaptable and flexible, hence suitable for interactions in a VE [2,9].…”

Section: Related Workmentioning

confidence: 99%

Thumb Inclination-Based Manipulation and Exploration, a Machine Learning Based Interaction Technique for Virtual Environments

Raees

Ullah

Rehman

et al. 2021

Mehran Univ. res. j. eng. technol.

View full text Add to dashboard Cite

In the context of Virtual Reality (VR), interactions refer to the plausible actions in a Virtual Environment (VE). To have an engrossing interface, interactions by the gestures of hand are becoming prominent. With thisresearch work, a novel interaction technique is proposed where interactions are performed on the basis of the position of thumb in dynamic image stream. The technique needs no expensive tracker but an ordinary camera to trace hand movements and position of thumb. The interaction tasks are enacted in distinct interaction states, where the Angle of Inclination (AOI) of thumb is used for state-to-state transition. The angle is computed dynamically between the tip-of-thumb and the base of the Region of Interest (ROI) of an input image. The technique works in two phases: learning phase and application phase. In the learning phase, user-defined fist-postures with distinct AOI are learnt. The Support Vector Machine (SVM) classifier is trained by the AOI of the postures. In the application phase, interactions are performed in distinct interaction states whereas a particular state is activated by posing the known posture. To follow the trajectory of thumb, dynamic mapping is performed to control a virtual hand by the position of thumb in the input image. The technique is implemented in a Visual Studio project called Thumb-Based Interaction for Virtual Environments (TIVE). The project was evaluated by a group of 15 users in a moderate lighting condition. The 89.7% average accuracy rate of the evaluation proves suitability of the technique in the wide range VR applications.

show abstract

Section: Related Workmentioning

confidence: 99%

Thumb Inclination-Based Manipulation and Exploration, a Machine Learning Based Interaction Technique for Virtual Environments

Raees

Ullah

Rehman

et al. 2021

Mehran Univ. res. j. eng. technol.

View full text Add to dashboard Cite

show abstract

“…This app is free and available through Google Play. Currently, more than 7,000 downloads have been exceeded in Spanish-speaking countries [55][56][57]. Alves et al (2013) presented the 'LIFEisGAME' prototype-Ipad version, a game that promotes facial emotion recognition and helps people with ASD to understand emotions so to develop empathy using real-time automatic facial expression analysis and virtual character synthesis.…”

Section: Literature Reviewmentioning

confidence: 99%

Mobile Applications to Improve Emotional Intelligence in Autism – A Review

Papoutsi

Drigas

Skianis

2018

Int. J. Interact. Mob. Technol.

View full text Add to dashboard Cite

<p>The ability to understand and regulate emotions in ourselves and others is essential for the healthy development of all human beings. It helps people comprehend themselves and other people, it guides response and decision making and enhances the capacity to develop social relationships. People with Autistic Spectrum Disorders have deficiencies in Emotional Intelligence skills and that leads to difficulties in understanding themselves and the people in their social environments in relation to emotions, feelings and thoughts. The usability of mobile applications developed for children and adolescents with ASD is important because it gives the opportunity to practice in an accessible and creative way to enhance their emotional intelligence. The current article aims to carry out a systematic review of mobile applications on improving emotional intelligence in children and adolescents with Autistic Spectrum Disorders.</p>

show abstract

“…With the current advancements in technology applications, considering non-verbal communication such as gesture recognition can produce best results for Low functioning (LF) autistic kids. There is very less work done on Applications allowing concurrent multiple users or a group of users whereas studies have shown that applications with more than one simultaneous user can have best results as it develops social interaction naturally [4]. Existing literature also shows that significant work is not done on sensory processing disorders, only one such UI is present, and it focuses on vision only [42].…”

Section: Future Workmentioning

confidence: 99%

“…Unlike the traditional interfaces, it allows the user to utilize the graphical interface in a natural way, and it also supports multi-user interaction. Therefore, making it extremely beneficial for enhancing the social skills of Autistic children [4].…”

Section: Introductionmentioning

confidence: 99%

On the Adaptability and Applicability of Multi-touch User Interfaces Addressing Behavioral Interventions for Children with Autism

Hassan

Pinkwart

2019

IETE Technical Review

Self Cite

View full text Add to dashboard Cite

Principles of human-computer interaction (HCI) are imperative when it comes to efficient user interface design. This becomes even more significant when the interface is for users with special needs and especially when there is a treatment methodology incorporated in a piece of software. This study investigates user interfaces that are specifically made for children with autism-spectrum disorders. We conducted a survey to evaluate the adaptability and applicability of various interfaces. For this, we selected four of the behavioral interventions for autism namely discrete trial training (DTT), cognitive-behavioral therapy (CBT), empathy enhancement and verbal behavior approach (VBA). User interfaces (UIs) of 16 software applications were assessed for the said features. Results of this assessment revealed that these Applications were adaptable to two behavioral interventions, on the average. Moreover, these Applications were simultaneously applicable for treatment of three levels of autism; namely high functioning, low functioning, and autistic adults. These interfaces were also applicable to the children with no autism (typically developing) who acted as a controlled group.

show abstract

Multi-Touch Collaborative Gesture Recognition Based User Interfaces as Behavioral Interventions for Children with Autistic Spectrum Disorder: A Review

Cited by 5 publications

References 23 publications

Thumb Inclination-Based Manipulation and Exploration, a Machine Learning Based Interaction Technique for Virtual Environments

Thumb Inclination-Based Manipulation and Exploration, a Machine Learning Based Interaction Technique for Virtual Environments

Mobile Applications to Improve Emotional Intelligence in Autism – A Review

On the Adaptability and Applicability of Multi-touch User Interfaces Addressing Behavioral Interventions for Children with Autism

Contact Info

Product

Resources

About