Gesture controlled human–computer interface for the disabled

Abstract

Background: The possibility of using a computer by a disabled person is one of the difficult problems of the human-computer interaction (HCI), while the professional activity (employment) is one of the most important factors affecting the quality of life, especially for disabled people. The aim of the project has been to propose a new HCI system that would allow for resuming employment for people who have lost the possibility of a standard computer operation. Material and Methods: The basic requirement was to replace all functions of a standard mouse without the need of performing precise hand movements and using fingers. The Microsoft's Kinect motion controller had been selected as a device which would recognize hand movements. Several tests were made in order to create optimal working environment with the new device. The new communication system consisted of the Kinect device and the proper software had been built. Results: The proposed system was tested by means of the standard subjective evaluations and objective metrics according to the standard ISO 9241-411:2012. The overall rating of the new HCI system shows the acceptance of the solution. The objective tests show that although the new system is a bit slower, it may effectively replace the computer mouse. Conclusions: The new HCI system fulfilled its task for a specific disabled person. This resulted in the ability to return to work. Additionally, the project confirmed the possibility of effective but nonstandard use of the Kinect device.

Suitability of the Kinect Sensor and Leap Motion Controller—A Literature Review

“…There are other studies regarding the Kinects which do not cover precision and accuracy, but rather focus on their use and suitability in multiple fields: virtual laboratories for education [39], helping children with special educational needs [40], measuring and improving mild cognitive impairment [41], improving motivation [42], exercise gaming [43], establishing a gesture controlled interface for people with disabilities [44], assessing game performance of people with physical disabilities [45], studying navigational issues of people with movement disorders in a virtual environment [46] and other, virtual reality therapies [47,48].…”

Gesture Interfacing for People With Disability of the Arm, Shoulder and Hand (Dash) for Smart Door Control: Goms Analysis

“…The interview was divided into two sections. First, in our study, the Quick DASH questionnaire [14] was given to the participants. It was used to classify the group of disabled people with DASH.…”

“…These systems can help to develop human-computer interactions that increase the quality of life through the inclusion of the disabled or elderly people. Another study designed a device for people who lost the ability to perform movement with their fingers and precise movements of the wrist [14]. A Microsoft Kinect device was used to detect the user movements from the waist up.…”