Eye-gaze control of a wheelchair mounted 6DOF assistive robot for activities of daily living

Abstract

Background Building control architecture that balances the assistive manipulation systems with the benefits of direct human control is a crucial challenge of human–robot collaboration. It promises to help people with disabilities more efficiently control wheelchair and wheelchair-mounted robot arms to accomplish activities of daily living. Methods In this study, our research objective is to design an eye-tracking assistive robot control system capable of providing targeted engagement and motivating individuals with a disability to use the developed method for self-assistance activities of daily living. The graphical user interface is designed and integrated with the developed control architecture to achieve the goal. Results We evaluated the system by conducting a user study. Ten healthy participants performed five trials of three manipulation tasks using the graphical user interface and the developed control framework. The 100% success rate on task performance demonstrates the effectiveness of our system for individuals with motor impairments to control wheelchair and wheelchair-mounted assistive robotic manipulators. Conclusions We demonstrated the usability of using this eye-gaze system to control a robotic arm mounted on a wheelchair in activities of daily living for people with disabilities. We found high levels of acceptance with higher ratings in the evaluation of the system with healthy participants.

Assistive Robots for Patients With Amyotrophic Lateral Sclerosis: Exploratory Task-Based Evaluation Study With an Early-Stage Demonstrator

“…At the same time, most of the tablet-based UIs offer the possibility to connect additional input devices such as head or eye control. Sunny et al [ 31 ] also followed such an approach. The authors investigated the usability of a control system consisting of an eye-gaze interface and a tablet-based graphical UI for a wheelchair-mounted xArm 6 from UFactory in different manipulation tasks.…”

Optimal Design of a Cable-driven Wrist Prosthetic Device

“…Besides, the values of are expressed in Eqs. (2). Thus, considering two rotation about the ̂ and ̂ axis of the moving platform by an angle and , respectively, the following relation for the points holds:…”

“…Upper limb amputation is the removal of any part of the forearm or arm. Only in the United States, this condition affects approximately 41,000 citizens [1,2]. Besides, according to the results of Ziegler-Graham K. et al, this value may double by 2050 [3].…”

A deep learning based multimodal interaction system for bed ridden and immobile hospital admitted patients: design, development and evaluation

“…Their research demonstrated how alternate means of interaction can be achieved by detecting and tracking very small organs of the human body like eyes and how a GUI can help to improve the interaction. Similarly, Sunny et al [ 31 ] developed a wheelchair mounted robotic arm that can be controlled using eye gaze. In this system also, a GUI was used and it was placed on the wheelchair along with the robotic arm.…”