A Novel Robot-Aided Upper Limb Rehabilitation Training System Based on Multimodal Feedback

Abstract

During robot-aided rehabilitation exercises, monotonous, and repetitive actions can, to the subject, feel tedious and tiring, so improving the subject's motivation and active participation in the training is very important. A novel robot-aided upper limb rehabilitation training system, based on multimodal feedback, is proposed in this investigation. To increase the subject's interest and participation, a friendly graphical user interface and diversiform game-based rehabilitation training tasks incorporating multimodal feedback are designed, to provide the subject with colorful and engaging motor training. During this training, appropriate visual, auditory, and tactile feedback is employed to improve the subject's motivation via multi-sensory incentives relevant to the training performance. This approach is similar to methods applied by physiotherapists to keep the subject focused on motor training tasks. The experimental results verify the effectiveness of the designed multimodal feedback strategy in promoting the subject's participation and motivation.

I-BaR: integrated balance rehabilitation framework

“…For instance, the ability of visualization shows spatial aspects, while audio/tactile feedback allows temporal aspects. Studies on the neurophysiology of somatosensory information processing emphasize that multiple cortical and subcortical brain (CNS and PNS) structures take an active role in sensory discrimination tests (Sigrist et al, 2013 ; Lee et al, 2018 ; Pan et al, 2019 ). Moreover, a stimulators should be placed on the skin of the patient so that muscles with low activity in sEMG measurement can be triggered.…”

“…For example, the learning process of motion detection tasks progressed positively even when auditory feedback was canceled after training with audio-visual feedback. This shows the importance of multi-modal training for complex motion recovery even at a further level (Sigrist et al, 2013 ; Pan et al, 2019 ; Morone et al, 2021 ). A study examined the recognition of object recognition defined by auditory and visual features.…”

Enhancing Stroke Rehabilitation with Whole-Hand Haptic Rendering: Development and Clinical Usability Evaluation of a Novel Upper-Limb Rehabilitation Device

“…multi-modal sensory information can increase motor performance [76,128]. However, such a feature should be optional as the provision of audiovisual multi-modal information in an already cognitively demanding situation-in stroke rehabilitation depending on the individual patient's abilities-can also undesirably excessively increase the cognitive workload [76].…”

An Image-Based Interactive Training Method of an Upper Limb Rehabilitation Robot

“…Guo et al proposed an interactive control method of a lower limb exoskeleton robot using an adaptive admittance model [8] Guang et al proposed an interactive upper limb rehabilitation robot [9], which can display the motion trajectory through a parallel mechanism and a non-equidistant screen on the platform, and provide users with the most intuitive visual feedback. There are also many similar robotic rehabilitation systems that have been designed with visual feedback [10,11], which greatly improves user engagement in the process of use and enables them to achieve better rehabilitation effects. At the same time, the robot control system, when combined with the image processing method, has also achieved good results in the exper iment.…”