NeuroSuitUp: System Architecture and Validation of a Motor Rehabilitation Wearable Robotics and Serious Game Platform

Abstract

Background: This article presents the system architecture and validation of the NeuroSuitUp body–machine interface (BMI). The platform consists of wearable robotics jacket and gloves in combination with a serious game application for self-paced neurorehabilitation in spinal cord injury and chronic stroke. Methods: The wearable robotics implement a sensor layer, to approximate kinematic chain segment orientation, and an actuation layer. Sensors consist of commercial magnetic, angular rate and gravity (MARG), surface electromyography (sEMG), and flex sensors, while actuation is achieved through electrical muscle stimulation (EMS) and pneumatic actuators. On-board electronics connect to a Robot Operating System environment-based parser/controller and to a Unity-based live avatar representation game. BMI subsystems validation was performed using exercises through a Stereoscopic camera Computer Vision approach for the jacket and through multiple grip activities for the glove. Ten healthy subjects participated in system validation trials, performing three arm and three hand exercises (each 10 motor task trials) and completing user experience questionnaires. Results: Acceptable correlation was observed in 23/30 arm exercises performed with the jacket. No significant differences in glove sensor data during actuation state were observed. No difficulty to use, discomfort, or negative robotics perception were reported. Conclusions: Subsequent design improvements will implement additional absolute orientation sensors, MARG/EMG based biofeedback to the game, improved immersion through Augmented Reality and improvements towards system robustness.

Deep reinforcement learning to assess lower extremity movement intention and assist a rehabilitation exoskeleton

“…In this initial phase, our research focuses on first controlling a graphical avatar within the Unity game engine (Unity Technologies, San Francisco, CA) using the LSTM-PPO framework. This step not only demonstrates the feasibility of our approach but also sets the stage for subsequent implementation in physical exoskeleton prototypes [16]. Later, our work focuses on implementing a sliding mode control for the controlling PAMs and our exoskeleton movement [5].…”

Electromyography Acquisition and Intervention in Healthcare for Older Adults: A HCI Scoping Review

“…It was discovered that both patients and physicians conveyed positive feedback regarding the technology, albeit with safety and comfort concerns. To facilitate a multimodal approach, the NeuroSuitUp platform [42] utilized various technologies like wearable robots, serious games, and more. This integration offers a comprehensive rehabilitation pathway and a richer therapeutic experience for patients.…”

“…-Smart wheelchairs [13] -Robot for daily hand tasks and rehabilitation [14], [26] -Toolbox for the muscle data analysis [15] Gamified therapy 11 -Virtual reality training and Electromyographic biofeedback [43] -VR or AR motor imagery [44] -Serious game [29] Wearable 12 -Electromyographic sensor placement [45] -Electrical stimulation patches [28], [42] Interface design 14 -Facial expression classified [21] -Hand gesture controlling [37] -Brain computer interface [46] Due to the necessity of wearing electromyographic sensors and electrical stimulation devices, a total of 7, 6, and 4 articles respectively discussed the interdisciplinary applications of wearable technology in Assistive Technology and Tool Design, Gamified Therapy, and Interface design. Furthermore, among the papers reviewed, four of them shared a common theme of Assistive Technology and Tool Design, along with Interface Design.…”

Editorial: Immersive media in connected health—volume II

“…Moving on to the field of collaborative and assistive robotics, which, along with various converging technologies, have seen rapid developments enhancing their usability and clinical applicability ( 11 ), while implementations in XR environments and gamification ( 12 ) expand their potential through immersiveness, empowerment and improved overall user experience. Although the role of emotions and affective states are considered crucial to the learning process, their implications on rehabilitation process have not been sufficiently studied ( 13 ).…”