One of the hottest topics in rehabilitation robotics is that of proper control of prosthetic devices. Despite decades of research, the state of the art is dramatically behind the expectations. To shed light on this issue, in June, 2013 the first international workshop on Present and future of non-invasive peripheral nervous system (PNS)–Machine Interfaces (MI; PMI) was convened, hosted by the International Conference on Rehabilitation Robotics. The keyword PMI has been selected to denote human–machine interfaces targeted at the limb-deficient, mainly upper-limb amputees, dealing with signals gathered from the PNS in a non-invasive way, that is, from the surface of the residuum. The workshop was intended to provide an overview of the state of the art and future perspectives of such interfaces; this paper represents is a collection of opinions expressed by each and every researcher/group involved in it.

BackgroundTo effectively replace the human hand, a prosthesis should seamlessly respond to user intentions but also convey sensory information back to the user. Restoration of sensory feedback is rated highly by the prosthesis users, and feedback is critical for grasping in able-bodied subjects. Nonetheless, the benefits of feedback in prosthetics are still debated. The lack of consensus is likely due to the complex nature of sensory feedback during prosthesis control, so that its effectiveness depends on multiple factors (e.g., task complexity, user learning).MethodsWe evaluated the impact of these factors with a longitudinal assessment in six amputee subjects, using a clinical setup (socket, embedded control) and a range of tasks (box and blocks, block turn, clothespin and cups relocation). To provide feedback, we have proposed a novel vibrotactile stimulation scheme capable of transmitting multiple variables from a multifunction prosthesis. The subjects wore a bracelet with four by two uniformly placed vibro-tactors providing information on contact, prosthesis state (active function), and grasping force. The subjects also completed a questionnaire for the subjective evaluation of the feedback.ResultsThe tests demonstrated that feedback was beneficial only in the complex tasks (block turn, clothespin and cups relocation), and that the training had an important, task-dependent impact. In the clothespin relocation and block turn tasks, training allowed the subjects to establish successful feedforward control, and therefore, the feedback became redundant. In the cups relocation task, however, the subjects needed some training to learn how to properly exploit the feedback. The subjective evaluation of the feedback was consistently positive, regardless of the objective benefits. These results underline the multifaceted nature of closed-loop prosthesis control as, depending on the context, the same feedback interface can have different impact on performance. Finally, even if the closed-loop control does not improve the performance, it could be beneficial as it seems to improve the subjective experience.ConclusionsTherefore, in this study we demonstrate, for the first time, the relevance of an advanced, multi-variable feedback interface for dexterous, multi-functional prosthesis control in a clinically relevant setting.Electronic supplementary materialThe online version of this article (10.1186/s12984-018-0371-1) contains supplementary material, which is available to authorized users.

The new method implements a high level, low effort control of complex functions in addition to the low level closed-loop control. The latter is achieved by providing rich visual feedback, which is integrated into the real life environment. The proposed system is an effective interface applicable with small alterations for many advanced prosthetic and orthotic/therapeutic rehabilitation devices.

State of the art clinical hand prostheses are controlled in a simple and limited way that allows the activation of one function at a time. More advanced laboratory approaches, based on machine learning, offer a significant increase in functionality, but their clinical impact is limited, mainly due to lack of reliability. In this study, we analyse two conceptually different machine learning approaches, focusing on their robustness and performance in a closed loop application. A classification (finite number of classes) and a regression (continuous mapping) based projection of EMG into external commands were applied while artificially introducing non-stationarities in the EMG signals. When tested on ten able-bodied individuals and one transradial amputee, the two methods were similarly influenced by non-stationarities when tested offline. However, in online tests, where the user could adapt his muscle activation patterns to the changed conditions, the regression-based approach was significantly less influenced by the changes in signal features than the classification approach. This observation demonstrates, on the one hand, the importance of online tests with users in the loop for assessing the performance of myocontrol approaches. On the other hand, it also demonstrates that regression allows for a better user correction of control commands than classification.

The tests demonstrated that the system was easy to setup and apply. The design and resolution of the multipad electrode was evaluated. Importantly, the novel dynamic patterns, which were successfully tested, can be superimposed to transmit multiple feedback variables intuitively and simultaneously. This is especially relevant for closing the loop in modern multifunction prostheses. Therefore, the proposed system is convenient for practical applications and can be used to implement sensory perception training and/or closed-loop control of myoelectric prostheses, providing grasping force and proprioceptive feedback.

Abstract-Providing somatosensory feedback to the user of a myoelectric prosthesis is an important goal since it can improve the utility as well as facilitate the embodiment of the assistive system. Most often, the grasping force was selected as the feedback variable and communicated through one or more individual single channel stimulation units (e.g., electrodes, vibration motors). In the present study, an integrated, compact, multichannel solution comprising an array electrode and a programmable stimulator was presented. Two coding schemes (15 levels), spatial and mixed (spatial and frequency) modulation, were tested in able-bodied subjects, psychometrically and in force control with routine grasping and force tracking using real and simulated prosthesis. The results demonstrated that mixed and spatial coding, although substantially different in psychometric tests, resulted in a similar performance during both force control tasks. Furthermore, the ideal, visual feedback was not better than the tactile feedback in routine grasping. To explain the observed results, a conceptual model was proposed emphasizing that the performance depends on multiple factors, including feedback uncertainty, nature of the task and the reliability of the feedforward control. The study outcomes, specific conclusions and the general model, are relevant for the design of closed-loop myoelectric prostheses utilizing tactile feedback.

BackgroundActive hand prostheses controlled using electromyography (EMG) signals have been used for decades to restore the grasping function, lost after an amputation. Although myocontrol is a simple and intuitive interface, it is also imprecise due to the stochastic nature of the EMG recorded using surface electrodes. Furthermore, the sensory feedback from the prosthesis to the user is still missing. In this study, we present a novel concept to close the loop in myoelectric prostheses. In addition to conveying the grasping force (system output), we provided to the user the online information about the system input (EMG biofeedback).MethodsAs a proof-of-concept, the EMG biofeedback was transmitted in the current study using a visual interface (ideal condition). Ten able-bodied subjects and two amputees controlled a state-of-the-art myoelectric prosthesis in routine grasping and force steering tasks using EMG and force feedback (novel approach) and force feedback only (classic approach). The outcome measures were the variability of the generated forces and absolute deviation from the target levels in the routine grasping task, and the root mean square tracking error and the number of sudden drops in the force steering task.ResultsDuring the routine grasping, the novel method when used by able-bodied subjects decreased twofold the force dispersion as well as absolute deviations from the target force levels, and also resulted in a more accurate and stable tracking of the reference force profiles during the force steering. Furthermore, the force variability during routine grasping did not increase for the higher target forces with EMG biofeedback. The trend was similar in the two amputees.ConclusionsThe study demonstrated that the subjects, including the two experienced users of a myoelectric prosthesis, were able to exploit the online EMG biofeedback to observe and modulate the myoelectric signals, generating thereby more consistent commands. This allowed them to control the force predictively (routine grasping) and with a finer resolution (force steering). The future step will be to implement this promising and simple approach using an electrotactile interface. A prosthesis with a reliable response, following faithfully user intentions, would improve the utility during daily-life use and also facilitate the embodiment of the assistive system.Electronic supplementary materialThe online version of this article (doi:10.1186/s12984-015-0047-z) contains supplementary material, which is available to authorized users.

The CASP constitutes a substantial improvement for the control of multi-DOF prostheses. The application of the CASP will have a significant impact when translated to real-life scenarious, particularly with respect to improving the usability and acceptance of highly complex systems (e.g., full prosthetic arms) by amputees.