The robustness and usability of pattern recognition based myoelectric control systems degrade significantly if the sensors are displaced during usage. This effect inevitably occurs during donning, doffing or using an upper-limb prosthesis over a longer period of time. Electrode shift has been previously studied but remains an unsolved problem. In this study we investigate if increasing the number of electrode channels and recording locations can improve the degraded classification accuracy caused by electrode shift. In our experiment we use a 96 channel high density electrode array to distinguish 11 different hand and wrist movements. Our results show that for electrode shifts up to 1 cm an array of about 32 sensors in combination with state-of-the-art pattern recognition algorithms is sufficient to compensate the electrode displacement effect.
Background
Hand amputation can have a truly debilitating impact on the life of the affected person. A multifunctional myoelectric prosthesis controlled using pattern classification can be used to restore some of the lost motor abilities. However, learning to control an advanced prosthesis can be a challenging task, but virtual and augmented reality (AR) provide means to create an engaging and motivating training.
Methods
In this study, we present a novel training framework that integrates virtual elements within a real scene (AR) while allowing the view from the first-person perspective. The framework was evaluated in 13 able-bodied subjects and a limb-deficient person divided into intervention (IG) and control (CG) groups. The IG received training by performing simulated clothespin task and both groups conducted a pre- and posttest with a real prosthesis. When training with the AR, the subjects received visual feedback on the generated grasping force. The main outcome measure was the number of pins that were successfully transferred within 20 min (task duration), while the number of dropped and broken pins were also registered. The participants were asked to score the difficulty of the real task (posttest), fun-factor and motivation, as well as the utility of the feedback.
Results
The performance (median/interquartile range) consistently increased during the training sessions (4/3 to 22/4). While the results were similar for the two groups in the pretest, the performance improved in the posttest only in IG. In addition, the subjects in IG transferred significantly more pins (28/10.5 versus 14.5/11), and dropped (1/2.5 versus 3.5/2) and broke (5/3.8 versus 14.5/9) significantly fewer pins in the posttest compared to CG. The participants in IG assigned (mean ± std) significantly lower scores to the difficulty compared to CG (5.2 ± 1.9 versus 7.1 ± 0.9), and they highly rated the fun factor (8.7 ± 1.3) and usefulness of feedback (8.5 ± 1.7).
Conclusion
The results demonstrated that the proposed AR system allows for the transfer of skills from the simulated to the real task while providing a positive user experience. The present study demonstrates the effectiveness and flexibility of the proposed AR framework. Importantly, the developed system is open source and available for download and further development.
Even small changes of electrode recording sites after training a classifier heavily influence robustness and usability of traditional pattern recognition-based myoelectric control schemes. This effect occurs during donning and doffing of the prosthesis or when changing the arm position and generally leads to a significant decrease of classification accuracy. On the other hand, image representations taken from high density electromyographic (EMG) signals offer high spatial resolution and only seem to change slightly during electrode shift, preserving most structural information. In this paper, we present a simple one-against-one nearest neighbor classifier based on the Structural Similarity Index (SSIM). SSIM quantifies visual similarity of two images based on decomposition into three components: luminance, contrast and structure. Our experimental results indicate that an SSIM-based classifier can outperform an LDA-based classifier using structural information taken from high density EMG signals during simulated electrode shift.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.