Gaze, visual, myoelectric, and inertial data of grasps for intelligent prosthetics

Abstract

a hand amputation is a highly disabling event, having severe physical and psychological repercussions on a person's life. Despite extensive efforts devoted to restoring the missing functionality via dexterous myoelectric hand prostheses, natural and robust control usable in everyday life is still challenging. Novel techniques have been proposed to overcome the current limitations, among them the fusion of surface electromyography with other sources of contextual information. We present a dataset to investigate the inclusion of eye tracking and first person video to provide more stable intent recognition for prosthetic control. this multimodal dataset contains surface electromyography and accelerometry of the forearm, and gaze, first person video, and inertial measurements of the head recorded from 15 transradial amputees and 30 able-bodied subjects performing grasping tasks. Besides the intended application for upper-limb prosthetics, we also foresee uses for this dataset to study eye-hand coordination in the context of psychophysics, neuroscience, and assistive robotics.

Gaze, behavioral, and clinical data for phantom limbs after hand amputation from 15 amputees and 29 controls

“…Table 1 displays an overview of the demographical and clinical parameters presented above. For the information relative to able-bodied controls, we invite the reader to see Table 1 in Cognolato et al 13 . ethical requirements.…”

“…These data can then be accessed via a personal computer connected to the base station. For a more detailed description of the acquisition software and most of the devices used in the present study, see Cognolato et al 13 .…”

“…The clinical interview was conducted before the beginning of the exercises described in this manuscript but after the completion of exercise 1 13 . This allowed participants to rest between the exercises in order to prevent muscular fatigue on the residual limb.…”

“…We developed a processing routine in MATLAB (MathWorks, Natick, MA, USA, http:// www.mathworks.com/) to perform data curation (for instance, by verifying the absence of acquisition errors), to synchronize the individual modalities and finally to store them in a single unified data file. This section briefly outlines the processing procedure; for a more detailed description, the reader is referred to Cognolato et al 13 .…”

“…The target field contains integers from 1 to 5 that indicate in increasing order the targets of 1.25 mm, 2.5 mm, 5 mm, 10 mm, and 20 mm. For each of the participants and experimental settings, we also release the video from the first-person perspective encoded with MPEG-4 AVC in an MP4 container 13 .…”