A Novel Multimodal Human-Exoskeleton Interface Based on EEG and sEMG Activity for Rehabilitation Training

Multimodal Human–Robot Interaction for Human‐Centric Smart Manufacturing: A Survey

“…Human emotion recognition for natural HRI [153,157,158] -Voice user interface for in-vehicle interaction [174] -Audio-based motion generation for HRI [195] User-oriented programming of collaborative robots [96] Audio-vision speech recognition for HRI of the industrial robot and HMI [56,73] VLN for autonomous agent interaction with human and environment [167] Haptics Teaching by demonstration task for HRC [196] -Hardness, temperature and roughness feedback for robot hand controlling and VR applications (haptic glove) [118] Ion-electronic skin providing realtime force directions and strain profiles for various tactile motions (shear, pinch, spread, torsion…) [101] Slip detection and re-grasp planning of unknown objects for robot robust grasping [88] A wearable glove for hand pose and sensory inputs identification for HRI [117] Multimodal robotic sensing system (M-Bot) for HMI [105] PBVS with collision avoidance for safe pHRC [170] Robot self-learning for complex manipulations skills (play Jenga) [89] Robotic manipulators learning from demonstrations for industrial processes such as assembly [108] In-hand pose estimation for robotic assembly [110] Physiology Human activity recognition (MR glass) for hands-free HRI [197] Hand gesture recognition for HMI [97] Wearable glove (hand pose reconstruction, identify sensory inputs such as holding force, object temperature, conductibility, material stiffness, user hear rate) [117] Gesture-based control (EMG þ EEG) to detect and correct robot mistakes for HRI target selection tasks [198] Human motion intention recognition for HRC sawing task [172] Human emotion recognition for HRI and HCI [125,152,157] Lower limb movement prediction for HRI [199] 6.1.…”