Haptics Electromyography Perception and Learning Enhanced Intelligence for Teleoperated Robot

Abstract

Due to the lack of transparent and friendly human-robot interaction (HRI) interface, as well as various uncertainties, it is usually a challenge to remotely manipulate a robot to accomplish a complicated task. To improve the teleoperation performance, we propose a new perception mechanism by integrating a novel learning method to operate the robots in the distance. In order to enhance the perception of the teleoperation system, we utilize a surface electromyogram signal to extract the human operator's muscle activation. As a response to the changes in the external environment, as sensed through haptic and visual feedback, a human operator naturally reacts with various muscle activations. By imitating the human behaviors in task execution, not only motion trajectory but also arm stiffness adjusted by muscle activation, it is expected that the robot would be able to carry out the repetitive tasks autonomously or uncertain tasks with improved intelligence. To this end, we develop a robot learning algorithm based on probability statistics under an integrated framework of the hidden semi-Markov model (HSMM) and the Gaussian mixture method. This method is employed to obtain a generative task model based on the robot's trajectory. Then, Gaussian mixture regression based on HSMM is applied to correct the robot trajectory with the reproduced results from the learned task model. The execution procedures consist of a learning phase and a reproduction phase. To guarantee the stability, immersion, and maneuverability of the teleoperation system, a variable gain control method that involves electromyography (EMG) is introduced. Experimental results have demonstrated the effectiveness of the proposed method. Note to Practitioners-This paper is inspired by the limitations of teleoperation to perform a task with unfriendly HRI and lack of intelligence. The human operators need to concentrate

Robot Teleoperation System Based on Mixed Reality

“…With the development of the robot manipulators, robots are commonly applied in complex and hash environments, such as space, earthquake rescue, etc. In some particular tasks, it is necessary to control the robot with the help of teleoperation technology [1] [2]. Teleoperation is a process that the operator controls the slave robot at a distance.…”

A Teleoperation Framework for Mobile Robots Based on Shared Control

“…It is noted that the haptic device with a human partner and the mobile platform is a typical teleoperation system. As its passivity is not affected by the proposed approach, the stability can be guaranteed [30].…”

Asymmetric Bimanual Control of Dual-arm Serial Manipulator for Robot-assisted Minimally Invasive Surgeries

“…The robot arms were set to autonomously follow surgical trajectories with five different shapes, a straight line, an angle, a sine curve, a semicircle, and a helix, to demonstrate and evaluate its versatility. (25,26) These shapes are directly related to the usual trajectory performed in MIS suturing and knot-tying techniques, (27)(28)(29) as shown in Fig. 4.…”