Emotion-Driven Analysis and Control of Human-Robot Interactions in Collaborative Applications

Abstract

The utilization of robotic systems has been increasing in the last decade. This increase has been derived by the evolvement in the computational capabilities, communication systems, and the information systems of the manufacturing systems which is reflected in the concept of Industry 4.0. Furthermore, the robotics systems are continuously required to address new challenges in the industrial and manufacturing domain, like keeping humans in the loop, among other challenges. Briefly, the keeping humans in the loop concept focuses on closing the gap between humans and machines by introducing a safe and trustworthy environment for the human workers to work side by side with robots and machines. It aims at increasing the engagement of the human as the automation level increases rather than replacing the human, which can be nearly impossible in some applications. Consequently, the collaborative robots (Cobots) have been created to allow physical interaction with the human worker. However, these cobots still lack of recognizing the human emotional state. In this regard, this paper presents an approach for adapting cobot parameters to the emotional state of the human worker. The approach utilizes the Electroencephalography (EEG) technology for digitizing and understanding the human emotional state. Afterwards, the parameters of the cobot are instantly adjusted to keep the human emotional state in a desirable range which increases the confidence and the trust between the human and the cobot. In addition, the paper includes a review on technologies and methods for emotional sensing and recognition. Finally, this approach is tested on an ABB YuMi cobot with commercially available EEG headset.

Analyzing the Role of Emotional Intelligence on the Performance of Small and Medium Enterprises (SMEs) Using AI-Based Convolutional Neural Networks (CNNs)

“…It was shown that frequency-domain characteristics on different bands had a better prediction rate compared to time-domain features. Human emotions may be taken into account while configuring cobot's settings [14]. For digitizing and analyzing the emotional state of people, this method makes use of electroencephalography (EEG).…”

Research Status and Challenges on the Sustainable Development of Artificial Intelligence Courses from a Global Perspective

“…As the higher-level intelligent creature, humans represent more complex and diversified needs such as personal security, health, friendship, love, respect, recognition, and so forth. In this regard, humans are highly flexible resources due to the high degree of motion of the physical structure and the high level of intelligence and recognition [129]. When we consider humans and robots work as a team, organizing their needs and getting a common ground is a precondition for human-robot collaboration in complex missions and dynamic changing environments.…”

Human Factors Considerations for Quantifiable Human States in Physical Human–Robot Interaction: A Literature Review

“…Some of these studies have explored the use of two robotic arms to hold an object for an operator while they work on it [118]. Other studies have focused on typical assembly tasks where a robot holds an object and the user assembles another part into it [116,117,119,120], or welds a wire into it [115].…”