A Multimodal Human-Robot-Interaction Scenario: Working Together with an Industrial Robot

Bannat, Alexander; Gast, Jürgen; Rehrl, Tobias; Rösel, Wolfgang; Rigoll, Gerhard; Wallhoff, Frank

doi:10.1007/978-3-642-02577-8_33

Cited by 31 publications

(23 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…System Controller: In a first phase, the control of the HumanRobot interaction system, presented in [133], has been realized with a finite state machine to build up an efficiently robotic work cell. During the first evaluation, we found, that this kind of system controller did not meet the requirements of flexibility.…”

Section: A Human-robot Cooperation 1) Motivationmentioning

confidence: 99%

Artificial Cognition in Production Systems

Bannat¹,

Bautze²,

Beetz³

et al. 2011

IEEE Trans. Automat. Sci. Eng.

Self Cite

View full text Add to dashboard Cite

Abstract-Today's manufacturing and assembly systems have to be flexible to adapt quickly to an increasing number and variety of products, and changing market volumes. To manage these dynamics, several production concepts (e.g., flexible, reconfigurable, changeable or autonomous manufacturing and assembly systems) were proposed and partly realized in the past years. This paper presents the general principles of autonomy and the proposed concepts, methods and technologies to realize cognitive planning, cognitive control and cognitive operation of production systems. Starting with an introduction on the historical context of different paradigms of production (e.g., evolution of production and planning systems), different approaches for the design, planning, and operation of production systems are lined out and future trends towards fully autonomous components of an production system as well as autonomous parts and products are discussed. In flexible production systems with manual and automatic assembly tasks, human-robot cooperation is an opportunity for an ergonomic and economic manufacturing system especially for low lot sizes. The state-of-the-art and a cognitive approach in this area are outlined. Furthermore, introducing self-optimizing and self-learning control systems is a crucial factor for cognitive systems. This principles are demonstrated by a quality assurance and process control in laser welding that is used to perform improved quality monitoring. Finally, as the integration of human workers into the workflow of a production system is of the highest priority for an efficient production, worker guidance systems for manual assembly with environmentally-and situationally dependent triggered paths on state-based graphs are described in this paper.Note to Practitioners-Today's manufacturing enterprises have to face a number of challenges in a turbulent environment that originates amongst other from saturated markets, unprecedented and abrupt changes in market demands, an ever increasing number of product variants and smaller lot sizes. A recent research trend in Germany is the so called Cognitive Factory, where artificial cognitive capabilities are introduced to the control of production systems. The applications range from production planning and control, human-robot-cooperation, automatic robot programming to intuitive worker guidance systems.The concept of fully automated production systems is no longer a viable vision, as it has been shown, that the conventional automa- tion is not able to deal with the ever-rising complexity of modern production systems. Especially, a high reactivity, agility and adaptivity that is required by modern production systems, can only be reached by human operators with their immense cognitive capabilities, which enable them to react to unpredictable situations, to plan their further actions, to learn and to gain experience and to communicate with others. Thus, new concepts are required, that apply these cognitive principles to the planning processes and control systems of pr...

show abstract

Section: A Human-robot Cooperation 1) Motivationmentioning

confidence: 99%

Artificial Cognition in Production Systems

Bannat¹,

Bautze²,

Beetz³

et al. 2011

IEEE Trans. Automat. Sci. Eng.

Self Cite

View full text Add to dashboard Cite

show abstract

“…This redundancy can be useful for different purposes. In noisy environments, the information provided on a channel could be not reliable and redundancy can help reducing errors in the interpretation of the input signals (e.g., in a low light environment speech commands may be more reliable than gestures), hence, the robustness is generally enhanced [3]. Finally, multimodal interaction should be more intuitive.…”

Section: Introductionmentioning

confidence: 96%

An extensible architecture for robust multimodal human-robot communication

Rossi

Leone

Fiore

et al. 2013

2013 IEEE/RSJ International Conference on Intelligent Robots and Systems

View full text Add to dashboard Cite

Human safety and effective human-robot communication are main concerns in HRI applications. In order to achieve such goals, a system should be very robust, allowing little chance for misunderstanding the user's commands. Moreover, the system should permit natural interaction reducing the time and the effort needed to achieve tasks. The main purpose of this work is to develop a general framework for flexible and multimodal human-robot communication. The proposed architecture should be easy to modify and expand, adding or modifying input channels and changing the multimodal fusion strategies. In this paper, we introduce our general approach and provide a case study with two modalities (gesture and speech).

show abstract

“…Bannat et al presented a novel approach how multimodal interaction between humans and industrial robots can be achieved [4]. In an application scenario, situated in the factory context, a robot supports a human worker to accomplish a given hybrid assembly scenario together.…”

Section: Related Workmentioning

confidence: 99%

Exploring human-robot cooperation possibilities for semiconductor manufacturing

Weiss

Buchner

Tscheligi

et al. 2011

2011 International Conference on Collaboration Technologies and Systems (CTS)

View full text Add to dashboard Cite

This paper presents notions of a novel human-centered, integrated production system based on the intelligent cooperation between humans, robots and automation systems in the clean room context. In semiconductor manufacturing and in particular for short-term interactions with robotic systems like turn taking (an operator performs some work, hands over a lot box to the robot to perform some work and so on), it is still an open issue how the ideal relationship between the human and the intelligent (autonomous) system should look like. We present two case studies conducted together with InfineonTechnologies Austria AG, with the overall aim to explore the interaction scope of operators and the cooperation potential of the robotic systems in the semiconductor manufacturing context.

show abstract

A Multimodal Human-Robot-Interaction Scenario: Working Together with an Industrial Robot

Cited by 31 publications

References 5 publications

Artificial Cognition in Production Systems

Artificial Cognition in Production Systems

An extensible architecture for robust multimodal human-robot communication

Exploring human-robot cooperation possibilities for semiconductor manufacturing

Contact Info

Product

Resources

About