Integration of work sequence and embodied interaction for collaborative work based human-robot interaction

Abstract

In order to develop intelligent robots that are able to cooperate well with human in a collaborative work, this work aims to integrate work sequence and embodied interaction capabilities into an integrated intelligence system for collaborative robot development. A task modeling approach is proposed to build a hierarchical task model of the entire work sequence to generate state transition table, and grounding with the actual condition (state) of the objects and the action (transition) of work in the embodied dimension. The system is implemented in a simulation environment with human interaction to materialize human-robot collaboration by robot work support in work sequence (what, when and how), assist on parallel task, and error correction.Index Terms-robot intelligence; work sequence; embodied interaction; human-robot interaction

Embodied and multimodal human-robot interaction between virtual and real worlds

“…In the Okonomiyaki collaborative cooking task (Fig. 4) described in our previous development [6], the embodied interaction is integrated into lengthy work operation. The high level work planning is grounded to the local low level embodied and multimodal interaction for high level robot intelligence development in collaborative manipulation.…”