Proof of concept for a user-centered system for sharing cooperative plan knowledge over extended periods and crew changes in space-flight operations

Abstract

With the Robonaut-2 humanoid robot now permanently flying on the ISS, the potential role for robots participating in cooperative activity in space is becoming a reality. Recent research has demonstrated that cooperation in the joint achievement of shared goals is a promising framework for human interaction with robots, with application in space. Perhaps more importantly, with the turn-over of crew members, robots could play an important role in maintaining and transferring expertise between outgoing and incoming crews. In this context, the current research builds on our experience in systems for cooperative human-robot interaction, introducing novel interface and interaction modalities that exploit the long-term experience of the robot. We implement a system where the human agent can teach the Nao humanoid new actions by physical demonstration, visual imitation, and spoken command. These actions can then be composed into joint action plans that coordinate the cooperation between agent and human.We also implement algorithms for an Autobiographical Memory (ABM) that provides access to of all of the robots interaction experience.These functions are assembled in a novel interaction paradigm for the capture, maintenance and transfer of knowledge in a five-tiered structure. The five tiers allow the robot to 1) learn simple behaviors, 2) learn shared plans composed from the learned behaviors, 3) execute the learned shared plans efficiently, 4) teach shared plans to new humans, and 5) answer questions from the human to better understand the origin of the shared plan. Our results demonstrate the feasibility of this system and indicate that such humanoid robot systems will provide a potential mechanism for the accumulation and transfer of knowledge, between humans who are not co-present. Applications to space flight operations as a target scenario are discussed.Index Terms-human-robot interaction, shared-plan, behavior learning, robotic teaching, space-flight operations.

The Role of Autobiographical Memory in the Development of a Robot Self

“…This memory can be accessed by language, allowing the system to say when it first learned something, with whom, how many times since then etc. (Sorce et al, 2015 ). This narrative memory is of particular interest, and is a focus of our current and future research.…”

“…The past thus becomes available for interrogation by the human partner, in order to understand why a shared plan was learned in a certain way, who taught the shared plan, etc. (Sorce et al, 2015 ). The crucial next step was to allow narrative to enrich the experience of the iCub beyond what the iCub can directly perceive (Bruner, 1990 ).…”

10 Years of Human-NAO Interaction Research: A Scoping Review

“…We separated studies on autism therapy from healthcare as this context is receiving a growing attention within HRI. Some unusual application areas are space (helping astronauts in space flight-operations in Sorce et al (2015), art (drawing on canvas in Gurpinar et al (2012) and performing in theatrical play in Petrović et al (2019).…”

Learning to Use Narrative Function Words for the Organization and Communication of Experience

“…In the most direct usage, language allows the robot to describe events that have just occurred ( Dominey and Boucher, 2005 ), and allows the human to command actions that the robot should perform ( Dominey et al, 2007a , b , 2009 ). Extending the usage of language in time, we have used spoken language to allow the human to explain a coordinated, cooperative shared plan to the robot, and then to help explain and show the robot how to perform the different actions in the shared plan ( Petit et al, 2013 ; Sorce et al, 2015 ) as illustrated in Figure 1 .…”