Robot-augmented communication: a remote-collaboration system based on a shared field of view in real space

Abstract

To create a more efficient environment in which to perform remote maintenance, the authors propose a novel collaboration concept, called robot-augmented communication (RAC). In RAC a maintenance robot and an on-site human worker are assisted by another skilled human operator at a remote support center. By emphasizing the intentions of the remote supporter through robot functions that cannot be imitated by humans, RAC can provide effective support for the on-site worker. In the present study, as the first manifestation of RAC, featuring the projection capability of a maintenance robot, a prototype remote-collaboration system named SCOPE (sight collaboration by projection effect) was developed. This system consists of a projector unit with a camera, a multiple control unit (MCU) for video/voice communications, and PCs connected via a network. It has three key functions: creating a shared field of view between a remote supporter and an on-site worker, keeping meta-information related to objects in real space, and projecting meta-information onto the objects. The effectiveness of these functions was evaluated by experiments on two fundamental tasks-"comprehending a target object" and "transmission of instruction details"-involved in a typical maintenance operation. The experimental results show that each function is effective in shortening the time taken to perform the maintenance operation.

A Review on Methods and Systems for Remote Collaboration

“…Machino [29,30] proposed a 2 DOF robot on wheels, situated on a worksite and controlled by a remote expert. A video camera was fixed to the top of the robot, allowing it to capture the local environment, while a projector was used to project the expert's instructions to the remote worker.…”

“…All the aforementioned solutions [26][27][28][29][30][31][32][33][34] require a fixed setup for the cameras, either on the worker's or the helper's side. In contrast, HandsInAir [35] includes a new feature that allows mobility for both the remote helper and the worker.…”

Step-On Interface on Mobile Robot to Operate by Stepping on Projected Button

“…Projector is sometimes used to support handling a real object, for example, it displays information from a remote supporter to an on-site worker to support and prescribe tasks or operations [19,20]. RFIG (radio frequency identification and geometry) lamp (local-aware mobile projector) [21] is interesting as an informational interaction in real workspace which uses an active RFID tag with photo electronic sensor and a handheld projector with camera.…”

Mobile Robot with Preliminary-Announcement and Indication of Scheduled Route and Occupied Area Using Projector

“…Mobile Robot with Preliminary-announcement and Indication of Scheduled Route and Occupied Area using Projector 365 (Hiura et al, 2003;Machino et al, 2005). RFIG (Radio Frequency Identification and Geometry) lamps are interesting as an interaction of information in real workspace (Raskar et al, 2003).…”