Remote mobile manipulation with the centauro robot: Full‐body telepresence and autonomous operator assistance

Abstract

Solving mobile manipulation tasks in inaccessible and dangerous environments is an important application of robots to support humans. Example domains are construction and maintenance of manned and unmanned stations on the moon and other planets. Suitable platforms require flexible and robust hardware, a locomotion approach that allows for navigating a wide variety of terrains, dexterous manipulation capabilities, and respective user interfaces. We present the CENTAURO system which has been designed for these requirements and consists of the Centauro robot and a set of advanced operator interfaces with complementary strength enabling the system to solve a wide range of realistic mobile manipulation tasks. The robot possesses a centaur-like body plan and is driven by torquecontrolled compliant actuators. Four articulated legs ending in steerable wheels allow for omnidirectional driving as well as for making steps. An anthropomorphic upper body with two arms ending in five-finger hands enables human-like manipulation. The robot perceives its environment through a suite of multimodal sensors. The resulting platform complexity goes beyond the complexity of most known systems which puts the focus on a suitable operator interface. An operator can control the robot through a telepresence suit, which allows for flexibly solving a large variety of mobile manipulation tasks. Locomotion and manipulation functionalities on different levels of autonomy support the operation. The proposed user interfaces enable solving a wide variety of tasks without previous task-specific training. The integrated system is evaluated in numerous teleoperated experiments that are described along with lessons learned. 3D laser scanner Cameras RGB-D sensor 7 DoF arm 9 DoF dexterous hand 1 DoF soft hand 5 DoF leg 360°steerable wheel Base with CPUs, router and battery Figure 1: The Centauro robot. IntroductionCapable mobile manipulation robots are desperately needed in environments which are inaccessible or dangerous for humans. Missions include construction and maintenance of manned and unmanned stations, as well as exploration of unknown environments on the moon and other planets. Furthermore, such systems can be employed in search and rescue missions on earth. It applies to all these missions that human deployment is impossible or dangerous, and depends on extensive logistical and financial effort.To address the wide range of possible tasks, a suitable platform needs to provide a wide range of capabilities. Regarding locomotion, exemplary tasks are to overcome a variety of obstacles which can occur on planetary surfaces and in man-made environments, e.g., in space stations. Regarding manipulation, tasks may be to use power tools, to physically connect and disconnect objects such as electrical plugs, or to scan surfaces, e.g., for radiation. Since maintenance is not possible during missions, a high hardware and software reliability is necessary. Furthermore, suitable operator interfaces are key to enable the control of a system that must solve suc...

Mobile Manipulation Integrating Enhanced AMCL High-Precision Location and Dynamic Tracking Grasp

“…Extensive research on mobile manipulation has been conducted in many robot subdivisions, such as humanoid robots [ 14 , 15 ], wheeled robots [ 7 , 16 ], legged robots [ 17 , 18 ], unmanned aerial vehicles [ 19 , 20 , 21 ] and underwater robots [ 22 ]. In recent years, a large number of competitions related to mobile operations have been held, such as the Amazon Robotics Challenge [ 23 , 24 ], the DARPA Robotics Challenge [ 25 ], and the FetchIt!…”

Flexible Disaster Response of Tomorrow: Final Presentation and Evaluation of the CENTAURO System

“…Many technical details of the systems have been already described in [10]-a report on the intermediate system status one year before the end of the project. In this article, we present the final system at the end of the project.…”

“…Tasks were designed based on KHG's knowledge about real-world disasterresponse missions. While the intermediate evaluation reported in [10] was carried out at the same facilities, one year of further, intensive system development significantly extended and advanced the CENTAURO system. Hence, the described tasks in this article are designed to be considerably more challenging to demonstrate the significantly increased real-world applicability of the final CENTAURO system.…”

A Deformable Configuration Planning Framework for a Parallel Wheel-Legged Robot Equipped with Lidar

“…Several wheel-legged hybrid robots (WLHRs) have shown their ability of adapting to convex environment. The robot CENTAURO [ 5 ] which are equipped with steerable wheels on legs’ ending allows for executing steps, omnidirectional steering, and dominating a large variety of mobile manipulation missions, demonstrating its various moving modes in different types of terrains.…”