Due to their flexibility, soft-bodied robots can potentially achieve rich and various behaviors within a single body. However, to date, no methodology has effectively harnessed these robots to achieve such diverse desired functionalities. Controllers that accomplish only a limited range of behaviors in such robots have been handcrafted. Moreover, the behaviors of these robots should be determined through body–environment interactions because an appropriate behavior may not always be manifested even if the body dynamics are given. Therefore, we have proposed SenseCPG-PGPE, a method for automatically designing behaviors for caterpillar-like soft-bodied robots. This method optimizes mechanosensory feedback to a central pattern generator (CPG)-based controller, which controls actuators in a robot, using policy gradients with parameter-based exploration (PGPE). In this article, we deeply investigated this method. We found that PGPE can optimize a CPG-based controller for soft-bodied robots that exhibit viscoelasticity and large deformation, whereas other popular policy gradient methods, such as trust region policy optimization and proximal policy optimization, cannot. Scalability of the method was confirmed using simulation as well. Although SenseCPG-PGPE uses a CPG-based controller, it can achieve nonsteady motion such as climbing a step in a simulated robot. The approach also resulted in distinctive behaviors depending on different body–environment conditions. These results demonstrate that the proposed method enables soft robots to explore a variety of behaviors automatically.
Conventional model theories are not suitable to control soft-bodied robots as deformable materials present rapidly changing behaviors. Neuromorphic electronics are now entering the field of robotics, demonstrating that a highly integrated device can mimic the fundamental properties of a sensory synaptic system, including learning and proprioception. This research work focuses on the physical implementation of a reservoir computing-based network to actuate a soft-bodied robot. More specifically, modeling the hysteresis of a shape memory alloy (SMA) using echo state networks (ESN) in real-world situations represents a novel approach to enable soft machines with task-learning. In this work, we show that not only does our ESN model enable our SMA-based robot with locomotion, but it also discovers a successful strategy to do so. Compared to standard control modeling, established either by theoretical frameworks or from experimental data, here, we gained knowledge a posteriori, guided by the physical interactions between the trained model and the controlled actuator, interactions from which striking patterns emerged, and informed us about what type of locomotion would work best for our robot.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.