How can we close the gap between animals and robots when it comes to intelligently interacting with the environment? On our quest for answers, we have investigated the problem of physically exploring complex mechanical puzzles, called lockboxes. Biologists have discovered that cockatoos are intrinsically motivated to explore and solve such problems through physical explorative behavior. In this work, we study how different strategies shape the robots' exploration, given basic perception-action skills. Our evaluation highlights the influence of different statistical priors on the performance of the exploration strategies, showing that not only a range of computational methods, but also a range of priors could explain different exploration behaviors. We carry out our study of exploration strategies both in simulation and on two robot platforms. This first step towards a fully integrated real-world system allowed us to identify and remove limitations of our prior theoretical work on cross-entropy-based exploration when applied to complex realistic scenarios. In this paper we propose novel variants of this strategy and our experiments verify that the cross-entropy method performs well on a physical lockbox analogue of the cockatoo apparatus, and can generalize to lockboxes of different properties.
Abstract-Population based encodings allow to represent probabilistic and fuzzy state estimates. Such a representation will be introduced and applied for the case of a redundant manipulator. Following the Mean of Multiple Computations principle, a neural network model (PbMMC) is presented in which the overall complexity is divided into multiple local relationships. This allows to solve inverse, forward and mixed kinematic problems. The local transformations in between the kinematic variables can be sufficiently well learned by small single MLP layers. The population codes of the kinematic variables are based on nested periodic receptive fields which allow to express multiple weighted state estimates. Therefore, the model as such is quite flexible as it can keep track of multiple possible solutions at the same time.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.