Active Vision During Coordinated Head/Eye Movements in a Humanoid Robot

Abstract

While looking at a point in the scene, humans continually perform smooth eye movements to compensate for involuntary head rotations. Since the optical nodal points of the eyes do not lie on the head rotation axes, this behavior yields useful 3-D information in the form of visual parallax. Here, we describe the replication of this behavior in a humanoid robot. We have developed a method for egocentric distance estimation based on the parallax that emerges during compensatory head/eye movements. This method was tested in a robotic platform equipped with an anthropomorphic neck and two binocular pan-tilt units specifically designed to reproduce the visual input signals experienced by humans. We show that this approach yields accurate and robust estimation of egocentric distance within the space nearby the agent. These results provide a further demonstration of how behavior facilitates the solution of complex perceptual problems.Index Terms-Active perception, behavior-based systems, biologically inspired robots, humanoid robots, 3-D vision.

Neurorobots as a Means Toward Neuroethology and Explainable AI

“…The active scanning behavior can be naturally studied using a robotic implementation to explain its association with depth perception. Kuang et al (2012) replicated this behavior on a humanoid robot and observed that the parallax-based distance estimates emerge during compensatory head/eye movements to fixate on a target during self-motion. When the robot rotated its head at a constant speed, its eyes rotated in the opposite direction to position the fixation object at the center of the image.…”

Analytical and simulation results of micro-ring resonator system using two eyes imaging model

“…The solution of equation (17) is given by (18), which is a cubic equation. Then, the result in equation (16) is the E 1 (ρ, ϕ) of the PANDA ring.…”

“…Humanoid robot has become the best robotic type in robotic technology, which there are required many components and related technologies. Robotic research and development has been the important issue of the world robotic society for years [15][16][17][18][19], where the main part of robotic components is the process for brain communication and commands. To obtain the realistic robotic brain and its functions, the brains signal and communications are required to manipulate and test [20][21][22][23][24], therefore, the searching of realized technique for brain signals remains.…”

Robot Depth Estimation Inspired by Fixational Movements

“…These ideas from biology inspired earlier work in robotics for distance estimation based on the parallax produced by camera rotations [29] and compensatory head/eye movements [18]. In later works the concept is extended to depth estimation [1].…”