3-D Motion Estimation, Understanding, and Prediction from Noisy Image Sequences

Abstract

Abstract-This paper presents an approach to understanding general 3-D motion of a rigid body from image sequences. Based on dynamics, a locally constant angular momentum (LCAM) model is introduced. The model is local in the sense that it is applied to a limited number of image frames at a time. Specifically, the model constrains the motion, over a local frame subsequence, to be a superposition of precession and translation. Thus, the instantaneous rotation axis of the object is allowed to change through the subsequence. The trajectory of the rotation center is approximated by a vector polynomial. The parameters of the model evolve in time so that they can adapt to long term changes in motion characteristics.The nature and parameters of short term motion can be estimated continuously with the goal of understanding motion through the image sequence. The estimation algorithm presented in this paper is linear, i.e., the algorithm consists of solving simultaneous linear equations. Based on the assumption that the motion is smooth, object positions and motion in the near future can be predicted, and short missing subsequences can be recovered.Noise smoothing is achieved by overdetermination and a leastsquares criterion. The framework is flexible in the sense that it allows both overdetermination in number of feature points and the number of image frames. The number of frames from which the model is derived can be varied according to the complexity of motion and the noise level so as to obtain stable and good estimates of parameters over the entire image sequence. Simulation results are given for noisy synthetic data and images taken of a model airplane.

Mobile Robot Localization from Large-Scale Appearance Mosaics

“…Motion can be recovered from a known scene [48] and this problem is related to visual odometry. Scene structure can be determined from camera motion [45] [32].…”

Tracking a Dynamic Set of Feature Points

“…For tbh similarity measure Vglg 2 defined in (13), it has been shown that 121) I 1 (17) and the following equality holds:…”

“…the robustness of approaches that use a sequence of images has attracted the attention of many researchers [6,17,18,19]. The issue of finding feature correspondences over a long sequence of images needs to be addressed in such approaches.…”

On the problem of correspondence in range data and some inelastic uses for elastic nets

“…Establishing the correspondence is clearly a prerequisite to further processing in feature based schemes. Many efforts in the area of dynamic image analysis, however, assume that this underlying problem of correspondence has been resolved [28,23,31,25,1,2,35,33,13,17,16,5].…”