A Survey on Variational Optic Flow Methods for Small Displacements

Abstract

Optic flow describes the displacement field in an image sequence. Its reliable computation constitutes one of the main challenges in computer vision, and variational methods belong to the most successful techniques for achieving this goal. Variational methods recover the optic flow field as a minimiser of a suitable energy functional that involves data and smoothness terms. In this paper we present a survey on different model assumptions for each of these terms and illustrate their impact by experiments. We restrict ourselves to rotationally invariant convex functionals with a linearised data term. Such models are appropriate for small displacements. Regarding the data term, constancy assumptions on the brightness, the gradient, the Hessian, the gradient magnitude, the Laplacian, and the Hessian determinant are investigated. Local integration and nonquadratic penalisation are considered in order to improve robustness under noise. With respect to the smoothness term, we review a recent taxonomy that links regularisers to diffusion processes. It allows to distinguish five types of regularisation strategies: homogeneous, isotropic image-driven, anisotropic image-driven, isotropic flow-driven, and anisotropic flow-driven. All these regularisations can be performed either in the spatial or the spatiotemporal domain. After discussing well-posedness results for convex optic flow functionals, we sketch some numerical ideas in order to achieve realtime performance on a standard PC by means of multigrid methods, and we survey a simple and intuitive confidence measure.

Optical flow modeling and computation: A survey

“…Comprehensive surveys of optical flow literature were carried out in the nineties [21,178,228]. More recently, reviewing works have focused on variational approaches [264], benchmark results [13], specific applications [115], or tutorials restricted to a certain subset of methods [177,260]. However, covering all the main estimation approaches and including recent developments in a comprehensive classification is still lacking in the optical flow field.…”

Hyperproperties-Based Optical Flow-Based Autonomous Driving System

“…This has the disadvantage of working with only information in regard to the object's position which was gained from detector and latter being used to estimate velocity vectors. It reduces the robustness of the filter [7][8][9]. Other studies used PHD filters with optical flow method for extracting imagery data and velocity vectors [10][11][12][13][14][15][16][17].…”

A General PDE-Framework for Registration of Contrast Enhanced Images

“…Following Horn-Schunck's seminal work [5] on estimating the motion using optical flow equations, a number of approaches were proposed in the literature [6,3,4] which allowed varying illumination among the two images being registered. The approaches developed in [3,4] were very similar to Horn-Schunck's, except that they separated the illumination change as a linear intensity shift term.…”