A Novel Central Camera Calibration Method Recording Point-to-Point Distortion for Vision-Based Human Activity Recognition

Abstract

The camera is the main sensor of vison-based human activity recognition, and its high-precision calibration of distortion is an important prerequisite of the task. Current studies have shown that multi-parameter model methods achieve higher accuracy than traditional methods in the process of camera calibration. However, these methods need hundreds or even thousands of images to optimize the camera model, which limits their practical use. Here, we propose a novel point-to-point camera distortion calibration method that requires only dozens of images to get a dense distortion rectification map. We have designed an objective function based on deformation between the original images and the projection of reference images, which can eliminate the effect of distortion when optimizing camera parameters. Dense features between the original images and the projection of the reference images are calculated by digital image correlation (DIC). Experiments indicate that our method obtains a comparable result with the multi-parameter model method using a large number of pictures, and contributes a 28.5% improvement to the reprojection error over the polynomial distortion model.

Sensor-Based Human Activity and Behavior Research: Where Advanced Sensing and Recognition Technologies Meet

“…Conventional approaches sometimes need hundreds or thousands of images to optimize the camera model. Jin et al put forward an innovative point-to-point distortion calibration procedure that requires only dozens of images to obtain a dense distortion rectification map, contributing to a 28.5% enhancement to the reprojection error over the polynomial distortion model [ 11 ]. It is worthy of academic focus that although the authors emphasized the application of the new method in HAR, we find that the applicability is not limited to HAR and deserves a more extensive scope of attention.…”

A Distortion Correction Method Based on Actual Camera Imaging Principles

“…With the development of digital image technology, Xiong [ 26 ] and Weng et al [ 27 ] determined the distortion displacement map of the entire image point-by-point based on the fringe pattern phase analysis method. Gao [ 28 ] and Jin et al [ 29 ] computed the dense features between the original images and the projection of the reference images to obtain the distortion correction map based on the feature detection method of digital image correlation (DIC). Digital imaging techniques, while highly accurate in calibration, require pixel-by-pixel analysis and a significant amount of time for calibration.…”

Compensation for Vanadium Oxide Temperature with Stereo Vision on Long-Wave Infrared Light Measurement

“…In [ 18 ], a more accurate and suitable image localization method in various situations is proposed, and to achieve higher accuracy than traditional methods. The method [ 18 ] requires a small number of images for a short time to measure, which can be of great help for depth cameras.…”

“…In [ 18 ], a more accurate and suitable image localization method in various situations is proposed, and to achieve higher accuracy than traditional methods. The method [ 18 ] requires a small number of images for a short time to measure, which can be of great help for depth cameras. Especially, the frame rate of the depth camera reaches 60 fps, and through the technique of [ 18 ], the distance and the object under testing can be more effectively corrected repeatedly.…”

“…The method [ 18 ] requires a small number of images for a short time to measure, which can be of great help for depth cameras. Especially, the frame rate of the depth camera reaches 60 fps, and through the technique of [ 18 ], the distance and the object under testing can be more effectively corrected repeatedly. The method of [ 18 ] can more effectively solve the problem when there is external environmental interference.…”