Accurate laser scanner to camera calibration with application to range sensor evaluation

Abstract

Multi-modal sensory data plays an important role in many computer vision and robotics tasks. One popular multi-modal pair is cameras and laser scanners. To overlay and jointly use the data from both modalities, it is necessary to calibrate the sensors, i.e., to obtain the spatial relation between the sensors. Computing such a calibration is challenging as both sensors provide quite different data: cameras yield color or brightness information, laser scanners yield 3-D points. However, several laser scanners additionally provide reflectances, which turn out to make calibration to a camera well feasible. To this end, we first estimate a rough alignment of the coordinate systems of both modalities. Then, we use the laser scanner reflectances to compute a virtual image of the scene. Stereo calibration on the virtual image and the camera image are then used to compute a refined, high-accuracy calibration. It is encouraging that the accuracies in our experiments are comparable to camera-camera stereo setups and outperform another of other target-based calibration approach. This shows that the proposed algorithm reliably integrates the point cloud with the intensity image. As an example application, we use the calibration results to obtain ground-truth distance images for range cameras. Furthermore, we utilize this data to investigate the accuracy of the Microsoft Kinect V2 time-of-flight and the Intel RealSense R200 structured light camera.

Learning with known operators reduces maximum error bounds

“…Although only applications from the medical domain are shown in this paper, this does not limit the generality of our theoretical analysis. Similar problems are found in many fields, e. g. computer vision [ 22 ], image super resolution [ 23 ], or audio signal processing [ 24 ].…”

A Vision-Based Approach for Sidewalk and Walkway Trip Hazards Assessment

“…There have been several improvements to this technique over the years. Fuersattel et al developed a novel way to perform stereo calibration to align laser scanner and RGB information [ 39 ]. The maximum accuracy obtained was 1.3 mm or 0.2 pixels [ 39 ].…”

“…Fuersattel et al developed a novel way to perform stereo calibration to align laser scanner and RGB information [ 39 ]. The maximum accuracy obtained was 1.3 mm or 0.2 pixels [ 39 ]. Cabrera et al attempted to remove the RMS (Root Mean Square) error.…”

Range Information Characterization of the Hokuyo UST-20LX LIDAR Sensor

“…This can be done in numerous ways, and can use more than one type of sensor. Some common extrinsic calibration procedures use a LiDAR-Camera procedure as outlined in [7][8][9][10], and multiple LiDAR sensors or multiple sensor views as illustrated by [11][12][13][14][15][16], of a fixed target structure for a faster extrinsic calibration prior to operations [17][18][19][20]. These scenarios require the sensors raw data to be correlated into one coherent picture.…”