Wide-angle lens provides a broad field of view which benefits some applications, such as video surveillance or endoscopic imaging. However, it also induces lens distortion, especially radial distortion, which may impede further video analysis or perceptual interpretation. For some applications, such as minimally invasive surgery and visual surveillance, realtime correction of image distortion is required. Traditional CPU-centric machines are difficult to achieve the requirement of real-time computation because of a large amount of computation. In this paper, we propose to achieve real-time correction of wide-angle lens distortion of images on several target platforms. In the GPGPU platform, we achieve real-time correction at full-HD resolution by using CUDA. For middle-end devices, an error-controllable mesh is used and the system is implemented by industry standard, OpenGL. We also implement it with OpenGL ES on embedded GPUs for mobile devices. Experiments show using our error-controllable mesh greatly outperforms those using regularly downsampled meshes.
Operation in minimally invasive surgery is more difficult since the surgeons perform operations without haptic feedback or depth perception. Moreover, the field of view perceived by the surgeons through endoscopy is usually quite limited. The goal of this paper is to allow surgeons to see wide-angle images from endoscopy without the drawback of lens distortion. The proposed distortion correction process consists of lens calibration and real-time image warping. The calibration step is to estimate the parameters in the lens distortion model. We propose a fully automatic Hough-entropy-based calibration algorithm, which provides calibration results comparable to the previous manual calibration method. To achieve real-time correction, we use graphics processing unit to warp the image in parallel. In addition, surgeons may adjust the focal length of a lens during the operation. Real-time distortion correction of a zoomable lens is impossible by using traditional calibration methods because the tedious calibration process has to repeat again if focal length is changed. We derive a formula to describe the relationship between the distortion parameter, focal length, and image boundary. Hence, we can estimate the focal length for a zoomable lens from endoscopic images online and achieve real-time lens distortion correction.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.