Long Integral Time Continuous Panorama Scanning Imaging Based on Bilateral Control with Image Motion Compensation

Abstract

Urban remote sensing with moving carriers enables comprehensive monitoring of an urban area. High spatial resolution and wide covering are always required to improve the performance and efficiency of remote sensing. Continuous scanning imaging is a feasible solution. However, imaging motion degrades the performance of a remote sensing system. Rotating motion leads to the loss of key urban morphology information of a panorama imaging. Image translation results in blurry images. For high spatial resolution and high efficiency imaging with low illumination condition, such as imaging at dusk, long-focus lens and long integral time must be further utilized, which makes the problem more severe. In this paper, a novel image motion compensation method is proposed to compensate for image rotation and image translation simultaneously. A quantitative description of image motion, including both image rotation and image translation, is first developed based on the principle of geometrical optics and then analyzed in detail through numerical simulations. Furthermore, a comprehensive image rotation compensation method is developed based on four-channel bilateral control with sliding mode controller, at the same time image translation compensation is performed according to the quantitative relationship of the motion of the scan mirror and image translation compensator. The experimental results show that the proposed method provides effective compensation for image rotation and image translation. This enables acquisition of high spatial resolution urban panoramic images.

Multi‐actuator control with modal switching and different disturbance for scanning imaging motion compensation

“…, , and were added in the system. Three methods were compared: 1) PD tracking controller with no compensation, 2) PD tracking controller with the SC and IRC cooperating with the PD[31], and 3) ASMC tracking controller with SC, IRC, and ITC cooperating with the ASMC. The parameters are shown in Table 6.…”

“…The ITC trajectory is related to x ri (t ) and the focal length f . From [31], the functions between rotation and translation are…”

“…In [30], the image rotation was compensated by bilateral control. Subsequently, image motion compensation was added to the scanning imaging system as an independent part [31]. However, the research on multi‐actuator control including translation and rotation in scanning imaging remains inadequate.…”

Design of a Panoramic Scanning Device Based on a Piezoelectric Ceramic Stack Actuator and Friction Transmission

“…The panoramic scanning imaging system can obtain a clear 360 • image of the surrounding environment and has the advantages of a large range, a short scanning period, and fast panoramic imaging [1]. As a consequence, it is widely used in security monitoring [2], robot vision [3], oblique photography [4], and laser scanning systems [5]. With the continuous increase in applications, various improvements have been suggested for the panoramic scanning imaging system, such as fine angle control and faster response speed.…”

Editorial for Special Issue: “Remote Sensing for Urban Morphology”

“…Based on many sample points from OpenStreetMap and MOD13Q1-NDVI classifications and centered on feature learning, the methodology uses convolutional neural networks and seven-neighborhood random forests to produce accuracies of over 90% [2]. The problem of blurred images from continuous scanning imaging is addressed by the second paper, where Tian et al propose a novel synchronized control method of multiple image compensation units to resolve image rotation problems [3]. They apply a four-channel bilateral control method based on sliding mode control and disturbance observation to compensate for image rotation.…”