TomoSAR 3D Reconstruction for Buildings Using Very Few Tracks of Observation: A Conditional Generative Adversarial Network Approach

Abstract

SAR tomography (TomoSAR) is an important technology for three-dimensional (3D) reconstruction of buildings through multiple coherent SAR images. In order to obtain sufficient signal-to-noise ratio (SNR), typical TomoSAR applications often require dozens of scenes of SAR images. However, limited by time and cost, the available SAR images are often only 3–5 scenes in practice, which makes the traditional TomoSAR technique unable to produce satisfactory SNR and elevation resolution. To tackle this problem, the conditional generative adversarial network (CGAN) is proposed to improve the TomoSAR 3D reconstruction by learning the prior information of building. Moreover, the number of tracks required can be reduced to three. Firstly, a TomoSAR 3D super-resolution dataset is constructed using high-quality data from the airborne array and low-quality data obtained from a small amount of tracks sampled from all observations. Then, the CGAN model is trained to estimate the corresponding high-quality result from the low-quality input. Airborne data experiments prove that the reconstruction results are improved in areas with and without overlap, both qualitatively and quantitatively. Furthermore, the network pretrained on the airborne dataset is directly used to process the spaceborne dataset without any tuning, and generates satisfactory results, proving the effectiveness and robustness of our method. The comparative experiment with nonlocal algorithm also shows that the proposed method has better height estimation and higher time efficiency.

Laser-light cueing shoes with integrated foot pressure and inertial sensing for investigating the impact of visual cueing on gait characteristics in Parkinson’s disease individuals

“…A high-resolution map of foot pressure distribution was generated using a conditional generative adversarial network (GAN) based on measurements from eleven foot pressures. The GAN model was developed using measurements obtained from a customized eleven-FSR insole and Pedar-X insole, which featured a 99-point pressure sensor pad covering the entire plantar surface of the foot, provided by Novel GmbH in Munich, Germany (Liang, 2022). The COP for each foot was calculated from the reconstructed foot pressure distribution by summing the products of the reconstructed foot pressures and their corresponding x and y positions, and dividing by the sum of the reconstructed foot pressures:…”

Exploiting SAR visual semantics in TomoSAR for 3D modeling of buildings

“…Synthetic aperture radar tomography (TomoSAR) can reconstruct high-resolution 3D structures of targets from a stack of coregistered SAR images and has the advantage of being unaffected by weather conditions, time, and terrain limitations. Recently, it has been applied to city modeling, geological exploration, environmental monitoring, target detection, military reconnaissance, and other fields [1][2][3][4].…”

Synthetic SAR Data Generator Using Pix2pix cGAN Architecture for Automatic Target Recognition

“…The proposed network combines the information of both optical and SAR images to eliminate image blurring. In[43],Wang et al. used cGAN to improve the Tomographic SAR (TomoSAR) reconstruction with a limited number of available SAR images.…”