A Novel Squeeze-and-Excitation W-Net for 2D and 3D Building Change Detection with Multi-Source and Multi-Feature Remote Sensing Data

Abstract

Building Change Detection (BCD) is one of the core issues in earth observation and has received extensive attention in recent years. With the rapid development of earth observation technology, the data source of remote sensing change detection is continuously enriched, which provides the possibility to describe the spatial details of the ground objects more finely and to characterize the ground objects with multiple perspectives and levels. However, due to the different physical mechanisms of multi-source remote sensing data, BCD based on heterogeneous data is a challenge. Previous studies mostly focused on the BCD of homogeneous remote sensing data, while the use of multi-source remote sensing data and considering multiple features to conduct 2D and 3D BCD research is sporadic. In this article, we propose a novel and general squeeze-and-excitation W-Net, which is developed from U-Net and SE-Net. Its unique advantage is that it can not only be used for BCD of homogeneous and heterogeneous remote sensing data respectively but also can input both homogeneous and heterogeneous remote sensing data for 2D or 3D BCD by relying on its bidirectional symmetric end-to-end network architecture. Moreover, from a unique perspective, we use image features that are stable in performance and less affected by radiation differences and temporal changes. We innovatively introduced the squeeze-and-excitation module to explicitly model the interdependence between feature channels so that the response between the feature channels is adaptively recalibrated to improve the information mining ability and detection accuracy of the model. As far as we know, this is the first proposed network architecture that can simultaneously use multi-source and multi-feature remote sensing data for 2D and 3D BCD. The experimental results in two 2D data sets and two challenging 3D data sets demonstrate that the promising performances of the squeeze-and-excitation W-Net outperform several traditional and state-of-the-art approaches. Moreover, both visual and quantitative analyses of the experimental results demonstrate competitive performance in the proposed network. This demonstrates that the proposed network and method are practical, physically justified, and have great potential application value in large-scale 2D and 3D BCD and qualitative and quantitative research.

A Novel Bayes Approach to Impervious Surface Extraction from High-Resolution Remote Sensing Images

“…To comprehensively evaluate the impervious surface extraction model, we used precision, recall, value, Overall Accuracy (OA) and Kappa coefficient for accuracy evaluation [ 57 , 58 ]. Precision is the ratio of samples that are actually impervious among all samples predicted to be impervious and recall is the ratio of samples that are predicted to be impervious among those that are actually impervious.…”

Design and Validate a Dual-Modality Characteristic Information Fusion System Based on Probabilistic Graphical Models

“…The conventional methods include thresholding and level-set segmentation [47]. The deep learning methods include single modality such as FCN [48] and dual-modality such as V-Net [32], W-Net [49] and 3D-UNet+GC [50,51]. Besides, we compared our method with some classical segmentation approaches on the PET modality.…”

A Dual-Channel Fully Convolutional Network for Land Cover Classification Using Multifeature Information

“…Under certain extreme conditions where other ground features do not exist, the object's category can still be identified through the shape and contour of the object [41]. For image data with complex features and a large amount of data, the edge detection method is used to describe the shape features of the object, which can retain detailed local and global information in space [42]. For some local noisesensitive areas, the unevenness of the shape contour can be used to describe the shape characteristics of the object.…”