L2AMF-Net: An L2-Normed Attention and Multi-Scale Fusion Network for Lunar Image Patch Matching

Abstract

The terrain-relative navigation (TRN) method is often used in entry, descent and landing (EDL) systems for position estimation and navigation of spacecraft. In contrast to the crater detection method, the image patch matching method does not depend on the integrity of the database and the saliency of the crater features. However, there are four difficulties associated with lunar images: illumination transformation, perspective transformation, resolution mismatch, and the lack of texture. Deep learning offers possible solutions. In this paper, an L2-normed attention and multi-scale fusion network (L2AMF-Net) was proposed for patch descriptor learning to effectively overcome the above four difficulties and achieve lunar image patch matching accurately and robustly. On the one hand, an L2-Attention unit (LAU) was proposed to generate attention score maps in spatial and channel dimensions and enhance feature extraction. On the other hand, a multi-scale feature self and fusion enhance structure (SFES) was proposed to fuse multi-scale features and enhance the feature representations. L2AMF-Net achieved a 95.57% matching accuracy and excellent performance compared with several other methods in lunar image patch dataset generated in this paper. Experiments verified the illumination, perspective and texture robustness of L2AMF-Net and the validity of the attention module and feature fusion structure.

An Image Retrieval Method for Lunar Complex Craters Integrating Visual and Depth Features

“…Cao et al proposed a method based on a triplet deep metric learning network to enhance the retrieval performance of remote sensing images [22]. Zhong et al introduced an L2-normed attention and multi-scale fusion network (L2AMF-Net) to achieve accurate and robust lunar image patch matching [44]. Additionally, some scholars focus on constructing new loss functions to enhance retrieval performance.…”

Cartography of the Solar System: Remote Sensing beyond Earth

“…Two contributions in this Special Issue deal with this topic: Chen and Jiang [13] present an impact crater detection method for pose estimation by relying on a high-accuracy network and sequence image information, which is suggested to be an efficient crater detection and recognition method for pose estimation. Zhong et al [14] take a different route and try to address specific difficulties of effective lunar patch matching, proposing a multi-scale fusion network to achieve lunar image patch matching accurately and robustly.…”

“…Mapping and spectral analysis [1][2][3][4][5][6][7]; • Data processing and data products [8][9][10]; • Impact crater and feature detection [11,12]; • Pose estimation [13,14]; • Research data management and valuation [15,16].…”