Local feature matching is a part of many large vision tasks. Local feature matching usually consists of three parts: feature detection, description, and matching. The matching task usually serves a downstream task, such as camera pose estimation, so geometric information is crucial for the matching task. We propose the geometric feature embedding matching method (GFM) for local feature matching. We propose the adaptive keypoint geometric embedding module dynamic adjust keypoint position information and the orientation geometric embedding displayed modeling of geometric information about rotation. Subsequently, we interleave the use of self-attention and cross-attention for local feature enhancement. The predicted correspondences are multiplied by the local features. The correspondences are solved by computing dual-softmax. An intuitive human extraction and matching scheme is implemented. In order to verify the effectiveness of our proposed method, we performed validation on three datasets (MegaDepth, Hpatches, Aachen Day-Night v1.1) according to their respective metrics, and the results showed that our method achieved satisfactory results in all scenes.
Building a dense correspondence between two images is a fundamental vision problem. Most existing methods use local features, but global features cannot be ignored. Local features are often not enough to disambiguate similar regions without global features. Computing relevant features between images requires structural relationship and the importance of local features. For that, We propose novel multi-scale attention and structural relation graph (MASRG) for local feature matching. The MASRG adopts an overall architecture that first builds coarse-level matches on a coarse feature map and then refines fine matches on a fine-level feature map. We propose a structural relation graph module and a multi-scale attention module. We introduce global context information into the overall architecture. Using global information to separately assist in learning the structural information between local descriptors, the features of different receptive fields, and the importance of modeling single local information, a limited number of possible matches can be obtained with high confidence. Finally, the matching relationship is predicted. In this way, the network significantly improves the matching reliability and localization accuracy. Our proposed method has 5.6%, 6.7%, and 6.3% performance increases over the baseline method(See I) under different conditions in the HPatches. Extensive experiments on three large-scale datasets (i.e., HPatches, InLoc, and Aachen Day-Night v1.1) demonstrate that our proposed MASRG method is superior to state-of-the-art local feature matching approaches.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.