An adversarial cross-modal retrieval method based on collaborative attention networks

Abstract

Serious feature heterogeneity and semantic gaps exist between multi-source heterogeneous data, and existing cross-modal retrieval methods cannot effectively extract common semantic and complementary information between multi-source heterogeneous data. In this regard, an adversarial cross-modal retrieval method that fuses collaborative attention networks is proposed. The method addresses two major challenges in the cross-modal retrieval process, firstly, an information extraction algorithm based on the cooperative attention mechanism is designed, and secondly, the cooperative attention network is combined with the adversarial subspace learning algorithm to enhance the complementary capability of information in the feature subspace. The experimental results show that the proposed method has better retrieval results than similar cross-modal retrieval methods in terms of MAP metrics.