Learning global image representation with generalized‐mean pooling and smoothed average precision for large‐scale CBIR

Abstract

Content-based image retrieval (CBIR) is the problem of searching for items in an image database that are similar to the query image. Most of the existing image retrieval methods are trained based on metric learning loss functions (e.g. contrastive loss or triplet loss), however, which require the use of hard sample mining strategies (HMS) to better train the model. The HMS implies that picking out hard positive or negative samples increases the complexity of model training and requires a large amount of additional training time. To address this issue, lessons from recent work are leveraged on representation learning and a model called GS is proposed that combines the state-of-the-art Generalized-Mean (GeM) pooling and the smoothed average precision (AP). The entire network can be learned end-to-end by approximating the non-differentiable AP function to a differentiable onewithout mining hard samples, only image-level annotations. A model named GSA is also presented which achieves excellent retrieval performance jointly trained by two various loss functions. Experimental results validate the effectiveness of the proposed approach and demonstrate the competitive performance on a common standard image retrieval dataset (Revisited Oxford and Paris).

Crack Detection of Concrete Based on Improved CenterNet Model

“…The number of images the algorithm processes per second-the higher the value, the faster the algorithm processes p The size of the video memory occupied by the algorithm in the inference stage-the smaller the video memory occupation, the fewer resources are required Average Precision (AP) was obtained by calculating the area of the PR curve. The calculation formula is shown in Equation ( 7) [39]:…”