BR-NPA: A non-parametric high-resolution attention model to improve the interpretability of attention

Gomez, Tristan; Ling, Suiyi; Fréour, Thomas; Mouchère, Harold

doi:10.1016/j.patcog.2022.108927

Cited by 4 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We can also cite bilinear-representative non-parametric attention (BR-NPA), 50 which introduces a multipart nonparametric attention mechanism that groups feature vectors by similarity. This algorithm first consists to select N vectors among the feature vectors that have a high norm and a low cosine similarity with each other.…”

Section: Saliency Map Generationmentioning

confidence: 99%

Computing and evaluating saliency maps for image classification: a tutorial

Gomez

Mouchère

2023

J. Electron. Imag.

Self Cite

View full text Add to dashboard Cite

Facing the black-box nature of deep learning models for image classification, a popular trend in the literature proposes methods to generate explanations in the form of heat maps indicating the areas that played an important role in the models' decisions. Such explanations are called saliency maps and constitute an active field of research, given that many fundamental questions are yet to be answered: how to compute them efficiently? How to evaluate them? What exactly can they be used for? Given the increasing rate at which papers are produced and the vast amount of literature that is already existing, we propose our study to help newcomers become part of this community and to contribute to the research field. First, the two existing approaches to generate saliency maps are discussed, namely post-hoc methods and attention models. Post-hoc methods are generic algorithms that can be applied to any model from a given class without requiring fine-tuning. On the contrary, attention models are ad-hoc architectures that generate a saliency map during the inference phase to guide the decision. We show that both approaches can be divided into several subcategories and illustrate each of them with one important model or method. Second, we present the current methodologies used to evaluate saliency maps, including objective and subjective protocols, depending on whether or not they involve users. Among objective methods, we notably detail faithfulness metrics and propose an implementation featuring the faithfulness metrics discussed in this paper (https://github. com/TristanGomez44/metrics-saliency-maps).

show abstract

Section: Saliency Map Generationmentioning

confidence: 99%