Evaluation of Explanation Methods of AI - CNNs in Image Classification Tasks with Reference-based and No-reference Metrics

Zhukov, A. E.; Benois‐Pineau, Jenny; Giot, Romain

doi:10.54364/aaiml.2023.1143

Cited by 4 publications

(1 citation statement)

References 22 publications

(55 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Gaze fixation 30,31 recordings are utilized to create GFDMs for directing models on their recognition task. A GFDM can identify the areas of an image relevant to humans.…”

Section: Gfdms For Ground Truthmentioning

confidence: 99%

Abstract painting image orientation recognition based on eye movement and multitask learning

Bai,

Guo

2024

J. Electron. Imag.

View full text Add to dashboard Cite

paintings are produced by artists based on their concepts and employ color, texture, and other techniques. Determining the arrangement of abstract paintings is challenging given their ambiguous nature. Previous studies on image orientation recognition faced three major difficulties. First, they relied heavily on pre-existing convolution neural network models, such as VGG and AlexNet. Second, they focused largely on a single task-recognizing image orientation. Finally, ground truth data concerning visual perception regions of images were often obtained through manual annotation. To overcome these issues, we introduce OC-OD: a multitask approach fused across multiple feature layers for better performance. The orientation classification (OC) subtask is the primary task, whereas the visual perception region detection (OD) subtask is auxiliary. OC and OD utilize the same feature extraction layer; OD aims to enhance the efficiency of OC completion. At the same time, the ground truth data used in OD is obtained from gaze fixation density maps gathered by an eye tracker during the subject's viewing of the image, rather than through manual annotation. Two datasets were chosen to compare the training impact of various model parameters and architecture. The experimental results were extensively compared, leading to the discovery that our proposed approach significantly enhances orientation recognition accuracy and outperforms other state-ofthe-art methodologies.

show abstract

“…Gaze fixation 30,31 recordings are utilized to create GFDMs for directing models on their recognition task. A GFDM can identify the areas of an image relevant to humans.…”

Section: Gfdms For Ground Truthmentioning

confidence: 99%