MAMA Net: Multi-Scale Attention Memory Autoencoder Network for Anomaly Detection

Abstract

Anomaly detection refers to the identification of cases that do not conform to the expected pattern, which takes a key role in diverse research areas and application domains. Most of existing methods can be summarized as anomaly object detection-based and reconstruction error-based techniques. However, due to the bottleneck of defining encompasses of real-world high-diversity outliers and inaccessible inference process, individually, most of them have not derived groundbreaking progress. To deal with those imperfectness, and motivated by memory-based decision-making and visual attention mechanism as a filter to select environmental information in human vision perceptual system, in this paper, we propose a Multi-scale Attention Memory with hash addressing Autoencoder network (MAMA Net) for anomaly detection. First, to overcome a battery of problems result from the restricted stationary receptive field of convolution operator, we coin the multi-scale global spatial attention block which can be straightforwardly plugged into any networks as sampling, upsampling and downsampling function. On account of its efficient features representation ability, networks can achieve competitive results with only several level blocks. Second, it's observed that traditional autoencoder can only learn an ambiguous model that also reconstructs anomalies "well" due to lack of constraints in training and inference process. To mitigate this challenge, we design a hash addressing memory module that proves abnormalities to produce higher reconstruction error for classification. In addition, we couple the mean square error (MSE) with Wasserstein loss to improve the encoding data distribution. Experiments on various datasets, including two different COVID-19 datasets and Manuscript

The COVID-19 epidemic analysis and diagnosis using deep learning: A systematic literature review and future directions

“… Method Usage? Chen, Zhang [ 78 ] Introducing the autoencoder's hash addressing memory module. -High robustness -Need to test on more difficult datasets No COVID-19 CT images, X-Ray Images, and reference image database No Autoencoder Detect the anomaly, especially in the case of COVID-19 detection -Low delay -High complexity -High accuracy Li, Fu [ 79 ] Using autoencoders to extract deeper information from CT images.…”

FCF: Feature complement fusion network for detecting COVID-19 through CT scan images

“…People began to shift their attention to researching what information should be most careful when extracting information from images meets its bottleneck. For this reason, attention-based algorithms become embedded in blocks to lead crucial information into a better representation [30] , [31] . Attention mechanisms combined with the residual block, which emerges henceforth, further activate to focus and preserve more on core information importance [32] , [33] .…”

A Review of Pharmaceutical Robot based on Hyperspectral Technology

“…It can improve the accuracy of foreign body detection and reduce the rate of missed detection under the background of strong noise. In addition, Chen [37] proposes a multi-scale attention-memory autoencoder network for abnormal detection. This method combines the superior performance of the autoencoder network in abnormal sample data reconstruction and the excellent feature extraction ability of the multi-scale global spatial attention module to achieve the high-precision detection effect of medical abnormal samples.…”