Object Detection via Gradient-Based Mask R-CNN Using Machine Learning Algorithms

Abstract

Object detection has received a lot of research attention in recent years because of its close association with video analysis and image interpretation. Detecting objects in images and videos is a fundamental task and considered as one of the most difficult problems in computer vision. Many machine learning and deep learning models have been proposed in the past to solve this issue. In the current scenario, the detection algorithm must calculate from beginning to end in the shortest amount of time possible. This paper proposes a method called GradCAM-MLRCNN that combines Gradient-weighted Class Activation Mapping++ (Grad-CAM++) for localization and Mask Regional Convolution Neural Network (Mask R-CNN) for object detection along with machine learning algorithms. In our proposed method, images are used to train the network, together with masks that shows where the objects are in the image. A bounding box is regressed around the region of interest in most localization networks. Furthermore, just like any classification task, the multi-class log loss is minimized during training. This model enhances the calculation time and speed, as well as the efficiency, which recognizes objects in images accurately by comparing state-of-the-art machine learning algorithms, such as decision tree, Gaussian algorithm, k-means clustering, k-nearest neighbor, and logistic regression. Among these methods, we found logistic regression performed well with an accuracy rate of 98.4%, recall rate of 99.6%, and precision rate of 97.3% with respect to ResNet 152 and VGG 19. Furthermore, we proved the goodness of fit of our proposed model using chi-square statistical method and demonstrated that our solution can achieve great precision while maintaining a fair recall level.

Non-Intrusive Fish Weight Estimation in Turbid Water Using Deep Learning and Regression Models

“…This loss function is computed as a weighted total sum of various losses during the training at every phase of the model on each proposal RoI, which is shown by Equation (2). This weighted loss is defined as [ 25 ]: where , , and represent the classification loss, bounding-box loss, and the average binary cross-entropy loss, respectively. The shows the convergence of the predictions to the true class.…”

“…This loss function is computed as a weighted total sum of various losses during the training at every phase of the model on each proposal RoI, which is shown by Equation ( 2). This weighted loss is defined as [25]: 3) and ( 4):…”

Robust Deep Neural Network for Learning in Noisy Multi-Label Food Images

“…However, in the multi-label problem, the annotations are related to the ingredients contained in the image, but there is no information about the locations. In our proposal, to estimate the ingredient locations, we decided to use an explainability algorithm like Grad-CAM++ because, as was observed in [39,40], Grad-CAM++ is a good alternative to estimate the object location and segmentation in an unsupervised way and can be used at the top of a neural network without retraining. Subsequently, a group-to-attend (GA) module forms groups of a predefined size K = 2 randomly.…”

“…Grad-CAM++ was developed with the purpose of getting a visual explanation of the model prediction. However, they have also been successfully used as unsupervised object location [40] and segmentation [46]. Segmenting food images is a hard problem, even for supervised methods.…”

Grad-CAM: Understanding AI Models

“…In the future, there will be new potential applications of Grad-CAM: (i) Object localization. The Grad-CAM can localize objects [32] by highlighting the regions of the objects that contribute to the predictions of objects' presence. (ii) Image classification.…”