TRC‐YOLO: A real‐time detection method for lightweight targets based on mobile devices

Abstract

Object detection is one of the main tasks of computer vision. Object detection algorithms usually rely on deep convolutional neural networks, which require the host device to have high computing capabilities, greatly limiting the application of object detection methods for mobile devices with limited computing capabilities, such as embedded devices. Among the current object detection algorithms, the you only look once (YOLO) series takes both speed and accuracy into consideration and is one of the most commonly used methods for object detection. In this article, TRC-YOLO is proposed, which improves the mean average precision (mAP) and real-time detection speed of the model while reducing the size of the model. In TRC-YOLO, the convolution kernel of YOLO v4-tiny is pruned and an expansive convolution layer is introduced into the residual module of the network to produce an hourglass Cross Stage Partial ResNet (CSPResNet) structure. A receptive field block (RFB) that simulates human vision is also added, increasing the receptive field of the model and strengthening the feature extraction ability of the network. In addition, the convolutional block attention module is applied, which combines spatial attention and channel attention, to enhance the effective features of the model and reduce the negative impact of noise on the model. The size of the TRC-YOLO model is 17.8 MB, which is 5.9 MB smaller than YOLO v4-tiny, and the model parameter is 2.983 billion floating point operations per second (BFLOP/s) (3.834 BFLOP/s less than YOLO v4-tiny). In addition, TRC-YOLO achieves a real-time performance of 36.9 frames per second on a Jetson Xavier NX, and its mAP on the PASCAL VOC dataset is 66.4% (3.83% higher than YOLO v4-tiny). In addition, the mAP of TRC-YOLO on the MS COCO dataset is 37.7%, which is 1.9% higher than that of the baseline model. K E Y W O R D SCBAM, dilated convolution, object detection, receptive field block (RFB), TridentNet, YOLO | INTRODUCTIONObject detection is a challenging task in the field of computer vision. Traditional object detection algorithms, such as histograms of oriented gradient (HOG) [1] and the deformable part-based model (DPM) [2], are mainly based on region selection using sliding windows but have high time complexity and cannot meet real-time requirements. In recent years, with the development of deep neural networks and the improvement of hardware computing power [3,4], a series of major breakthroughs with excellent performance have been made in the field of object detection.Compared with two-stage object detection algorithms, one-stage object detection algorithms, such as the single shot multibox detector (SSD) [5] and you only look once (YOLO) series [6][7][8][9][10], achieve a balance between speed and accuracy and have been widely used in practice. The YOLO series includes YOLO v1, YOLO v2, YOLO v3, and YOLO v4, the This is an open access article under the terms of the Creative Commons Attribution-NonCommercial License, which permits use, distribution and reproduction in any...

Real‐time vehicle detection using segmentation‐based detection network and trajectory prediction

“…In ref. [43] TRC‐YOLO has been introduced, which decreases model size while increasing mean average precision (mAP) and real‐time detection speed. In TRC‐YOLO, the YOLOV4‐Tiny convolution kernel reduces in size.…”

A Review of Lightweight Object Detection Algorithms for Mobile Augmented Reality

“…The study of [32] introduced the TRC-YOLO, TRC-YOLO proposed the pruning of the YOLOv4-tiny convolution kernel and the addition of an expansive convolution layer to the residual network model to produce an hourglass-shaped Cross-Stage partial Present (CSP) structure. The introduction of TRC-YOLO enhanced the mAP and real-time speed while minimizing the model size which was achieved by minimizing the number of YOLOv4-tiny model parameters.…”

Enhancing Sun-Dried Kelp Detection: Introducing K-YOLO, a Lightweight Model with Improved Precision and Recall

“…Traditional target detection methods rely on color, texture, and shape features. Their processing speed is fast and less dependent on hardware, but they need to manually select features and have low robustness when disturbed by noise, which makes it difficult to meet the detection needs in complex environments [ 7 , 8 , 9 ]. In contrast, deep learning algorithms, despite having higher hardware requirements, automatically learn features from raw data, providing accurate detection in complex environments [ 10 , 11 ].…”