Automated Sensing System for Real-Time Recognition of Trucks in River Dredging Areas Using Computer Vision and Convolutional Deep Learning

Abstract

Sand theft or illegal mining in river dredging areas has been a problem in recent decades. For this reason, increasing the use of artificial intelligence in dredging areas, building automated monitoring systems, and reducing human involvement can effectively deter crime and lighten the workload of security guards. In this investigation, a smart dredging construction site system was developed using automated techniques that were arranged to be suitable to various areas. The aim in the initial period of the smart dredging construction was to automate the audit work at the control point, which manages trucks in river dredging areas. Images of dump trucks entering the control point were captured using monitoring equipment in the construction area. The obtained images and the deep learning technique, YOLOv3, were used to detect the positions of the vehicle license plates. Framed images of the vehicle license plates were captured and were used as input in an image classification model, C-CNN-L3, to identify the number of characters on the license plate. Based on the classification results, the images of the vehicle license plates were transmitted to a text recognition model, R-CNN-L3, that corresponded to the characters of the license plate. Finally, the models of each stage were integrated into a real-time truck license plate recognition (TLPR) system; the single character recognition rate was 97.59%, the overall recognition rate was 93.73%, and the speed was 0.3271 s/image. The TLPR system reduces the labor force and time spent to identify the license plates, effectively reducing the probability of crime and increasing the transparency, automation, and efficiency of the frontline personnel’s work. The TLPR is the first step toward an automated operation to manage trucks at the control point. The subsequent and ongoing development of system functions can advance dredging operations toward the goal of being a smart construction site. By intending to facilitate an intelligent and highly efficient management system of dredging-related departments by providing a vehicle LPR system, this paper forms a contribution to the current body of knowledge in the sense that it presents an objective approach for the TLPR system.

Automatic Number Plate Recognition:A Detailed Survey of Relevant Algorithms

“…The cited works reviewed various techniques for each stage of ANPR system. The authors in [ 17 ] provided a good references collection for the new researchers in license plate detection field. However, the research did not compare the performance of recognition techniques in terms of accuracy rates.…”

“…There are different terminologies used for ANPR systems: Table 1 summarizes previous reviews and surveys related to ANPR [16][17][18][19]. Table 2 presents performance summary of ANPR system techniques considering their relevant performance parameters.…”

The Model of Support for the Decision-Making Process, While Organizing Dredging Works in the Ports

“…The aim of the study was to create a decision model, in the form of a computer application, which would be able to support planning, organizing and conducting the dredging works in the port area [7]. The proposed solution is a multi-element system which enables to conduct a comprehensive verification of most of the aspects determining a quality and a time of dredging [8].…”

Artificial Intelligence‐Assisted Visual Sensing Technology under Duodenoscopy of Gallbladder Stones

“…The main function of this technology is to add perception technology to the visual sensor so that it can segment, detect, and recognize the network architecture of the target object [8]. The basic theory of this technology is the convolutional neural network (CNN) algorithm [9], and visual sensing technology assisted by the CNN system has gradually reached or exceeded the recognition level of humans. In the past, this technology was mostly used for segmentation and identification of commodity goods [10] and measurement of pitting of gears in shooting ranges [11].…”