With the growth in vehicular traffic, there is a greater risk of road accidents. Over speeding, intoxicated driving, driver distractions, red-light runners, ignoring safety equipment such as seat belts and helmets, non-adherence to lane driving, and improper overtaking are the leading causes of accidents. Speed violation, in particular, has a significant influence on today’s transportation. Also, detecting this speed violation and punishing this violator are more time-consuming tasks. For that reason, a novel automatic speed violation detection in traffic based on Deep learning is proposed in this paper. This proposed method is separated into two working modules: object detection and license plate recognition. The object detection module uses the most efficient PP YOLO neural networks. It utilizes open ALPR (Automatic License Plate Recognition) for the vehicle’s number plate identification, which passes the traffic above maximum speed. With the number plate details, the authorities can take action against the rule violator with less time and effort. The simulation results show that the proposed automatic speed violation detection system also has an accuracy rate of 98.8% for speed violation detection and 99.3% for license plate number identification, demonstrating that the approach described in this work has a higher performance in terms of accuracy. Furthermore, the proposed technique was compared to recent existing results.