This study proposes a YOLOv5 inspection model based on polariser filtering (PF) to improve the recognition accuracy of the machine vision inspection model for tea leaf shoots when operating under intense outdoor light. To study the influence of the polariser parameters on the quality of the tea shoot image datasets, we improved the YOLOv5 algorithm module, inputted the results obtained from the spatial pyramid pooling structure in the backbone module into the neck module, set the up-sampling link of the neck module as a low-level feature alignment (LFA) structure, and used a bounding box similarity comparison metric based on the minimum point distance (mpdiou) to improve the accuracy of the YOLOv5 detection model. The mpdiou loss function is used to replace the original loss function. Experimental results show that the proposed method can effectively address the impact of intense outdoor light on tea identification, effectively solving the problem of poor detection accuracy of tea buds in the top view state. In the same identification environment, the model mAP50 value increased by 3.3% compared to that of the existing best mainstream detection model, and the mAP50-90 increased by 3.1%. Under an environment of light intensity greater than 5×104 Lux, the proposed YOLOv5s+LFA+mpdiou+PF model reduced the leakage detection rate by 35% and false detection rate by 10% compared to that with YOLOv5s alone.