Multi-target recognition and positioning using robots in orchards is a challenging task in modern precision agriculture owing to the presence of complex noise disturbance, including wind disturbance, changing illumination, and branch and leaf shading. To obtain the target information for a bud-cutting robotic operation, we employed a modified deep learning algorithm for the fast and precise recognition of banana fruits, inflorescence axes, and flower buds. Thus, the cutting point on the inflorescence axis was identified using an edge detection algorithm and geometric calculation. We proposed a modified YOLOv3 model based on clustering optimization and clarified the influence of front-lighting and backlighting on the model. Image segmentation and denoising were performed to obtain the edge images of the flower buds and inflorescence axes. The spatial geometry model was constructed on this basis. The center of symmetry and centroid were calculated for the edges of the flower buds. The equation for the position of the inflorescence axis was established, and the cutting point was determined. Experimental results showed that the modified YOLOv3 model based on clustering optimization showed excellent performance with good balance between speed and precision both under front-lighting and backlighting conditions. The total pixel positioning error between the calculated and manually determined optimal cutting point in the flower bud was 4 and 5 pixels under the front-lighting and backlighting conditions, respectively. The percentage of images that met the positioning requirements was 93 and 90%, respectively. The results indicate that the new method can satisfy the real-time operating requirements for the banana bud-cutting robot.

No abstract

The detection of banana fruits is an important part of intelligent management in the banana plantation. To detect the banana fruit quickly and accurately in the complex orchard environment, this paper proposes a method based on the latest deep learning algorithm to detect the banana fruit. Using a monocular camera, we applied the YOLOv4 neural network algorithm to extract the deep features of banana fruits, realizing accurate detection of different banana sizes. The detection algorithm achieved a 99.29% detection rate, the average execution time was 0.171s, the shortest execution time was 0.135s, and the AP was 0.9995. Moreover, the detection results were discussed with the YOLOv3 algorithm and the machine learning algorithm. Compared with the machine learning algorithm, deep learning algorithm was superior to both detection accuracy and detection time. YOLOv4 had higher detection confidence and higher detection rate than YOLOv3. The results show that the proposed method could realize the fast detection of different varieties and different maturity in banana plantations, under different illumination and occlusion conditions, and provide information for banana picking, maturity and yield estimation. INDEX TERMS Banana detection, orchard environment, deep learning, green fruit, YOLOv4. L.Fu et al.: Fast and Accurate Detection of Banana Fruits in Complex Background Orchards L.Fu et al.: Fast and Accurate Detection of Banana Fruits in Complex Background Orchards

No abstract