Selective fruit harvesting: Research, trends and developments towards fruit detection and localization – A review

Abstract

Progressive application of multidisciplinary research and development pushes the evolution of automation in many subsectors of agriculture to increase productivity, economic growth and environmental preservation with the help of robotics and artificial intelligence. Fruit harvesting robots have been developed mainly to provide support in the field for limited labour resources, to enable selective harvesting, to improve the efficiency and to preserve the quality of fruits. Even a small delay in harvesting can cause a maximum impact to the quality of the fruit. Selective fruit harvesting is an integration of different subcomponents. This paper provides a brief analysis of the techniques in selective fruit harvesting for the past 6 years starting from 2017 to 2022, associated principles, limitations and directions for future challenges. The first subcomponent is the vision system, it captures the information about the fruit in a tree canopy to perform efficient 2D and 3D localization. Hence getting accurate information from the vision system is more essential even in a complex agricultural environment. The detection of fruit from the vision system is normally done with two major methods such as traditional image processing and deep learning approaches. The result shows that the traditional methods provide high efficiency but the colour similarity, complex backgrounds and lightning conditions often makes failure in detection. Shortage of standard dataset and high-powered processing devices hinders the development of deep learning algorithms. Also, the usage of large data sets reduces the training speed even in pre-trained networks. For fruit grasping and detachment, the detection of plucking point is more essential to preserve the quality and for further storage. The elaborate description about the framework, limitations in current sensing, fruit and picking point detection algorithms provides guidelines to the researchers in building a fully automated robotic system to increase the processing speed and production rate.

A Review on Automated Detection and Assessment of Fruit Damage Using Machine Learning

“…Findings suggest that Transfer learning and optimizing weights to train the architecture in fruit detection and related tasks improves performance. Kumar et.al [104] also reviewed the application of deep learning models for fruit detection and localisation to aid in tree crop load estimation. This work further looked at approaches from extrapolation of tree image counts to orchard yield estimation while dealing with occlusion.…”

A Comprehensive Review of the Research of the “Eye–Brain–Hand” Harvesting System in Smart Agriculture

“…Intelligent harvesting system refers to a system that utilizes modern technology to achieve autonomous harvesting by the steps of recognition, decision, control, and grasping during the agricultural harvesting process. The intelligent picking system has the characteristics of efficiency, precision, and reliability, which can greatly improve agricultural production efficiency, reduce the labor burden of fruit farmers, and improve the quality and safety of agricultural production [1][2][3][4][5][6][7][8]. The literature distribution of intelligent harvesting systems for different crops is shown in Figure 1.…”