An improved contour symmetry axes extraction algorithm and its application in the location of picking points of apples

Abstract

The key problem for picking robots is to locate the picking points of fruit. A method based on the moment of inertia and symmetry of apples is proposed in this paper to locate the picking points of apples. Image pre-processing procedures, which are crucial to improving the accuracy of the location, were carried out to remove noise and smooth the edges of apples. The moment of inertia method has the disadvantage of high computational complexity, which should be solved, so convex hull was used to improve this problem. To verify the validity of this algorithm, a test was conducted using four types of apple images containing 107 apple targets. These images were single and unblocked apple images, single and blocked apple images, images containing adjacent apples, and apples in panoramas. The root mean square error values of these four types of apple images were 6.3, 15.0, 21.6 and 18.4, respectively, and the average location errors were 4.9°, 10.2°, 16.3° and 13.8°, respectively. Furthermore, the improved algorithm was effective in terms of average runtime, with 3.7 ms and 9.2 ms for single and unblocked and single and blocked apple images, respectively. For the other two types of apple images, the runtime was determined by the number of apples and blocked apples contained in the images. The results showed that the improved algorithm could extract symmetry axes and locate the picking points of apples more efficiently. In conclusion, the improved algorithm is feasible for extracting symmetry axes and locating the picking points of apples. Additional key words: picking robot; fruit picking point; symmetry axes extraction; moment of inertia; convex hull

Extraction and classification of apple defects under uneven illumination based on machine vision

“…Therefore, it was very necessary to use image processing to extract the ROI (bruised and decayed parts). How to accurately segment the target object from the image was always a major challenge ( Wang et al, 2015). The RGB-based color model depends on the device, and pixel values could change significantly with the use of different imaging sensors.…”

A review on structural development and recognition–localization methods for end-effector of fruit–vegetable picking robots

“…Consequently, an intelligent learning-based approach was proposed by many scholars. [134][135][136][137][138][139][140][141][142][143] Specifically, the clustering, modeling, and decision trees at given color spaces or components have been adopted to found fruits rather than the simple method of threshold segmentation. 134,135 For example, the K-means clustering algorithm with a color space transformation model was used to distinguish ripe apples.…”

Location and model reconstruction algorithm for overlapped and sheltered spherical fruits based on geometry

“…For instance, Wang et al transformed the RGB color space to Lab color space and then adopted K-means clustering algorithm to recognize the occluded apples. 20,21 Xiong et al combined the improved fuzzy clustering method (FCM) and random signal histogram to remove the background of the nocturnal image in YIQ color model and then used the Otsu algorithm to identify the fruit from the stem base. 22,23 Chaivivatrakul and Dailey proposed a study of texture-based fruit detection for green fruits (bitter melon and pineapple) on plants in the field and recognized the green fruits in natural environment based on feature classification and region extration.…”