An improved contour symmetry axes extraction algorithm and its application in the location of picking points of apples

The key problem for picking robots is to locate the picking points of fruit. A method based on the moment of inertia and symmetry of apples is proposed in this paper to locate the picking points of apples. Image pre-processing procedures, which are crucial to improving the accuracy of the location, were carried out to remove noise and smooth the edges of apples. The moment of inertia method has the disadvantage of high computational complexity, which should be solved, so convex hull was used to improve this problem. To verify the validity of this algorithm, a test was conducted using four types of apple images containing 107 apple targets. These images were single and unblocked apple images, single and blocked apple images, images containing adjacent apples, and apples in panoramas. The root mean square error values of these four types of apple images were 6.3, 15.0, 21.6 and 18.4, respectively, and the average location errors were 4.9°, 10.2°, 16.3° and 13.8°, respectively. Furthermore, the improved algorithm was effective in terms of average runtime, with 3.7 ms and 9.2 ms for single and unblocked and single and blocked apple images, respectively. For the other two types of apple images, the runtime was determined by the number of apples and blocked apples contained in the images. The results showed that the improved algorithm could extract symmetry axes and locate the picking points of apples more efficiently. In conclusion, the improved algorithm is feasible for extracting symmetry axes and locating the picking points of apples.

[1]  Yibin Ying,et al.  Three-dimensional location of tomato based on binocular stereo vision for tomato harvesting robot , 2010, International Symposium on Advanced Optical Manufacturing and Testing Technologies (AOMATT).

[2]  M. Benjelloun,et al.  A k-Means Clustering Algorithm Initialization for Unsupervised Statistical Satellite Image Segmentation , 2006, 2006 1ST IEEE International Conference on E-Learning in Industrial Electronics.

[3]  Yu Yong.  A Symmetry Axis Detected Method Based on the Minimal Value of Moment of Inertia , 2009 .

[4]  S. Hata,et al.  Development of a real-time machine vision system for the apple harvesting robot , 2004, SICE 2004 Annual Conference.

[5]  Tateshi Fujiura,et al.  Cherry-harvesting robot , 2008 .

[6]  Simon X. Yang,et al.  Ripe Tomato Recognition and Localization for a Tomato Harvesting Robotic System , 2009, 2009 International Conference of Soft Computing and Pattern Recognition.

[7]  John R. Jensen,et al.  Object‐based change detection using correlation image analysis and image segmentation , 2008 .

[8]  R Adnaabazar C Hinchuluun,et al.  MACHINE VISION-BASED CITRUS YIELD MAPPING SYSTEM , 2006 .

[9]  M. Luo,et al.  The development of the CIE 2000 Colour Difference Formula , 2001 .

[10]  Kaveh Mollazade,et al.  Recognition and localization of ripen tomato based on machine vision , 2011 .

[11]  Giorgio Grasso,et al.  Localization of spherical fruits for robotic harvesting , 2001, Machine Vision and Applications.

[12]  Masayuki Kikuchi,et al.  Symmetry axis extraction by a neural network , 2006, Neurocomputing.

[13]  Daoliang Li,et al.  An improved KK-means clustering algorithm for fish image segmentation , 2013, Math. Comput. Model..

[14]  Edouard Thiel,et al.  Exact medial axis with euclidean distance , 2005, Image Vis. Comput..

[15]  Jose L Pons,et al.  A SURVEY OF COMPUTER VISION METHODS FOR LOCATING FRUIT ON TREES , 2000 .

[16]  Zhou Qihai,et al.  A New Algorithm for Finding Convex Hull with a Maximum Pitch of the Dynamical Base Line , 2008 .

[17]  Won Suk Lee,et al.  Green citrus detection using fast Fourier transform (FFT) leakage , 2012, Precision Agriculture.