Visual positioning technology of picking robots for dynamic litchi clusters with disturbance

Abstract Visual localization by picking robots in natural environments is a difficult problem due to disturbance by interference factors. To solve this problem, research on visual positioning for dynamic litchi clusters with disturbance under natural environments was performed in this study. A visual system with two CCD cameras was used to acquire images of dynamic litchi clusters. The centroid of minimum bounding rectangle of litchi fruit was calculated, and the pendulum principle was used to calculate the oscillation angle of litchi clusters with three disturbance states: static, slight and large. For static or slight disturbance, the improved fuzzy C-means clustering method was used in image segmentation to obtain the litchi fruit and stem, and picking points were calculated using binocular visual stereo matching. The indoor experimental results show the maximum depth error of the picking point visual positioning for litchi clusters with static or slight disturbance is 5.08 cm, and the minimum depth error is 1.96 cm. The orchard visual positioning test results show the maximum depth error is 5.8 cm, and the minimum depth error is 0.4 cm. The results meet the picking demands of the picking robot end effector.

[1]  Ye Min,et al.  Error analysis of dynamic localization tests based on binocular stereo vision on litchi harvesting manipulator , 2016 .

[2]  Vicente Mata,et al.  Evolutionary indirect approach to solving trajectory planning problem for industrial robots operating in workspaces with obstacles , 2013 .

[3]  Huang Ke,et al.  Litchi image segmentation algorithm based on sparse field level set , 2011 .

[4]  Jun Lu,et al.  Virtual manipulator-based binocular stereo vision positioning system and errors modelling , 2010, Machine Vision and Applications.

[5]  Mark J. Carlotto,et al.  Histogram Analysis Using a Scale-Space Approach , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  R. Paul,et al.  Kinematic control equations for simple manipulators , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[7]  Xiangjun Zou,et al.  Localisation of litchi in an unstructured environment using binocular stereo vision , 2016 .

[8]  Xiangjun Zou,et al.  Vision-based extraction of spatial information in grape clusters for harvesting robots , 2016 .

[9]  Milos Manic,et al.  General Type-2 Fuzzy C-Means Algorithm for Uncertain Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[10]  E. J. van Henten,et al.  Stem localization of sweet-pepper plants using the support wire as a visual cue , 2014 .

[11]  Li Kai-yue.  Design of High temperature and pressure alternating and shaking experiment machine , 2008 .

[12]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  T. Casey Garvey,et al.  Assessment of tomato pericarp mechanical damage using multivariate analysis of magnetic resonance images. , 2009 .

[14]  Daniel E. Guyer,et al.  Evaluation of different pattern recognition techniques for apple sorting , 2008 .

[15]  Germano Veiga,et al.  Interactive Industrial Robot Programming for the Ceramic Industry , 2013 .

[16]  Naoshi Kondo,et al.  Patterns of Fluorescence Associated with Citrus Peel Defects , 2013 .

[17]  Hichem Frigui,et al.  Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. II , 1995, IEEE Trans. Fuzzy Syst..

[18]  Hiroshi Shimizu,et al.  A Double Image Acquisition System with Visible and UV LEDs for Citrus Fruit , 2009, J. Robotics Mechatronics.

[19]  Amparo Alonso-Betanzos,et al.  Analysis and evaluation of hard and fuzzy clustering segmentation techniques in burned patient images , 2000, Image Vis. Comput..

[20]  Min Ye,et al.  Fault-Tolerant Design of a Limited Universal Fruit-Picking End-Effector Based on Vision-Positioning Error , 2016 .

[21]  Takashi Kataoka,et al.  Fruit detection system and an end effector for robotic harvesting of Fuji apples , 2010 .