Rapid Recognition and Localization Based on Deep Learning and Random Filtering

Occlusion is a challenge for accuracy of recognition and localization for picking robot in harvesting. The algorithm developed in this paper combing deep learning and random filtering, which can be effectively eliminate the disturbing of obstacle. Firstly, apple images under occluded are as training input for neural network YOLO. Recognition result was signed by rectangular after YOLO. Secondly, for eliminate the interference of occlusion by random sampling filtered the depth values of obstacle points. Experiments shown that, this algorithm can provide real-time and accurate location information for picking. The difference between real and detection is limited in 4mm by the measure range from 600mm to 1500mm. The algorithm proposed in this paper could be flexible applied in other fruits, and it has a widely application values.

[1]  Zhengyou Zhang A New Multistage Approach to Motion and Structure Estimation by Gradually Enforcing Geometric Constraints , 1998, ACCV.

[2]  William T. Faricy A.A.R. , 1951 .

[3]  Yueju Xue,et al.  Detection of passion fruits and maturity classification using Red-Green-Blue Depth images , 2018, Biosystems Engineering.

[4]  Liang Gong,et al.  Detecting tomatoes in greenhouse scenes by combining AdaBoost classifier and colour analysis , 2016 .

[5]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[7]  Reza Ehsani,et al.  Detection of citrus fruit and tree trunks in natural environments using a multi-elliptical boundary model , 2018, Comput. Ind..

[8]  Raphael Linker,et al.  Vision-based localisation of mature apples in tree images using convexity , 2014 .

[9]  Dani Martínez,et al.  A Proposal for Automatic Fruit Harvesting by Combining a Low Cost Stereovision Camera and a Robotic Arm , 2014, Sensors.

[10]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[12]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[13]  Josse De Baerdemaeker,et al.  Detection of red and bicoloured apples on tree with an RGB-D camera , 2016 .