Design and implementation of an automatic peach-harvesting robot system

In this paper, we present a novel autonomous peach-harvesting approach. The robot can autonomously move around the tree and detect the peaches accurately by a well-designed fully connected neural network, adapting to different illumination. Next, the robot generates a score for each peach, taking into account the confidence of the classification and the size of the bounding box, and then pick one of the most suitable peach. In order to track the peach more robustly and quickly, we choose the KCF tracking algorithm. Finally, the robot picks the peach through a 6-DOF manipulator. In addition, we propose a monocular high-precision ranging method based on structured light. The cost of our method is lower than the traditional ranging method, which enables the robot to obtain the accurate spatial position of the peach.

[1]  Tateshi Fujiura,et al.  Study on Agricultural Robot (Part 1) , 1984 .

[2]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[3]  Ying Zhang,et al.  Automatic recognition vision system guided for apple harvesting robot , 2012, Comput. Electr. Eng..

[4]  David A. McAllester,et al.  Visual object detection with deformable part models , 2013, CACM.

[5]  Naoshi Kondo,et al.  Cucumber Harvesting Robot and Plant Training System , 1999, J. Robotics Mechatronics.

[6]  Siddhartha S. Mehta,et al.  Vision-based control of robotic manipulator for citrus harvesting , 2014 .

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Zhao Dean,et al.  Obstacle avoidance method of apple harvesting robot manipulator. , 2013 .

[9]  Tateshi Fujiura,et al.  Cherry-harvesting robot , 2008 .

[10]  E. J. van Henten,et al.  Robust pixel-based classification of obstacles for robotic harvesting of sweet-pepper , 2013 .

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Mitsuji Monta,et al.  Strawberry Harvesting Robot on Table-top Culture , 2004 .

[13]  Kuan Chong Ting,et al.  Harvesting End-effector for Inverted Single Truss Tomato Production Systems , 1998 .

[14]  Tristan Perez,et al.  Sweet pepper pose detection and grasping for automated crop harvesting , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[15]  C. Glasbey,et al.  Automatic fruit recognition and counting from multiple images , 2014 .