Automated Boxwood Topiary Trimming with a Robotic Arm and Integrated Stereo Vision*

This paper presents an integrated hardware-software solution to perform fully automated robotic bush trimming to user-specified shapes. In contrast to specialized solutions that can trim only bushes of a certain shape, the approach ensures flexibility via a vision-based shape fitting module that allows fitting an arbitrary mesh into a bush at hand. A trimming planning method considers the available degrees of freedom of the robot arm to achieve effective cutting motions. The performance of the mesh fitting module is assessed in multiple experiments involving both artificial and real plants with a variety of shapes. The trimming accuracy of the overall approach is quantitatively evaluated by inspecting the bush pointcloud before and after robotic trimming, and measuring the change in the deviation from the originally computed target mesh.

[1]  Thomas Brox,et al.  Occlusions, Motion and Depth Boundaries with a Generic Network for Disparity, Optical Flow or Scene Flow Estimation , 2018, ECCV.

[2]  Xin Li,et al.  Design of an Autonomous Precision Pollination Robot , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Tom Botterill,et al.  A comparison of sampling-based path planners for a grape vine pruning robot arm , 2015, 2015 6th International Conference on Automation, Robotics and Applications (ICARA).

[4]  Wolfram Burgard,et al.  Null space optimization for effective coverage of 3D surfaces using redundant manipulators , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Dejan Kaljaca,et al.  Coverage trajectory planning for a bush trimming robot arm , 2019, J. Field Robotics.

[6]  Yael Edan,et al.  Harvesting Robots for High‐value Crops: State‐of‐the‐art Review and Challenges Ahead , 2014, J. Field Robotics.

[7]  J. Bontsema,et al.  An Autonomous Robot for Harvesting Cucumbers in Greenhouses , 2002, Auton. Robots.

[8]  R. Siegwart,et al.  Self-supervised calibration for robotic systems , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[9]  Leonidas J. Guibas,et al.  ShapeNet: An Information-Rich 3D Model Repository , 2015, ArXiv.

[10]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[11]  M Dorigo,et al.  Ant colonies for the travelling salesman problem. , 1997, Bio Systems.

[12]  Daniel Cremers,et al.  What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation? , 2018, International Journal of Computer Vision.

[13]  Huan Liu,et al.  Building a distributed robot garden , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Thomas Brox,et al.  A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[16]  Thomas Brox,et al.  FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Angelo Mencarelli,et al.  Structured Design of a Novel End-Effector for a Bush Trimming Robot , 2018 .