On Achieving Bounded Harvest Times in Robotic Fruit Harvesting: A Finite-Time Visual Servo Control Approach

Abstract To improve commercial feasibility of robotic harvesters, it is utmost important to reduce and be able to guarantee harvesting times. A significant portion of this responsibility is on the control system. Current visual servo control methods can at best achieve exponential regulation of a robot (i.e., theoretically infinite convergence time), making it impossible to predict harvest time. The aim of this paper is to introduce a new finite-time visual servo control approach that guarantees finite (i.e., bounded) and computable harvest times. To this end, a continuous terminal sliding mode visual servo controller is developed, and Lyapunov-based stability analysis is presented to guarantee finite-time regulation of the robot to a target fruit. Further, we derive expressions for the bound on the harvesting time, which can aid post-harvest operations management. The developed controller is validated through numerical simulations.

[1]  Yuanshen Zhao,et al.  A review of key techniques of vision-based control for harvesting robot , 2016, Comput. Electron. Agric..

[2]  Yael Edan,et al.  Robotic melon harvesting , 2000, IEEE Trans. Robotics Autom..

[3]  Yael Edan,et al.  Harvesting Robots for High‐value Crops: State‐of‐the‐art Review and Challenges Ahead , 2014, J. Field Robotics.

[4]  Warren E. Dixon,et al.  An exponential Class of Visual Servoing controllers in the Presence of uncertain Camera Calibration , 2006, Int. J. Robotics Autom..

[5]  R. C. Harrell,et al.  The Florida robotic grove-lab. , 1990 .

[6]  Dean Zhao,et al.  Picking Robot Visual Servo Control Based on Modified Fuzzy Neural Network Sliding Mode Algorithms , 2019, Electronics.

[7]  Zhao Dean,et al.  System Design and Control of an Apple Harvesting Robot , 2020, ArXiv.

[8]  Eldert J. van Henten,et al.  Design of an eye-in-hand sensing and servo control framework for harvesting robotics in dense vegetation , 2016 .

[9]  Siddhartha S. Mehta,et al.  Vision-based control of robotic manipulator for citrus harvesting , 2014 .

[10]  R. C. Harrell,et al.  A fruit-tracking system for robotic harvesting , 2005, Machine Vision and Applications.

[11]  François Chaumette,et al.  Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods , 2002, IEEE Trans. Robotics Autom..

[12]  T. F. Burks,et al.  Adaptive Visual Servo Control of Robotic Harvesting Systems , 2016 .

[13]  Giulio Reina,et al.  Agricultural robot for radicchio harvesting , 2006, J. Field Robotics.

[14]  William MacKunis,et al.  Robust visual servo control in the presence of fruit motion for robotic citrus harvesting , 2016, Comput. Electron. Agric..

[15]  Shigehiko Hayashi,et al.  Robotic Harvesting System for Eggplants , 2002 .