An Autonomous Grape-Harvester Robot: Integrated System Architecture

This work pursues the potential of extending “Industry 4.0” practices to farming toward achieving “Agriculture 4.0”. Our interest is in fruit harvesting, motivated by the problem of addressing the shortage of seasonal labor. In particular, here we present an integrated system architecture of an Autonomous Robot for Grape harvesting (ARG). The overall system consists of three interdependent units: (1) an aerial unit, (2) a remote-control unit and (3) the ARG ground unit. Special attention is paid to the ARG; the latter is designed and built to carry out three viticultural operations, namely harvest, green harvest and defoliation. We present an overview of the multi-purpose overall system, the specific design of each unit of the system and the integration of all subsystems. In addition, the fully sensory-based sensing system architecture and the underlying vision system are analyzed. Due to its modular design, the proposed system can be extended to a variety of different crops and/or orchards.

[1]  J. N. Paoli,et al.  « On-the-go » multispectral imaging system to characterize the development of vineyard foliage with quantitative and qualitative vegetation indices , 2016, Precision Agriculture.

[2]  Vassilis G. Kaburlasos,et al.  Forward Kinematic Analysis of JACO2 Robotic Arm Towards Implementing a Grapes Harvesting Robot , 2020, 2020 International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[3]  Rory C. Flemmer,et al.  Development of an autonomous kiwifruit picking robot , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[4]  Eleni Vrochidou,et al.  Identifying the Technological Needs for Developing a Grapes Harvesting Robot: Operations and Systems , 2020, HAICTA.

[5]  N. Kondo,et al.  Agricultural robot in grape production system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[6]  António Paulo Gomes Mendes Moreira,et al.  Towards a Reliable Monitoring Robot for Mountain Vineyards , 2015, 2015 IEEE International Conference on Autonomous Robot Systems and Competitions.

[7]  Mohd Saiful Azimi Mahmud,et al.  Robotics and Automation in Agriculture: Present and Future Applications , 2020 .

[8]  Avital Bechar,et al.  Agricultural robots for field operations. Part 2: Operations and systems , 2017 .

[9]  George A. Papakostas,et al.  Grape stem detection using regression convolutional neural networks , 2021, Comput. Electron. Agric..

[11]  P. Clingeleffer,et al.  Management practices impact vine carbohydrate status to a greater extent than vine productivity , 2014, Front. Plant Sci..

[12]  Vassilis G. Kaburlasos,et al.  Semantic Segmentation of Vineyard Images Using Convolutional Neural Networks , 2020, EANN.

[13]  Carlos Lopes,et al.  Using an unmanned ground vehicle to scout vineyards for non-intrusive estimation of canopy features and grape yield , 2017 .

[14]  Thomas Moore,et al.  A Generalized Extended Kalman Filter Implementation for the Robot Operating System , 2014, IAS.

[15]  Lars Grimstad,et al.  An autonomous strawberry‐harvesting robot: Design, development, integration, and field evaluation , 2019, J. Field Robotics.

[16]  Vassilis G. Kaburlasos,et al.  Navigation Route Mapping for Harvesting Robots in Vineyards Using UAV-based Remote Sensing , 2020, 2020 IEEE 10th International Conference on Intelligent Systems (IS).

[17]  Tristan Perez,et al.  Efficacy of Mechanical Weeding Tools: A Study Into Alternative Weed Management Strategies Enabled by Robotics , 2018, IEEE Robotics and Automation Letters.

[18]  Stefano Poni,et al.  Effects of Early Defoliation on Shoot Photosynthesis, Yield Components, and Grape Composition , 2006, American Journal of Enology and Viticulture.

[19]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[20]  Lav R. Khot,et al.  High Resolution Multispectral and Thermal Remote Sensing-Based Water Stress Assessment in Subsurface Irrigated Grapevines , 2017, Remote. Sens..

[21]  Zijian Lin,et al.  LQR controller for car-like robot , 2016, 2016 35th Chinese Control Conference (CCC).

[22]  U. Knauer,et al.  Improved classification accuracy of powdery mildew infection levels of wine grapes by spatial-spectral analysis of hyperspectral images , 2017, Plant Methods.

[23]  Thanasis Hadzilacos,et al.  Design and development of a semi‐autonomous agricultural vineyard sprayer: Human–robot interaction aspects , 2017, J. Field Robotics.

[24]  J. C. Herrera,et al.  Combined Effects of Early Season Leaf Removal and Climatic Conditions on Aroma Precursors in Sauvignon Blanc Grapes. , 2017, Journal of agricultural and food chemistry.

[25]  Tom Duckett,et al.  Agricultural Robotics: The Future of Robotic Agriculture , 2018, UKRAS White Papers.

[26]  G. A. Papakostas,et al.  Toward Big Data Manipulation for Grape Harvest Time Prediction by Intervals’ Numbers Techniques , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[27]  K Tziridis,et al.  Information management and monitoring system for a grapes harvesting robot , 2021 .

[28]  Rajnikant V. Patel,et al.  A collision-avoidance scheme for redundant manipulators: Theory and experiments , 2005, J. Field Robotics.

[29]  Wei Zou,et al.  Design and test of robotic harvesting system for cherry tomato , 2018 .

[30]  Eleni Vrochidou,et al.  Real-time vineyard trunk detection for a grapes harvesting robot via deep learning , 2021, International Conference on Machine Vision.

[31]  Vassilis G. Kaburlasos,et al.  The Lattice Computing (LC) Paradigm , 2020, CLA.

[32]  D. Martin,et al.  Grape cluster microclimate influences the aroma composition of Sauvignon blanc wine. , 2016, Food chemistry.

[33]  R. Sparrow,et al.  Robots in agriculture: prospects, impacts, ethics, and policy , 2020, Precision Agriculture.

[34]  Avital Bechar,et al.  Agricultural robots for field operations: Concepts and components , 2016 .

[35]  V. Rastija,et al.  Effects of early leaf removal on grape yield, chemical characteristics, and antioxidant activity of grape variety Cabernet Sauvignon and wine from eastern Croatia , 2017 .

[36]  M. Winter,et al.  Agriculture 4.0: Making it work for people, production, and the planet , 2021, Land Use Policy.

[37]  Mrinal Kanti Dhar,et al.  Robotics and Automation in Agriculture , 2016 .

[38]  António Paulo Moreira,et al.  Towards a Reliable Robot for Steep Slope Vineyards Monitoring , 2016, J. Intell. Robotic Syst..

[39]  Samuel Williams,et al.  A Robot System for Pruning Grape Vines , 2017, J. Field Robotics.

[40]  Daniel Serrano,et al.  GRAPE: Ground Robot for vineyArd Monitoring and ProtEction , 2017, ROBOT.

[41]  Pedro Melo-Pinto,et al.  Brix, pH and anthocyanin content determination in whole Port wine grape berries by hyperspectral imaging and neural networks , 2015, Comput. Electron. Agric..

[42]  Vassilis G. Kaburlasos,et al.  Harvest Crate Detection for Grapes Harvesting Robot Based on YOLOv3 Model , 2020, 2020 Fourth International Conference On Intelligent Computing in Data Sciences (ICDS).

[43]  Ankit A. Ravankar,et al.  A Single LiDAR-Based Feature Fusion Indoor Localization Algorithm , 2018, Sensors.

[44]  Gang Liu,et al.  Auto Recognition of Navigation Path for Harvest Robot Based on Machine Vision , 2010, CCTA.

[45]  H. T. Søgaard,et al.  Application Accuracy of a Machine Vision-controlled Robotic Micro-dosing System , 2007 .