Towards Autonomous Robotic Precision Harvesting

This paper presents an integrated system for performing precision harvesting missions using a walking harvester. Our harvester performs a challenging task of autonomous navigation and tree grabbing in a confined, Global Positioning System (GPS) denied forest environment. Strategies for mapping, localization, planning, and control are proposed and integrated into a fully autonomous system. The mission starts with a human or a mobile robot mapping the area of interest using a custom-made sensor module. Subsequently, a human expert or a data-supported algorithm selects the trees for harvesting. The sensor module is then mounted on the machine and used for localization within the given map. A planning algorithm searches for both an approach pose and a path in a single path planning problem. We design a path following controller leveraging the walking harvester’s capabilities for negotiating rough terrain. Upon reaching the approach pose, the machine grabs a tree with a general-purpose gripper. This process repeats for all the trees selected by the operator (algorithm). Our system has been tested on a testing field with tree trunks and in a natural forest. To the best of our knowledge, this is the first time this level of autonomy has been shown on a full-size hydraulic machine operating in a realistic environment.

[1]  François Pomerleau,et al.  Large-scale 3D Mapping of Sub-arctic Forests , 2019, ArXiv.

[2]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[3]  Lydia E. Kavraki,et al.  The Open Motion Planning Library , 2012, IEEE Robotics & Automation Magazine.

[4]  Thomas Hellström,et al.  Estimating the position of the harvester head : a key step towards the precision forestry of the future? , 2015 .

[5]  Kostas Alexis,et al.  Complementary Multi–Modal Sensor Fusion for Resilient Robot Pose Estimation in Subterranean Environments , 2020, 2020 International Conference on Unmanned Aircraft Systems (ICUAS).

[6]  Leonid B. Freidovich,et al.  Open-loop control experiments on driver assistance for crane forestry machines , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Sanghyun Kim,et al.  Whole-body Control of Non-holonomic Mobile Manipulator Based on Hierarchical Quadratic Programming and Continuous Task Transition , 2019, 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM).

[8]  Jill Kubit,et al.  Green Jobs: Towards Decent Work in a Sustainable, Low-Carbon World , 2008 .

[9]  Marco Hutter,et al.  Autonomous Free-Form Trenching Using a Walking Excavator , 2019, IEEE Robotics and Automation Letters.

[10]  Jürgen Roßmann,et al.  Realization of a highly accurate mobile robot system for multi purpose precision forestry applications , 2009, 2009 International Conference on Advanced Robotics.

[11]  John C. Eidson,et al.  Measurement, Control, and Communication Using IEEE 1588 , 2006 .

[12]  Takashi Tsubouchi,et al.  Forest 3D Mapping and Tree Sizes Measurement for Forest Management Based on Sensing Technology for Mobile Robots , 2012, FSR.

[13]  Jonas Buchli,et al.  Efficient kinematic planning for mobile manipulators with non-holonomic constraints using optimal control , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Marco Hutter,et al.  Probabilistic Terrain Mapping for Mobile Robots With Uncertain Localization , 2018, IEEE Robotics and Automation Letters.

[15]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[16]  Thomas Hellström,et al.  Development of an Autonomous Path Tracking Forest Machine - a status report - , 2005 .

[17]  Jürgen Roßmann,et al.  Mapping and Navigation of Mobile Robots in Natural Environments , 2009 .

[18]  Siddhartha S. Srinivasa,et al.  CHOMP: Covariant Hamiltonian optimization for motion planning , 2013, Int. J. Robotics Res..

[19]  Abel Gawel,et al.  A Fully-Integrated Sensing and Control System for High-Accuracy Mobile Robotic Building Construction , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  G. O'Kelly Precision forestry: A revolution in the woods , 2018 .

[21]  Takeshi Nishida,et al.  Development of Robot for 3D Measurement of Forest Environment , 2018, J. Robotics Mechatronics.

[22]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[23]  Juha Hyyppä,et al.  Outlook for the Next Generation’s Precision Forestry in Finland , 2014 .

[24]  Thinning , 2021, Encyclopedic Dictionary of Archaeology.

[25]  Paul Newman,et al.  TICSync: Knowing when things happened , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Arto Visala,et al.  Simultaneous Localization and Mapping for Forest Harvesters , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[27]  Roland Siegwart,et al.  Towards optimal force distribution for walking excavators , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[28]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[29]  Arto Visala,et al.  Forestry crane posture estimation with a two‐dimensional laser scanner , 2018, J. Field Robotics.

[30]  Marco Hutter,et al.  Deployment of an autonomous mobile manipulator at MBZIRC , 2018, J. Field Robotics.

[31]  Arto Visala,et al.  Nonlinear model predictive control of hydraulic forestry crane with automatic sway damping , 2014 .

[32]  Marco Hutter,et al.  Autonomous dry stone , 2020, Construction Robotics.

[33]  E. Næsset Determination of mean tree height of forest stands using airborne laser scanner data , 1997 .

[34]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[35]  Anton S. Shiriaev,et al.  Modeling and control of hydraulic rotary actuators used in forestry cranes , 2009, 2009 IEEE International Conference on Robotics and Automation.

[36]  Peter Fankhauser,et al.  Perception-less terrain adaptation through whole body control and hierarchical optimization , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[37]  Sven Behnke,et al.  NimbRo Rescue: Solving Disaster‐response Tasks with the Mobile Manipulation Robot Momaro , 2017, J. Field Robotics.

[38]  HEAP , 2019, Proceedings of the 30th International Workshop on Rapid System Prototyping (RSP'19).

[39]  Ji Zhang,et al.  Visual-lidar odometry and mapping: low-drift, robust, and fast , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[40]  M. N. Mikhaylov,et al.  Control and navigation of forest robot , 2018, 2018 25th Saint Petersburg International Conference on Integrated Navigation Systems (ICINS).

[41]  Jonathan P. How,et al.  Motion Planning in Complex Environments using Closed-loop Prediction , 2008 .

[42]  Wolfgang Hess,et al.  Real-time loop closure in 2D LIDAR SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Simon Westerberg,et al.  Semi-Automating Forestry Machines Motion Planning, System Integration, and Human-Machine Interaction , 2014 .

[44]  Abbe Mowshowitz,et al.  Development of Navigation System in Field Robot for Forest Management , 2018, 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS) and 19th International Symposium on Advanced Intelligent Systems (ISIS).

[45]  Roland Siegwart,et al.  Navigation planning for legged robots in challenging terrain , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  Thomas Hellström,et al.  Autonomous forest machines : Past present and future , 2008 .

[47]  Marco Hutter,et al.  Force Control for Active Chassis Balancing , 2017, IEEE/ASME Transactions on Mechatronics.

[48]  Sebastian Thrun,et al.  Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments , 2010, Int. J. Robotics Res..

[49]  M. Hutter,et al.  A Universal Grid Map Library: Implementation and Use Case for Rough Terrain Navigation , 2016 .

[50]  L. Shepp,et al.  OPTIMAL PATHS FOR A CAR THAT GOES BOTH FORWARDS AND BACKWARDS , 1990 .

[51]  Leonid B. Freidovich,et al.  Increasing the Level of Automation in the Forestry Logging Process with Crane Trajectory Planning and Control , 2014, J. Field Robotics.

[52]  Dr.-Ing. Jürgen Rossmann Navigation of Mobile Robots in Natural Environments : Using Sensor Fusion in Forestry , 2013 .

[53]  Ying Chen,et al.  A Rubber-Tapping Robot Forest Navigation and Information Collection System Based on 2D LiDAR and a Gyroscope , 2019, Sensors.