Tree Detection With Low-Cost Three-Dimensional Sensors for Autonomous Navigation in Orchards

This letter deals with autonomous farming and with the autonomous navigation of an agricultural robot in orchards. These letter are typical semistructured environments where the dense canopy prevents from using GPS signal and embedded sensors are often preferred to localize the vehicle. To move safely in such environments, it is necessary to provide the robot the ability of detecting and localizing trees. This letter focuses on this problem. It presents a low cost but an efficient vision-based system allowing to detect accurately, quickly, and robustly the trees. It is made of four stereo cameras that provide a point cloud characterizing the environment. The key idea is to find the tree trunks by detecting their shadows, which are materialized by concavities in the obtained point cloud. In this way, branches and leaves are not taken into account, improving the detection robustness and, therefore, the navigation strategy. The method has been implemented using robot operating system (ROS) and validated using data sequences taken in several different orchards. The obtained results definitely validate the approach and its performances show that the processing time (around 1 ms) is sufficiently short for the data to be used at the control level. A comparison with other approaches from the literature is also provided.

[1]  Reza Ehsani,et al.  Detection of citrus fruit and tree trunks in natural environments using a multi-elliptical boundary model , 2018, Comput. Ind..

[2]  Carlos Vallespi,et al.  AUTOMATING ORCHARDS: A SYSTEM OF AUTONOMOUS TRACTORS FOR ORCHARD MAINTENANCE , 2012 .

[3]  Sim Heng Ong,et al.  A rule-based approach for robust clump splitting , 2006, Pattern Recognit..

[4]  Xiaoqi Chen,et al.  A novel vision based row guidance approach for navigation of agricultural mobile robots in orchards , 2015, 2015 6th International Conference on Automation, Robotics and Applications (ICARA).

[5]  Vijay Subramanian,et al.  Development of machine vision and laser radar based autonomous vehicle guidance systems for citrus grove navigation , 2006 .

[6]  Wenhui Zhang,et al.  A method for recognizing overlapping elliptical bubbles in bubble image , 2012, Pattern Recognit. Lett..

[7]  Stavros G. Vougioukas,et al.  Design of a Sensor-based Controller Performing U-turn to Navigate in Orchards , 2017, ICINCO.

[8]  Heikki Haario,et al.  Comparison of Concave Point Detection Methods for Overlapping Convex Objects Segmentation , 2017, SCIA.

[9]  Gang Liu,et al.  Auto Recognition of Navigation Path for Harvest Robot Based on Machine Vision , 2010, CCTA.

[10]  S. Carpenter,et al.  Solutions for a cultivated planet , 2011, Nature.

[11]  Heikki Haario,et al.  Segmentation of Partially Overlapping Nanoparticles Using Concave Points , 2015, ISVC.

[12]  Kazunobu Ishii,et al.  Development of an Autonomous Navigation System using a Two-dimensional Laser Scanner in an Orchard Application , 2007 .

[13]  Sanjiv Singh,et al.  Autonomous Orchard Vehicles for Specialty Crops Production , 2011 .

[14]  Salah Sukkarieh,et al.  A Pipeline for Trunk Detection in Trellis Structured Apple Orchards , 2015, J. Field Robotics.

[15]  Nagham Shalal,et al.  Orchard mapping and mobile robot localisation using on-board camera and laser scanner data fusion - Part A: Tree detection , 2015, Comput. Electron. Agric..

[16]  Ole Ravn,et al.  Autonomous Rule Based Robot Navigation In Orchards , 2010 .

[17]  Liang Luo,et al.  Multi-feature fusion tree trunk detection and orchard mobile robot localization using camera/ultrasonic sensors , 2018, Comput. Electron. Agric..

[18]  Sanjiv Singh,et al.  Results with autonomous vehicles operating in specialty crops , 2012, 2012 IEEE International Conference on Robotics and Automation.

[19]  Ji Zhang,et al.  3D perception for accurate row following: Methodology and results , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Yee Wan Wong,et al.  A novel tree trunk detection method for oil-palm plantation navigation , 2016, Comput. Electron. Agric..