Vision-based monitoring of orchards with UAVs

Abstract We present an autonomous aerial system which can safely navigate inside the rows of an orchard for crop inspection, yield estimation and similar farm management tasks. Our operating environment has two practical constraints: GPS signal can be unreliable close to the ground and the trees can grow large branches that might block the robot’s predetermined path. To address these challenges, we developed components for navigation, vision-based obstacle detection and avoidance and path planning for visual coverage. Results from a field demonstration in an apple orchard are presented showcasing the ability of our system to perform successful navigation and complete yield coverage of apple tree rows.

[1]  J. Bontsema,et al.  An Autonomous Robot for Harvesting Cucumbers in Greenhouses , 2002, Auton. Robots.

[2]  Howie Choset,et al.  Coverage Path Planning: The Boustrophedon Cellular Decomposition , 1998 .

[3]  F. Zhao,et al.  Stitching of hyper-spectral UAV images based on feature bands selection , 2016 .

[4]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[5]  Chun Chang,et al.  Develop an unmanned aerial vehicle based automatic aerial spraying system , 2016, Comput. Electron. Agric..

[6]  N. M. Arshad,et al.  Construction sonar sensor model of low altitude field mapping sensors for application on a UAV , 2012, 2012 IEEE 8th International Colloquium on Signal Processing and its Applications.

[7]  Kjeld Jensen,et al.  A low cost, modular robotics tool carrier for precision agriculture research , 2012 .

[8]  Volkan Isler,et al.  Coverage Path Planning Under the Energy Constraint , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Vassilios Morellas,et al.  Automation solutions for the evaluation of plant health in corn fields , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Claus G. Sørensen,et al.  HortiBot: A System Design of a Robotic Tool Carrier for High-tech Plant Nursing , 2007 .

[11]  Jianfeng Zhou,et al.  Aerial multispectral imaging for crop hail damage assessment in potato , 2016, Comput. Electron. Agric..

[12]  Sebastian Scherer,et al.  Flying Fast and Low Among Obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Gonzalo Pajares,et al.  Fleets of robots for environmentally-safe pest control in agriculture , 2017, Precision Agriculture.

[14]  Albert S. Huang,et al.  Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera , 2011, ISRR.

[15]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  An adaptive approach for UAV-based pesticide spraying in dynamic environments , 2017, Comput. Electron. Agric..

[16]  Heikki Saari,et al.  Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture , 2013, Remote. Sens..

[17]  Jason. Hickle,et al.  The Design and Implementation of a Semi-Autonomous Surf-Zone Robot Using Advanced Sensors and a Common Robot Operating System , 2011 .

[18]  Antonio Barrientos,et al.  Moisture measurement in crops using spherical robots , 2013, Ind. Robot.

[19]  Noboru Noguchi,et al.  Multi-temporal Monitoring of Wheat Growth through Correlation Analysis of Satellite Images, Unmanned Aerial Vehicle Images with Ground Variable , 2016 .

[20]  Pratap Tokekar,et al.  Sensor Planning for a Symbiotic UAV and UGV System for Precision Agriculture , 2016, IEEE Trans. Robotics.

[21]  Sven Behnke,et al.  Hierarchical Planning with 3D Local Multiresolution Obstacle Avoidance for Micro Aerial Vehicles , 2014, ISR 2014.

[22]  Ahmad Kamal Nasir,et al.  Precision Forestry: Trees Counting in Urban Areas Using Visible Imagery based on an Unmanned Aerial Vehicle , 2016 .

[23]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[24]  Martial Hebert,et al.  Learning monocular reactive UAV control in cluttered natural environments , 2012, 2013 IEEE International Conference on Robotics and Automation.

[25]  Stefan Hrabar,et al.  3D path planning and stereo-based obstacle avoidance for rotorcraft UAVs , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Juan Agüera,et al.  Autonomous systems for precise spraying – Evaluation of a robotised patch sprayer , 2016 .

[27]  Vijay Kumar,et al.  Quadrotor Kinematics and Dynamics , 2015 .

[28]  Volkan Isler,et al.  Large Scale Image Mosaic Construction for Agricultural Applications , 2016, IEEE Robotics and Automation Letters.

[29]  Elon Rimon,et al.  On-line Coverage of Planar Environments by a Battery Powered Autonomous Mobile Robot , 2014, WAFR.