Ambient awareness for agricultural robotic vehicles

In the last few years, robotic technology has been increasingly employed in agriculture to develop intelligent vehicles that can improve productivity and competitiveness. Accurate and robust environmental perception is a critical requirement to address unsolved issues including safe interaction with field workers and animals, obstacle detection in controlled traffic applications, crop row guidance, surveying for variable rate applications, and situation awareness, in general, towards increased process automation. Given the variety of conditions that may be encountered in the field, no single sensor exists that can guarantee reliable results in every scenario. The development of a multi-sensory perception system to increase the ambient awareness of an agricultural vehicle operating in crop fields is the objective of the Ambient Awareness for Autonomous Agricultural Vehicles (QUAD-AV) project. Different onboard sensor technologies, namely stereovision, LIDAR, radar, and thermography, are considered. Novel methods for their combination are proposed to automatically detect obstacles and discern traversable from non-traversable areas. Experimental results, obtained in agricultural contexts, are presented showing the effectiveness of the proposed methods.

[1]  Sang Uk Lee,et al.  A dense stereo matching using two-pass dynamic programming with generalized ground control points , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  John F. Vetelino,et al.  Introduction to Sensors , 2010 .

[3]  Giulio Reina,et al.  LIDAR and stereo imagery integration for safe navigation in outdoor settings , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[4]  Giulio Reina,et al.  3D reconstruction and classification of natural environments by an autonomous vehicle using multi-baseline stereo , 2014, Intell. Serv. Robotics.

[5]  Takeo Kanade,et al.  Integrating LIDAR into Stereo for Fast and Improved Disparity Computation , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[6]  Larry H. Matthies,et al.  Stereo-Based Tree Traversability Analysis for Autonomous Off-Road Navigation , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[7]  T. Cichon.  The EU Framework Programme for Research and Innovation H2020 Research and Innovation Action Deliverable D4.4 Switching between Direct Control and Prediction Mode , 2018 .

[8]  Peng Chang,et al.  Collision sensing by stereo vision and radar sensor fusion , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[9]  Fawzi Nashashibi,et al.  Intersection safety using lidar and stereo vision sensors , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[10]  Giulio Reina,et al.  The FLEXnav precision dead-reckoning system , 2006 .

[11]  Reid G. Simmons,et al.  Recent progress in local and global traversability for planetary rovers , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  Giulio Reina,et al.  Towards Autonomous Agriculture: Automatic Ground Detection Using Trinocular Stereovision , 2012, Sensors.

[13]  Qin Zhang,et al.  Development of a stereovision sensing system for 3D crop row structure mapping and tractor guidance , 2008 .

[14]  A. Rankin,et al.  Evaluation of stereo vision obstacle detection algorithms for off-road autonomous navigation , 2005 .

[15]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[16]  Ronny Hartanto,et al.  Dynamic and distributed Infield-Planning System for Harvesting , 2013 .

[17]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[18]  David G. Stork,et al.  Pattern Classification , 1973 .

[19]  Zhengping Ji,et al.  Radar-vision fusion for object classification , 2008, 2008 11th International Conference on Information Fusion.

[20]  Teresa A. Vidal-Calleja,et al.  Selective Combination of Visual and Thermal Imaging for Resilient Localization in Adverse Conditions: Day and Night, Smoke and Fire , 2013, J. Field Robotics.

[21]  John Lienhard,et al.  A Century of Innovation: Twenty Engineering Achievements that Transformed Our Lives , 2004 .

[22]  Giulio Reina,et al.  Combining radar and vision for self-supervised ground segmentation in outdoor environments , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[24]  Christopher Rasmussen,et al.  Combining laser range, color, and texture cues for autonomous road following , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[25]  Giulio Reina,et al.  A Self‐learning Framework for Statistical Ground Classification using Radar and Monocular Vision , 2015, J. Field Robotics.

[26]  Arno Ruckelshausen,et al.  Modular System Architecture for Individual Plant Phentotyping with an Autonomous Field Robot , 2009 .

[27]  Ricardo Carelli,et al.  Agricultural Robotics: Unmanned Robotic Service Units in Agricultural Tasks , 2013, IEEE Industrial Electronics Magazine.

[28]  Martial Hebert,et al.  Classifier fusion for outdoor obstacle detection , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[29]  Hugh F. Durrant-Whyte,et al.  Radar‐based perception for autonomous outdoor vehicles , 2011, J. Field Robotics.

[30]  K. Kusumoto,et al.  Genomic Analysis of Koji Mold Aspergillus oryzae and Investigation of Novel Peptidases by Post-genomic Approach , 2012 .

[31]  Karl Iagnemma,et al.  Self‐supervised terrain classification for planetary surface exploration rovers , 2012, J. Field Robotics.

[32]  Keiji Hanawa,et al.  Development of a Stereo Vision System to Assist the Operation of Agricultural Tractors , 2012 .

[33]  David Ball,et al.  Novelty-based visual obstacle detection in agriculture , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[34]  David Ball,et al.  Vision based guidance for robot navigation in agriculture , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[35]  J. Underwood,et al.  Towards reliable perception for Unmanned Ground Vehicles in challenging conditions , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  J. Janata.  Introduction to Sensors , 2009 .

[37]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.