Terrain assessment for precision agriculture using vehicle dynamic modelling

Advances in precision agriculture greatly rely on innovative control and sensing technologies that allow service units to increase their level of driving automation while ensuring at the same time high safety standards. This paper deals with automatic terrain estimation and classification that is performed simultaneously by an agricultural vehicle during normal operations. Vehicle mobility and safety, and the successful implementation of important agricultural tasks including seeding, ploughing, fertilising and controlled traffic depend or can be improved by a correct identification of the terrain that is traversed. The novelty of this research lies in that terrain estimation is performed by using not only traditional appearance-based features, that is colour and geometric properties, but also contact-based features, that is measuring physics-based dynamic effects that govern the vehicle–terrain interaction and that greatly affect its mobility. Experimental results obtained from an all-terrain vehicle operating on different surfaces are presented to validate the system in the field. It was shown that a terrain classifier trained with contact features was able to achieve a correct prediction rate of 85.1%, which is comparable or better than that obtained with approaches using traditional feature sets. To further improve the classification performance, all feature sets were merged in an augmented feature space, reaching, for these tests, 89.1% of correct predictions.

[1]  M. G. Bekker Introduction to Terrain-Vehicle Systems , 1969 .

[2]  Mikkel Kragh Hansen,et al.  Object Detection and Terrain Classification in Agricultural Fields Using 3D Lidar Data , 2015, ICVS.

[3]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[4]  Giulio Reina,et al.  LIDAR and stereo combination for traversability assessment of off-road robotic vehicles , 2016, Robotica.

[5]  R. S. Bello,et al.  Agricultural Machinery Management , 2015 .

[6]  Johannes Fürnkranz,et al.  Round Robin Classification , 2002, J. Mach. Learn. Res..

[7]  Alexandre Escolà,et al.  Discriminating Crop, Weeds and Soil Surface with a Terrestrial LIDAR Sensor , 2013, Sensors.

[8]  Steven Dubowsky,et al.  Online terrain parameter estimation for wheeled mobile robots with application to planetary rovers , 2004, IEEE Transactions on Robotics.

[9]  Juan Carlos Fernandez-Diaz,et al.  Characterization of surface roughness of bare agricultural soils using LiDAR , 2010 .

[10]  Thomas Keller,et al.  Terranimo : a web based tool for evaluating soil compaction : model design and user interface , 2012 .

[11]  J. Borenstein,et al.  Wheel slippage and sinkage detection for planetary rovers , 2006, IEEE/ASME Transactions on Mechatronics.

[12]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[13]  Lei Wang,et al.  Hyper-spectral characteristics and classification of farmland soil in northeast of China , 2015 .

[14]  Giulio Reina,et al.  Slip-based terrain estimation with a skid-steer vehicle , 2016 .

[15]  Roland Siegwart,et al.  Comparison of Boosting Based Terrain Classification Using Proprioceptive and Exteroceptive Data , 2008, ISER.

[16]  Giulio Reina,et al.  A Self‐learning Framework for Statistical Ground Classification using Radar and Monocular Vision , 2015, J. Field Robotics.

[17]  F. Marinello,et al.  Application of the Kinect sensor for dynamic soil surface characterization , 2015, Precision Agriculture.

[18]  K. Iagnemma,et al.  Self-Supervised Terrain Classification for Planetary Rovers , 2022 .

[19]  Paul Newman,et al.  A generative framework for fast urban labeling using spatial and temporal context , 2009, Auton. Robots.

[20]  N. O. Myers,et al.  Characterization of surface roughness , 1962 .

[21]  Giulio Reina,et al.  Visual and Tactile-Based Terrain Analysis Using a Cylindrical Mobile Robot , 2006 .

[22]  Karl Iagnemma,et al.  Vibration-based terrain classification for planetary exploration rovers , 2005, IEEE Transactions on Robotics.

[23]  Gary Witus,et al.  Terrain characterization and classification with a mobile robot , 2006, J. Field Robotics.

[24]  Emmanuel G. Collins,et al.  Frequency response method for terrain classification in autonomous ground vehicles , 2008, Auton. Robots.

[25]  Larry H. Matthies,et al.  Obstacle Detection , 2014, Computer Vision, A Reference Guide.

[26]  Jacob Goldberger,et al.  Obstacle detection in a greenhouse environment using the Kinect sensor , 2015, Comput. Electron. Agric..

[27]  Giulio Reina,et al.  Towards Autonomous Agriculture: Automatic Ground Detection Using Trinocular Stereovision , 2012, Sensors.

[28]  David Ball,et al.  Online novelty-based visual obstacle detection for field robotics , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).