Object Detection and Terrain Classification in Agricultural Fields Using 3D Lidar Data

Autonomous navigation and operation of agricultural vehicles is a challenging task due to the rather unstructured environment. An uneven terrain consisting of ground and vegetation combined with the risk of non-traversable obstacles necessitates a strong focus on safety and reliability. This paper presents an object detection and terrain classification approach for classifying individual points from 3D point clouds acquired using single multi-beam lidar scans. Using a support vector machine SVM classifier, individual 3D points are categorized as either ground, vegetation, or object based on features extracted from local neighborhoods. Experiments performed at a local working farm show that the proposed method has a combined classification accuracy of $$91.6\,\%$$, detecting points belonging to objects such as humans, animals, cars, and buildings with $$81.1\,\%$$ accuracy, while classifying vegetation with an accuracy of $$97.5\,\%$$.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Anthony Stentz,et al.  Online adaptive rough-terrain navigation vegetation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[3]  Martial Hebert,et al.  Space-carving Kernels for Accurate Rough Terrain Estimation , 2010, Int. J. Robotics Res..

[4]  Martial Hebert,et al.  Scale selection for classification of point-sampled 3D surfaces , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[5]  Peter Christiansen,et al.  Advanced sensor platform for human detection and protection in autonomous farming , 2015 .

[6]  Roberto Manduchi,et al.  Obstacle Detection in Foliage with Ladar and Radar , 2003, ISRR.

[7]  Karl Iagnemma,et al.  Ground plane identification using LIDAR in forested environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[8]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[9]  Martial Hebert,et al.  Terrain Classification Techniques From Ladar Data For Autonomous Navigation , 2002 .

[10]  Martial Hebert,et al.  Natural terrain classification using 3-d ladar data , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[11]  Larry H. Matthies,et al.  Foliage discrimination using a rotating ladar , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  David Suter,et al.  3D terrestrial LIDAR classifications with super-voxels and multi-scale Conditional Random Fields , 2009, Comput. Aided Des..

[13]  Martial Hebert,et al.  Multi-scale interest regions from unorganized point clouds , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Roland Siegwart,et al.  A Layered Approach to People Detection in 3D Range Data , 2010, AAAI.

[15]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[16]  Roberto Manduchi,et al.  Ladar-Based Discrimination of Grass from Obstacles for Autonomous Navigation , 2000, ISER.

[17]  Michael Himmelsbach,et al.  Autonomous Ground Vehicles—Concepts and a Path to the Future , 2012, Proceedings of the IEEE.

[18]  Bertrand Douillard,et al.  On the segmentation of 3D LIDAR point clouds , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.