Plant Recognition through the Fusion of 2D and 3D Images for Robotic Weeding

Abstract. In crop production systems, weed management is vitally important. But both manual weeding and herbicide-based weed controlling are problematic due to concerns in cost, operator health, emergence of herbicide-resistant weed species, and environment impact. Automated robotic weeding offers a possibility of controlling weeds in a precise fashion, particularly for weeds growing near crops or within crop rows. However, identification and localization of plants have not yet been fully automated. The goal of this reported project is to develop a high-throughput plant recognition and localization algorithm by fusing 2D color and textural data with 3D point cloud data. Plant morphological models were developed and applied for plant recognition against different weed species at different growth stages.

[1]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[2]  J.M. Alvarez,et al.  Illuminant-invariant model-based road segmentation , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[3]  Xiaofeng Wang,et al.  Leaf shape based plant species recognition , 2007, Appl. Math. Comput..

[4]  Joachim Hertzberg,et al.  An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments , 2003, Robotics Auton. Syst..

[5]  Lin Kunhui,et al.  Feature extraction and automatic recognition of plant leaf using artificial neural network , 2007 .

[6]  Lie Tang,et al.  Automatic inter-plant spacing sensing at early growth stages using a 3D vision sensor , 2012 .

[7]  Craig S. T. Daughtry,et al.  Acquisition of NIR-Green-Blue Digital Photographs from Unmanned Aircraft for Crop Monitoring , 2010, Remote. Sens..

[8]  M. S. Drew,et al.  Recovery of a chromaticity image free from shadows via illumination invariance , 2003 .

[9]  Albert-Jan Baerveldt,et al.  An Agricultural Mobile Robot with Vision-Based Perception for Mechanical Weed Control , 2002, Auton. Robots.

[10]  Jian Jin,et al.  Corn plant sensing using real-time stereo vision , 2009 .

[11]  Larry Li,et al.  Time-of-Flight Camera - An Introduction , 2014 .

[12]  Giovanna Sansoni,et al.  State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation , 2009, Sensors.

[13]  Ji Li.  3D machine vision system for robotic weeding and plant phenotyping , 2014 .

[14]  Peter Biber,et al.  Plant detection and mapping for agricultural robots using a 3D LIDAR sensor , 2011, Robotics Auton. Syst..

[15]  Carme Torras,et al.  Robotic leaf probing via segmentation of range data into surface patches , 2012 .