Plant Classification for Field Robots: A Machine Vision Approach

Small size agricultural robots which are capable of sensing and manipulating the field environment are a promising approach towards more ecological, sustainable and human-friendly agriculture. This chapter proposes a machine vision approach for plant classification in the field and discusses its possible application in the context of robot based precision agriculture. The challenges of machine vision in the field are discussed at the example of plant classification for weed control. Automatic crop/weed discrimination enables new weed control strategies where single weed plants are treated individually. System development and evaluation are done using a dataset of images captured in a commercial organic carrot farm with the autonomous field robot Bonirob under field conditions. Results indicate plant classification performance with 93% average accuracy.

[1]  David Jones,et al.  Individual leaf extractions from young canopy images using Gustafson-Kessel clustering and a genetic algorithm , 2006 .

[2]  Xiaofeng Wang,et al.  Leaf shape based plant species recognition , 2007, Appl. Math. Comput..

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  Amit Bhati,et al.  A Study of Cloud Computing for Retinal Image Processing Through MATLAB , 2012, Int. J. Cloud Appl. Comput..

[5]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[6]  A. J. S. McDonald,et al.  Weed and crop discrimination using image analysis and artificial intelligence methods , 2003 .

[7]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[8]  Xavier Maldague,et al.  Bayesian classification and unsupervised learning for isolating weeds in row crops , 2014, Pattern Analysis and Applications.

[9]  Lie Tang,et al.  Automatic inter-plant spacing sensing at early growth stages using a 3D vision sensor , 2012 .

[10]  I. M. Scotford,et al.  Applications of Spectral Reflectance Techniques in Northern European Cereal Production: A Review , 2005 .

[11]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[12]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[13]  Jörn Ostermann,et al.  Plant classification system for crop /weed discrimination without segmentation , 2014, IEEE Winter Conference on Applications of Computer Vision.

[14]  L. Tian,et al.  A Review on Remote Sensing of Weeds in Agriculture , 2004, Precision Agriculture.

[15]  D. R. Cutler,et al.  Utah State University From the SelectedWorks of , 2017 .

[16]  Matthias Baumann,et al.  Approach Towards Robotic Mechanical Weed Regulation in Organic Farming , 2012, AMS.

[17]  Hanêne Ben-Abdallah,et al.  An Improved Lane Detection and Tracking Method for Lane Departure Warning Systems , 2013, Int. J. Comput. Vis. Image Process..

[18]  Alberto Tellaeche,et al.  A vision-based method for weeds identification through the Bayesian decision theory , 2008, Pattern Recognit..

[19]  Paolo Remagnino,et al.  Shape and Texture Based Plant Leaf Classification , 2010, ACIVS.

[20]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  R. Krishnamoorthi,et al.  Rotation Invariant Texture Image Retrieval with Orthogonal Polynomials Model , 2011, Int. J. Comput. Vis. Image Process..

[23]  David C. Slaughter,et al.  Autonomous robotic weed control systems: A review , 2008 .

[24]  Albert-Jan Baerveldt,et al.  An Agricultural Mobile Robot with Vision-Based Perception for Mechanical Weed Control , 2002, Auton. Robots.

[25]  Ramón Díaz-Uriarte,et al.  Gene selection and classification of microarray data using random forest , 2006, BMC Bioinformatics.

[26]  Jörn Ostermann,et al.  A Crop/Weed Field Image Dataset for the Evaluation of Computer Vision Based Precision Agriculture Tasks , 2014, ECCV Workshops.

[27]  Esmaeil S. Nadimi,et al.  Site‐specific weed control technologies , 2009 .

[28]  J. Hemming,et al.  PA—Precision Agriculture: Computer-Vision-based Weed Identification under Field Conditions using Controlled Lighting , 2001 .

[29]  Gonzalo Pajares,et al.  Support Vector Machines for crop/weeds identification in maize fields , 2012, Expert Syst. Appl..

[30]  J. Marchant,et al.  Segmentation of row crop plants from weeds using colour and morphology , 2003 .

[31]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .