On-line crop/weed discrimination through the Mahalanobis distance from images in maize fields

This study proposes a new automatic method for crop/weed discrimination in images captured in maize fields during the initial growth stages. The images were obtained under perspective projection with a camera installed on board at the front part of a tractor. Different approaches have addressed the problem based on crop row determination and then assuming that inter-row plants are weeds. Nevertheless, an important challenge is the identification of weeds intermixed within the crop rows. This issue is addressed on this paper by applying a minimum criterion distance based on the Mahalanobis distance derived from a Bayesian classification approach, this makes the main contribution. The identification of both intra- and inter-row weeds is useful for more accurate weed quantification for site-specific treatments. Image quality is affected by uncontrolled lighting conditions in outdoor agricultural environments. Also, different plant densities appear due to different growth stages affecting the crop/weed identification process. The proposed method was designed to deal with the above undesired situations, consisting of three phases: (i) segmentation, (ii) training and (iii) testing. The three phases are executed on-line for each image, where training is specific of each single image, requiring no prior training, as it is usual in common machine learning-based approaches, mainly supervised. This makes the second research contribution. The performance of the proposed approach was quantitatively compared against three existing strategies, achieving an accuracy of 91.8%, pixel-wise determined against ground-truth images manually built, with processing times ≤280 ms, which can be useful for real-time applications.

[1]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[2]  G. Pajares,et al.  Crop Row Detection in Maize Fields Inspired on the Human Visual Perception , 2012, TheScientificWorldJournal.

[3]  David Jones,et al.  Intensified fuzzy clusters for classifying plant, soil, and residue regions of interest from color images , 2004 .

[4]  David G. Stork,et al.  Pattern Classification , 1973 .

[5]  Asnor Juraiza Ishak,et al.  Original paper: Weed image classification using Gabor wavelet and gradient field distribution , 2009 .

[6]  T. Kataoka,et al.  Crop growth estimation system using machine vision , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[7]  Gonzalo Pajares,et al.  Discrete wavelets transform for improving greenness image segmentation in agricultural images , 2015, Comput. Electron. Agric..

[8]  A. T. Nieuwenhuizen,et al.  Adaptive detection of volunteer potato plants in sugar beet fields , 2010, Precision Agriculture.

[9]  Xavier P. Burgos-Artizzu,et al.  utomatic segmentation of relevant textures in agricultural images , 2010 .

[10]  Da-Wen Sun,et al.  Inspection and grading of agricultural and food products by computer vision systems—a review , 2002 .

[11]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[12]  E. R. Davies,et al.  The application of machine vision to food and agriculture: a review , 2009 .

[13]  Gonzalo Pajares,et al.  Automatic detection of curved and straight crop rows from images in maize fields , 2017 .

[14]  Francisca López-Granados,et al.  Object- and pixel-based analysis for mapping crops and their agro-environmental associated measures using QuickBird imagery , 2009 .

[15]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[16]  Gonzalo Pajares,et al.  Automatic expert system based on images for accuracy crop row detection in maize fields , 2013, Expert Syst. Appl..

[17]  George E. Meyer,et al.  Machine vision detection parameters for plant species identification , 1999, Other Conferences.

[18]  N. D. Tillett,et al.  Automated Crop and Weed Monitoring in Widely Spaced Cereals , 2006, Precision Agriculture.

[19]  Gonzalo Pajares,et al.  Camera Sensor Arrangement for Crop/Weed Detection Accuracy in Agronomic Images , 2013, Sensors.

[20]  Ivan Vidovic,et al.  Crop row detection by global energy minimization , 2016, Pattern Recognit..

[21]  G. Pajares,et al.  Unsupervised learning for crop/weeds discrimination in maize fields with high weeds densities. , 2012 .

[22]  Gonzalo Pajares,et al.  Curved and straight crop row detection by accumulation of green pixels from images in maize fields , 2018, Precision Agriculture.

[23]  Maria C. Garcia-Alegre,et al.  Development of an image analysis system for estimation of weed pressure. , 2005 .

[24]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[25]  Gonzalo Pajares,et al.  Fleets of robots for environmentally-safe pest control in agriculture , 2017, Precision Agriculture.

[26]  Alberto Tellaeche,et al.  A computer vision approach for weeds identification through Support Vector Machines , 2011, Appl. Soft Comput..

[27]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[28]  Gonzalo Pajares,et al.  New Trends in Robotics for Agriculture: Integration and Assessment of a Real Fleet of Robots , 2014, TheScientificWorldJournal.

[29]  J. C. Neto,et al.  A combined statistical-soft computing approach for classification and mapping weed species in minimum -tillage systems , 2004 .

[30]  Gonzalo Pajares,et al.  Support Vector Machines for crop/weeds identification in maize fields , 2012, Expert Syst. Appl..

[31]  Frederic Truchetet,et al.  Wavelet transform to discriminate between crop and weed in perspective agronomic images , 2009 .

[32]  F. Truchetet,et al.  Crop/weed discrimination in perspective agronomic images , 2008 .

[33]  R. Leemans,et al.  Comparing global vegetation maps with the Kappa statistic , 1992 .

[34]  G. Meyer,et al.  Verification of color vegetation indices for automated crop imaging applications , 2008 .

[35]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[36]  S. Christensen,et al.  Colour and shape analysis techniques for weed detection in cereal fields , 2000 .

[37]  Gonzalo Pajares,et al.  Automatic detection of crop rows in maize fields with high weeds pressure , 2012, Expert Syst. Appl..

[38]  Gonzalo Pajares,et al.  Automatic expert system for weeds/crops identification in images from maize fields , 2013, Expert Syst. Appl..

[39]  Faisal Ahmed,et al.  Classification of crops and weeds from digital images: A support vector machine approach , 2012 .

[40]  Gonzalo Pajares,et al.  Machine-Vision Systems Selection for Agricultural Vehicles: A Guide , 2016, J. Imaging.

[41]  Xavier P. Burgos-Artizzu,et al.  Real-time image processing for crop / weed discrimination in maize fields , 2012 .

[42]  Albert-Jan Baerveldt,et al.  A vision based row-following system for agricultural field machinery , 2005 .

[43]  Gonzalo Pajares,et al.  A new Expert System for greenness identification in agricultural images , 2013, Expert Syst. Appl..

[44]  María Guijarro,et al.  Identification of Plant Textures in Agricultural Images by Principal Component Analysis , 2016, HAIS.

[45]  Jui Jen Chou,et al.  Crop identification with wavelet packet analysis and weighted Bayesian distance , 2007 .