A review on the main challenges in automatic plant disease identification based on visible range images

The problem associated with automatic plant disease identification using visible range images has received considerable attention in the last two decades, however the techniques proposed so far are usually limited in their scope and dependent on ideal capture conditions in order to work properly. This apparent lack of significant advancements may be partially explained by some difficult challenges posed by the subject: presence of complex backgrounds that cannot be easily separated from the region of interest (usually leaf and stem), boundaries of the symptoms often are not well defined, uncontrolled capture conditions may present characteristics that make the image analysis more difficult, certain diseases produce symptoms with a wide range of characteristics, the symptoms produced by different diseases may be very similar, and they may be present simultaneously. This paper provides an analysis of each one of those challenges, emphasizing both the problems that they may cause and how they may have potentially affected the techniques proposed in the past. Some possible solutions capable of overcoming at least some of those challenges are proposed.

[1]  Humberto Bustince,et al.  New method to assess barley nitrogen nutrition status based on image colour analysis , 2009 .

[2]  Janick Mathys,et al.  The use of digital image analysis and real-time PCR fine-tunes bioassays for quantification of Cercospora leaf spot disease in sugar beet breeding , 2012 .

[3]  T. Hsiang,et al.  Quantifying Fungal Infection of Plant Leaves by Digital Image Analysis Using Scion Image Software , 2022 .

[4]  D. Martin,et al.  Microcomputer-Based Quantification of Maize Streak Virus Symptoms in Zea mays. , 1998, Phytopathology.

[5]  Yongqiang Ye,et al.  Use of leaf color images to identify nitrogen and potassium deficient tomatoes , 2011, Pattern Recognit. Lett..

[6]  Carme Torras,et al.  Robotized Plant Probing: Leaf Segmentation Utilizing Time-of-Flight Data , 2013, IEEE Robotics & Automation Magazine.

[7]  Di Cui,et al.  Image processing methods for quantitatively detecting soybean rust from multispectral images , 2010 .

[8]  J. A. Bondy,et al.  Graph Theory , 2008, Graduate Texts in Mathematics.

[9]  Jeremy S. Smith,et al.  An image-processing based algorithm to automatically identify plant disease visual symptoms. , 2009 .

[10]  Michael T. Maliappis,et al.  Image processing for distance diagnosis in pest management , 2004 .

[11]  Clive H. Bock,et al.  Plant Disease Severity Estimated Visually, by Digital Photography and Image Analysis, and by Hyperspectral Imaging , 2010 .

[12]  Jayme Garcia Arnal Barbedo,et al.  Digital image processing techniques for detecting, quantifying and classifying plant diseases. , 2013 .

[13]  Peter Jackson,et al.  Introduction to expert systems , 1986 .

[14]  Sukumar Chakraborty,et al.  Quantitative assessment of lesion characteristics and disease severity using digital image processing , 1997 .

[15]  Min Zhang,et al.  Automatic citrus canker detection from leaf images captured in field , 2011, Pattern Recognit. Lett..

[16]  A. Ferrer,et al.  Pixel classification methods for identifying and quantifying leaf surface injury from digital images , 2014 .

[17]  Anna Margolis,et al.  A Literature Review of Domain Adaptation with Unlabeled Data , 2011 .

[18]  Subhransu Maji,et al.  Bilinear CNN Models for Fine-Grained Visual Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Motoaki Kawanabe,et al.  Direct Importance Estimation with Model Selection and Its Application to Covariate Shift Adaptation , 2007, NIPS.

[20]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  E. Moya,et al.  Assessment of the disease severity of squash powdery mildew through visual analysis, digital image analysis and validation of these methodologies , 2005 .

[22]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[23]  Pritimoy Sanyal,et al.  Pattern recognition method to detect two diseases in rice plants , 2008 .

[24]  Jianfei Cai,et al.  Weakly Supervised Fine-Grained Image Categorization , 2015, ArXiv.

[25]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[26]  Asit Kumar Das,et al.  Rice diseases classification using feature selection and rule generation techniques , 2013 .

[27]  Massimo Marchi,et al.  Automatic detection of powdery mildew on grapevine leaves by image analysis: Optimal view-angle range to increase the sensitivity , 2014 .

[28]  Marian Wiwart,et al.  Early diagnostics of macronutrient deficiencies in three legume species by color image analysis , 2009 .

[29]  Won Suk Lee,et al.  An evaluation of a vision-based sensor performance in Huanglongbing disease identification , 2015 .

[30]  Marcel Salathé,et al.  An open access repository of images on plant health to enable the development of mobile disease diagnostics through machine learning and crowdsourcing , 2015, ArXiv.

[31]  J. F. Reid,et al.  Color Classifier for Symptomatic Soybean Seeds Using Image Processing. , 1999, Plant disease.

[32]  Gary G. Grove,et al.  Assessment of Severity of Powdery Mildew Infection of Sweet Cherry Leaves by Digital Image Analysis , 2001 .

[33]  Wei Guo,et al.  Illumination invariant segmentation of vegetation for time series wheat images based on decision tree model , 2013 .

[34]  Karl-Heinz Dammer,et al.  Detection of head blight (Fusarium ssp.) in winter wheat by color and multispectral image analyses , 2011 .

[35]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[36]  François Laviolette,et al.  A New PAC-Bayesian View of Domain Adaptation , 2015, NIPS 2015.

[37]  Reza Ehsani,et al.  Review: A review of advanced techniques for detecting plant diseases , 2010 .

[38]  Daniel Marçal de Queiroz,et al.  Fall Armyworm Damaged Maize Plant Identification using Digital Images , 2003 .

[39]  T R Gottwald,et al.  Automated Image Analysis of the Severity of Foliar Citrus Canker Symptoms. , 2009, Plant disease.

[40]  Daoliang Li,et al.  An Adaptive Thresholding algorithm of field leaf image , 2013 .

[41]  James J. Jiang A Literature Survey on Domain Adaptation of Statistical Classifiers , 2007 .

[42]  D. Berner,et al.  Use of digital images to differentiate reactions of collections of yellow starthistle (Centaurea solstitialis) to infection by Puccinia jaceae , 2003 .

[43]  Xiao Li,et al.  A Bayesian Divergence Prior for Classiffier Adaptation , 2007, AISTATS.

[44]  Jayme Garcia Arnal Barbedo,et al.  Detecting Fusarium head blight in wheat kernels using hyperspectral imaging , 2015 .

[45]  David Rousseau,et al.  Application note: Thermography versus chlorophyll fluorescence imaging for detection and quantification of apple scab , 2013 .

[46]  Shun'ichi Kaneko,et al.  Image-based field monitoring of Cercospora leaf spot in sugar beet by robust template matching and pattern recognition , 2015, Comput. Electron. Agric..

[47]  Vlastimil Křivan,et al.  Computer-assisted estimation of leaf damage caused by spider mites , 2006 .

[48]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Danielle Dennis,et al.  Digital image analysis of Zostera marina leaf injury , 2008 .

[50]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Rong Zhou,et al.  Disease detection of Cercospora Leaf Spot in sugar beet by robust template matching , 2014 .

[52]  Vincent Martin,et al.  A cognitive vision approach to early pest detection in greenhouse crops , 2008 .

[53]  José Blasco,et al.  Multispectral inspection of citrus in real-time using machine vision and digital signal processors , 2002 .

[54]  T R Gottwald,et al.  Visual Rating and the Use of Image Analysis for Assessing Different Symptoms of Citrus Canker on Grapefruit Leaves. , 2008, Plant disease.

[55]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[56]  Gerrit Polder,et al.  Automatic detection of tulip breaking virus (TBV) in tulip fields using machine vision , 2014 .

[57]  Kuo-Yi Huang Application of artificial neural network for detecting Phalaenopsis seedling diseases using color and texture features , 2007 .

[58]  Won Suk Lee,et al.  An optimum method for real-time in-field detection of Huanglongbing disease using a vision sensor , 2015, Comput. Electron. Agric..

[59]  K. Steddom,et al.  Comparing Image Format and Resolution for Assessment of Foliar Diseases of Wheat , 2005 .

[60]  Minzan Li,et al.  Detection of soybean rust using a multispectral image sensor , 2009 .

[61]  Zhenghong Yu,et al.  Crop feature extraction from images with probabilistic superpixel Markov random field , 2015, Comput. Electron. Agric..

[62]  Eric Duchêne,et al.  A semi-automatic non-destructive method to quantify grapevine downy mildew sporulation. , 2011, Journal of microbiological methods.

[63]  Alain Clément,et al.  A new colour vision system to quantify automatically foliar discolouration caused by insect pests feeding on leaf cells , 2015 .

[64]  O. Bruno,et al.  Use of artificial vision techniques for diagnostic of nitrogen nutritional status in maize plants , 2014 .

[65]  W. S. Lee,et al.  Identification of citrus disease using color texture features and discriminant analysis , 2006 .

[66]  Ruiliang Pu,et al.  Comparison between wavelet spectral features and conventional spectral features in detecting yellow rust for winter wheat , 2014 .

[67]  Trevor Darrell,et al.  Part-Based R-CNNs for Fine-Grained Category Detection , 2014, ECCV.

[68]  Jayme Garcia Arnal Barbedo,et al.  An Automatic Method to Detect and Measure Leaf Disease Symptoms Using Digital Image Processing. , 2014, Plant disease.

[69]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.