Recognition of plant leaf diseases based on computer vision

Agriculture is one of the most important sources of income for people in many countries. However, plant disease issues influence many farmers, as diseases in plants often naturally occur. If proper care is not taken, diseases can have hazardous effects on plants and influence the product quality, quantity or productivity. Therefore, the detection and prevention of plant diseases are serious concerns and should be considered to increase productivity. An effective identification technology can be beneficial for monitoring plant diseases. Generally, the leaves of plants show the first signs of plant disease, and most diseases can be detected from the symptoms that appear on the leaves. Therefore, this paper introduces a novel method for the detection of plant leaf diseases. The method is divided into two parts: image segmentation and image classification. First, a hue, saturation and intensity-based and LAB-based hybrid segmentation algorithm is proposed and used for the disease symptom segmentation of plant disease images. Then, the segmented images are input into a convolutional neural network for image classification. The validation accuracy obtained using this approach was approximately 15.51% higher than that for the conventional method. Additionally, the detection results showed that the average detection rate was 75.59% under complex background conditions, and most of the diseases were effectively detected. Thus, the approach of combined segmentation and classification is effective for plant disease identification, and our empirical research validates the advantages of the proposed method.

[1]  Yao Zhao,et al.  Median filtering detection of small-size image based on CNN , 2018, J. Vis. Commun. Image Represent..

[2]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[3]  Tingting Su,et al.  Image Recognition of Tea Leaf Diseases Based on Convolutional Neural Network , 2018, 2018 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[4]  Adem Tuncer,et al.  Plant Leaf Disease Detection and Classification Based on CNN with LVQ Algorithm , 2018, 2018 3rd International Conference on Computer Science and Engineering (UBMK).

[5]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[6]  Artzai Picón,et al.  Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case , 2017, Comput. Electron. Agric..

[7]  Michal Krumnikl,et al.  Image Segmentation Based on k-Means Clustering and Energy-Transfer Proximity , 2011, ISVC.

[8]  Patrick O. Glauner.  Deep Convolutional Neural Networks for Smile Recognition , 2015, ArXiv.

[9]  Michifumi Yoshioka,et al.  An image segmentation method using histograms and the human characteristics of HSI color space for a scene image , 2005, Artificial Life and Robotics.

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Nong Sang,et al.  Image segmentation via coherent clustering in L*a*b* color space , 2011, Pattern Recognit. Lett..

[12]  Anne-Sophie Capelle-Laizé,et al.  Blind image steganalysis based on evidential K-Nearest Neighbors , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[13]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[14]  Alsayed Algergawy,et al.  A Deep Learning-based Approach for Banana Leaf Diseases Classification , 2017, BTW.

[15]  Jayme Garcia Arnal Barbedo,et al.  Plant disease identification from individual lesions and spots using deep learning , 2019, Biosystems Engineering.

[16]  Okyay Kaynak,et al.  Robust predictive synchronization of uncertain fractional-order time-delayed chaotic systems , 2018, Soft Comput..

[17]  Itir Önal,et al.  Treelogy: A Novel Tree Classifier Utilizing Deep and Hand-crafted Representations , 2017, ArXiv.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  J. G. A. Barbedo,et al.  A novel algorithm for semi-automatic segmentation of plant leaf disease symptoms using digital image processing , 2016, Tropical Plant Pathology.

[20]  S Deepa,et al.  Steganalysis on Images using SVM with Selected Hybrid Features of Gini Index Feature Selection Algorithm , 2017 .

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Hitoshi Iyatomi,et al.  Basic Study of Automated Diagnosis of Viral Plant Diseases Using Convolutional Neural Networks , 2015, ISVC.

[23]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Farid García,et al.  Segmentation of images by color features: A survey , 2018, Neurocomputing.

[25]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[26]  Saeid Minaei,et al.  Vision-based pest detection based on SVM classification method , 2017, Comput. Electron. Agric..

[27]  Malik Braik,et al.  Detection and Classification of Leaf Diseases using K-means-based Segmentation and Neural-networks-based Classification , 2011 .

[28]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[29]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[30]  Sang Cheol Kim,et al.  A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition , 2017, Sensors.

[31]  Chris Chatwin,et al.  AUTOMATIC PLANT PEST DETECTION AND RECOGNITION USING k-MEANS CLUSTERING ALGORITHM AND CORRESPONDENCE FILTERS , 2013 .

[32]  Sandeep Kumar,et al.  Plant leaf disease identification using exponential spider monkey optimization , 2020, Sustain. Comput. Informatics Syst..

[33]  Malik Braik,et al.  Fast and Accurate Detection and Classification of Plant Diseases , 2011 .

[34]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Zhiguo Cao,et al.  Rice heading stage automatic observation by multi-classifier cascade based rice spike detection method , 2018, Agricultural and Forest Meteorology.

[36]  Olarik Surinta,et al.  Comparing Local Descriptors and Bags of Visual Words to Deep Convolutional Neural Networks for Plant Recognition , 2017, ICPRAM.

[37]  Mansour Sheikhan,et al.  Improved contourlet-based steganalysis using binary particle swarm optimization and radial basis neural networks , 2011, Neural Computing and Applications.

[38]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Mahdi Ramezani,et al.  Towards Genetic Feature Selection in Image Steganalysis , 2010, 2010 7th IEEE Consumer Communications and Networking Conference.

[40]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[41]  Raúl Alcaraz,et al.  Combined Nonlinear Analysis of Atrial and Ventricular Series for Automated Screening of Atrial Fibrillation , 2017, Complex..

[42]  Hitoshi Iyatomi,et al.  Basic Investigation on a Robust and Practical Plant Diagnostic System , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[43]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[44]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[45]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  José García,et al.  A Distributed K-Means Segmentation Algorithm Applied to Lobesia botrana Recognition , 2017, Complex..

[47]  Jayme G. A. Barbedo,et al.  Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification , 2018, Comput. Electron. Agric..

[48]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[49]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[50]  Bjarne K. Ersbøll,et al.  Supervised feature selection for linear and non-linear regression of L⁎a⁎b⁎ color from multispectral images of meat , 2014, Eng. Appl. Artif. Intell..

[51]  Jessica J. Fridrich,et al.  Ensemble Classifiers for Steganalysis of Digital Media , 2012, IEEE Transactions on Information Forensics and Security.

[52]  Jayme Garcia Arnal Barbedo,et al.  Factors influencing the use of deep learning for plant disease recognition , 2018, Biosystems Engineering.

[53]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[54]  Ke Zhang,et al.  Residual Networks of Residual Networks: Multilevel Residual Networks , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[55]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[56]  Dongming Zhang,et al.  Deep learning based image recognition for crack and leakage defects of metro shield tunnel , 2018, Tunnelling and Underground Space Technology.

[57]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[58]  Diego Oliva,et al.  Multi-level thresholding-based grey scale image segmentation using multi-objective multi-verse optimizer , 2019, Expert Syst. Appl..