An optimized model based on convolutional neural networks and orthogonal learning particle swarm optimization algorithm for plant diseases diagnosis

Abstract The plant disease classification based on using digital images is very challenging. In the last decade, machine learning techniques and plant images classification tools such as deep learning can be used for recognizing, detecting and diagnosing plant diseases. Currently, deep learning technology has been used for plant disease detection and classification. In this paper, an ensemble model of two pre-trained convolutional neural networks (CNNs) namely VGG16 and VGG19 have been developed for the task plant disease diagnosis by classifying the leaves images of healthy and unhealthy. In this context, CNNs are used due to its capability of overcoming the technical problems which are associated with the classification problem of plant diseases. However, CNNs suffer from a great variety of hyperparameters with specific architectures which is considered as a challenge to identify manually the optimal hyperparameters. Therefore, orthogonal learning particle swarm optimization (OLPSO) algorithm is utilized in this paper to optimize a number of these hyperparameters by finding optimal values for these hyperparameters rather than using traditional methods such as the manual trial and error method. In this paper, to prevent CNNs from falling into the local minimum and to train efficiently, an exponentially decaying learning rate (EDLR) schema is used. In this paper, the problem of the imbalanced used dataset has been solved by using random minority oversampling and random majority undersampling methods, and some restrictions in terms of both the number and diversity of samples have been overcome. The obtained results of this work show that the accuracy of the proposed model is very competitive. The experimental results are compared with the performance of other pre-trained CNN models namely InceptionV3 and Xception, whose hyperparameters were selected using a non-evolutionary method. The comparison results demonstrated that the proposed diagnostic approach has achieved higher performance than the other models.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Stefan Strauß,et al.  From Big Data to Deep Learning: A Leap Towards Strong AI or 'Intelligentia Obscura'? , 2018, Big Data Cogn. Comput..

[3]  Prabhjot Kaur,et al.  Comparing the Behavior of Oversampling and Undersampling Approach of Class Imbalance Learning by Combining Class Imbalance Problem with Noise , 2018 .

[4]  Antônio Teixeira do Amaral Júnior,et al.  Genome wide association study for gray leaf spot resistance in tropical maize core , 2018, PloS one.

[5]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[6]  Pooja Asopa,et al.  Conceptual Understanding of Convolutional Neural Network- A Deep Learning Approach , 2018 .

[7]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[8]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[9]  Jayme Garcia Arnal Barbedo,et al.  Digital image processing techniques for detecting, quantifying and classifying plant diseases. , 2013 .

[10]  Jiban Shrestha,et al.  A review on threat of gray leaf spot disease of maize in Asia , 2015 .

[11]  Mark J. van der Laan,et al.  The relative performance of ensemble methods with deep convolutional neural networks for image classification , 2017, Journal of applied statistics.

[12]  Wen-Huang Cheng,et al.  Computer-aided classification of lung nodules on computed tomography images via deep learning technique , 2015, OncoTargets and therapy.

[13]  Suet-Peng Yong,et al.  A deep learning architecture for classifying medical images of anatomy object , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[14]  Minping Jia,et al.  Wear indicator construction of rolling bearings based on multi-channel deep convolutional neural network with exponentially decaying learning rate , 2019, Measurement.

[15]  Arnu Pretorius,et al.  A bias-variance analysis of ensemble learning for classification , 2016 .

[16]  Roslina Mohamad,et al.  Enhancement of cross-entropy based stopping criteria via turning point indicator , 2017, 2017 7th International Conference on Modeling, Simulation, and Applied Optimization (ICMSAO).

[17]  Ashraf Darwish,et al.  A survey of swarm and evolutionary computing approaches for deep learning , 2019, Artificial Intelligence Review.

[18]  Yun Zhang,et al.  Identification of Apple Leaf Diseases Based on Deep Convolutional Neural Networks , 2017, Symmetry.

[19]  Abidi Ishfaq,et al.  Genetic studies on common rust (Puccinia sorghii) of maize under Kashmir conditions , 2015 .

[20]  Ilya Kostrikov,et al.  An Efficient Convolutional Network for Human Pose Estimation , 2016, BMVC.

[21]  Xiaohong W. Gao,et al.  Classification of CT brain images based on deep learning networks , 2017, Comput. Methods Programs Biomed..

[22]  Ausif Mahmood,et al.  A Framework for Designing the Architectures of Deep Convolutional Neural Networks , 2017, Entropy.

[23]  Xin-She Yang,et al.  Bio-inspired computation: Where we stand and what's next , 2019, Swarm Evol. Comput..

[24]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[25]  Rajesh Singh,et al.  Turcicum Leaf Blight: A Ubiquitous Foliar Disease of Maize (Zea mays L.) , 2017 .

[26]  Pinar Yildirim Pattern Classification with Imbalanced and Multiclass Data for the Prediction of Albendazole Adverse Event Outcomes , 2016, ANT/SEIT.

[27]  Lior Rokach,et al.  Ensemble learning: A survey , 2018, WIREs Data Mining Knowl. Discov..

[28]  Swagatam Das,et al.  A closed loop stability analysis and parameter selection of the Particle Swarm Optimization dynamics for faster convergence , 2007, 2007 IEEE Congress on Evolutionary Computation.

[29]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Anselmo Cardoso de Paiva,et al.  Lung nodules diagnosis based on evolutionary convolutional neural network , 2017, Multimedia Tools and Applications.

[31]  Antonio Teixeira do Amaral Júnior,et al.  History of northern corn leaf blight disease in the seventh cycle of recurrent selection of an UENF-14 popcorn population , 2016 .

[32]  Kreangkrai Kirdsiri,et al.  Efficacies of Some Fungicides and Antagonists in Controlling Northern Corn Leaf Blight Disease , 2015 .

[33]  Clive H. Bock,et al.  Plant Disease Severity Estimated Visually, by Digital Photography and Image Analysis, and by Hyperspectral Imaging , 2010 .

[34]  Georg Heigold,et al.  An empirical study of learning rates in deep neural networks for speech recognition , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[35]  Rebecca J. Nelson,et al.  Resistance to Gray Leaf Spot of Maize: Genetic Architecture and Mechanisms Elucidated through Nested Association Mapping and Near-Isogenic Line Analysis , 2015, PLoS genetics.

[36]  Chenggong Zhang,et al.  Scale-free fully informed particle swarm optimization algorithm , 2011, Inf. Sci..

[37]  Jagdish C. Patra,et al.  A novel orthogonal PSO algorithm based on orthogonal diagonalization , 2017, Swarm Evol. Comput..

[38]  Jun Li,et al.  Deep Convolutional Neural Network with Independent Softmax for Large Scale Face Recognition , 2016, ACM Multimedia.

[39]  Haider A. Alwzwazy,et al.  Robust Convolutional Neural Networks for Image Recognition , 2015 .

[40]  Utpal Dey,et al.  Integrated disease management strategy of common rust of maize incited by Puccinia sorghi Schw. , 2015 .

[41]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[42]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[43]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[44]  Zhiming Luo,et al.  Improving deep ensemble vehicle classification by using selected adversarial samples , 2018, Knowl. Based Syst..