Identification and Classification of Maize Drought Stress Using Deep Convolutional Neural Network

Drought stress seriously affects crop growth, development, and grain production. Existing machine learning methods have achieved great progress in drought stress detection and diagnosis. However, such methods are based on a hand-crafted feature extraction process, and the accuracy has much room to improve. In this paper, we propose the use of a deep convolutional neural network (DCNN) to identify and classify maize drought stress. Field drought stress experiments were conducted in 2014. The experiment was divided into three treatments: optimum moisture, light drought, and moderate drought stress. Maize images were obtained every two hours throughout the whole day by digital cameras. In order to compare the accuracy of DCNN, a comparative experiment was conducted using traditional machine learning on the same dataset. The experimental results demonstrated an impressive performance of the proposed method. For the total dataset, the accuracy of the identification and classification of drought stress was 98.14% and 95.95%, respectively. High accuracy was also achieved on the sub-datasets of the seedling and jointing stages. The identification and classification accuracy levels of the color images were higher than those of the gray images. Furthermore, the comparison experiments on the same dataset demonstrated that DCNN achieved a better performance than the traditional machine learning method (Gradient Boosting Decision Tree GBDT). Overall, our proposed deep learning-based approach is a very promising method for field maize drought identification and classification based on digital images.

[1]  Hulya Yalcin,et al.  Phenology recognition using deep learning , 2018, 2018 Electric Electronics, Computer Science, Biomedical Engineerings' Meeting (EBBT).

[2]  Alexis Comar,et al.  Leaf-rolling in maize crops: from leaf scoring to canopy-level measurements for phenotyping , 2017, bioRxiv.

[3]  Lingxian Zhang,et al.  A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network , 2018, Comput. Electron. Agric..

[4]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[5]  Ashutosh Kumar Singh,et al.  Machine Learning for High-Throughput Stress Phenotyping in Plants. , 2016, Trends in plant science.

[6]  Kai Sonder,et al.  Phenotyping for abiotic stress tolerance in maize. , 2012, Journal of integrative plant biology.

[7]  Ping Wang,et al.  Early detection of water stress in maize based on digital images , 2017, Comput. Electron. Agric..

[8]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[9]  Curt H. Davis,et al.  Rapid broad area search and detection of Chinese surface-to-air missile sites using deep convolutional neural networks , 2017 .

[10]  Baskar Ganapathysubramanian,et al.  An explainable deep machine vision framework for plant stress phenotyping , 2018, Proceedings of the National Academy of Sciences.

[11]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[12]  Hamid Laga,et al.  Detection and analysis of wheat spikes using Convolutional Neural Networks , 2018, Plant Methods.

[13]  David Stutz,et al.  Understanding Convolutional Neural Networks , 2014 .

[14]  Ajay Sharda,et al.  Development and evaluation of thermal infrared imaging system for high spatial and temporal resolution crop water stress monitoring of corn within a greenhouse , 2016, Comput. Electron. Agric..

[15]  R. Rasheed,et al.  Influence of Drought Applied at Different Growth Stages on Kernel Yield and Quality in Maize (Zea Mays L.) , 2016 .

[16]  Kuo-Yi Huang Application of artificial neural network for detecting Phalaenopsis seedling diseases using color and texture features , 2007 .

[17]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[18]  Yun Zhang,et al.  Identification of Apple Leaf Diseases Based on Deep Convolutional Neural Networks , 2017, Symmetry.

[19]  Ashutosh Kumar Singh,et al.  Deep Learning for Plant Stress Phenotyping: Trends and Future Perspectives. , 2018, Trends in plant science.

[20]  Xiaoling Liang,et al.  Trends in drought tolerance in Chinese maize cultivars from the 1950s to the 2000s , 2017 .

[21]  Ping Wang,et al.  Detection of maize drought based on texture and morphological features , 2018, Comput. Electron. Agric..

[22]  R. Zakaluk,et al.  Artificial Neural Network Modelling of Leaf Water Potential for Potatoes Using RGB Digital Images: A Greenhouse Study , 2007, Potato Research.

[23]  Lutz Plümer,et al.  A review of advanced machine learning methods for the detection of biotic stress in precision crop protection , 2014, Precision Agriculture.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  K. Nagel,et al.  Screening for drought tolerance of maize hybrids by multi-scale analysis of root and shoot traits at the seedling stage. , 2016, Journal of experimental botany.

[26]  Su Ki Ooi,et al.  Detecting maize leaf water status by using digital RGB images , 2014 .

[27]  Zongxue Xu,et al.  A drought rarity and evapotranspiration-based index as a suitable agricultural drought indicator , 2017 .

[28]  Pritam Chanda,et al.  DeepSort: deep convolutional networks for sorting haploid maize seeds , 2018, BMC Bioinformatics.

[29]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[30]  Zi-qi Zhao,et al.  Physiological and Dry Matter Characteristics of Spring Maize in Northeast China under Drought Stress , 2018, Water.

[31]  Dan Wu,et al.  Panicle-SEG: a robust image segmentation method for rice panicles in the field based on deep learning and superpixel optimization , 2017, Plant Methods.

[32]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[33]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[34]  O. Mutanga,et al.  Machine learning prediction of coffee rust severity on leaves using spectroradiometer data , 2018, Tropical Plant Pathology.

[35]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..

[36]  Nasir M. Rajpoot,et al.  Automatic Detection of Regions in Spinach Canopies Responding to Soil Moisture Deficit Using Combined Visible and Thermal Imagery , 2014, PloS one.

[37]  Kendall C. DeJonge,et al.  Water productivity under strategic growth stage-based deficit irrigation in maize , 2019, Agricultural Water Management.

[38]  Stefano Bianchi,et al.  Seed-per-pod estimation for plant breeding using deep learning , 2018, Comput. Electron. Agric..

[39]  Baskar Ganapathysubramanian,et al.  A real-time phenotyping framework using machine learning for plant stress severity rating in soybean , 2017, Plant Methods.

[40]  H. Jones Irrigation scheduling: advantages and pitfalls of plant-based methods. , 2004, Journal of experimental botany.