Classifying Wheat Hyperspectral Pixels of Healthy Heads and Fusarium Head Blight Disease Using a Deep Neural Network in the Wild Field

Classification of healthy and diseased wheat heads in a rapid and non-destructive manner for the early diagnosis of Fusarium head blight disease research is difficult. Our work applies a deep neural network classification algorithm to the pixels of hyperspectral image to accurately discern the disease area. The spectra of hyperspectral image pixels in a manually selected region of interest are preprocessed via mean removal to eliminate interference, due to the time interval and the environment. The generalization of the classification model is considered, and two improvements are made to the model framework. First, the pixel spectra data are reshaped into a two-dimensional data structure for the input layer of a Convolutional Neural Network (CNN). After training two types of CNNs, the assessment shows that a two-dimensional CNN model is more efficient than a one-dimensional CNN. Second, a hybrid neural network with a convolutional layer and bidirectional recurrent layer is reconstructed to improve the generalization of the model. When considering the characteristics of the dataset and models, the confusion matrices that are based on the testing dataset indicate that the classification model is effective for background and disease classification of hyperspectral image pixels. The results of the model show that the two-dimensional convolutional bidirectional gated recurrent unit neural network (2D-CNN-BidGRU) has an F1 score and accuracy of 0.75 and 0.743, respectively, for the total testing dataset. A comparison of all the models shows that the hybrid neural network of 2D-CNN-BidGRU is the best at preventing over-fitting and optimize the generalization. Our results illustrate that the hybrid structure deep neural network is an excellent classification algorithm for healthy and Fusarium head blight diseased classification in the field of hyperspectral imagery.

[1]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  H. Friberg,et al.  Agricultural factors affecting Fusarium communities in wheat kernels. , 2017, International journal of food microbiology.

[3]  A. Giebel,et al.  Early detection of Fusarium infection in wheat using hyper-spectral imaging , 2011 .

[4]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[5]  Davide Chicco,et al.  Ten quick tips for machine learning in computational biology , 2017, BioData Mining.

[6]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[7]  Eduard H. Hovy,et al.  End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF , 2016, ACL.

[8]  Lei Xie,et al.  Photo-real talking head with deep bidirectional LSTM , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Clive H. Bock,et al.  Plant Disease Severity Estimated Visually, by Digital Photography and Image Analysis, and by Hyperspectral Imaging , 2010 .

[10]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[11]  Valérie Bourdès,et al.  Comparison of Artificial Neural Network with Logistic Regression as Classification Models for Variable Selection for Prediction of Breast Cancer Patient Outcomes , 2010, Adv. Artif. Neural Syst..

[12]  Narendra S. Chaudhari,et al.  Improvement of bidirectional recurrent neural network for learning long-term dependencies , 2004, ICPR 2004.

[13]  Michele Colajanni,et al.  Trend-based load balancer for a distributed Web system , 2008 .

[14]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[15]  Douglas Kline,et al.  Revisiting squared-error and cross-entropy functions for training neural network classifiers , 2005, Neural Computing & Applications.

[16]  Peter Bajorski,et al.  Statistical Inference in PCA for Hyperspectral Images , 2011, IEEE Journal of Selected Topics in Signal Processing.

[17]  Gang Wang,et al.  Face recognition using Deep PCA , 2013, 2013 9th International Conference on Information, Communications & Signal Processing.

[18]  Shanjun Mao,et al.  Spectral–spatial classification of hyperspectral images using deep convolutional neural networks , 2015 .

[19]  Geoffrey E. Hinton,et al.  Temporal-Kernel Recurrent Neural Networks , 2010, Neural Networks.

[20]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[21]  Matthew L. Clark,et al.  One-Dimensional Convolutional Neural Network Land-Cover Classification of Multi-Seasonal Hyperspectral Imagery in the San Francisco Bay Area, California , 2017, Remote. Sens..

[22]  Francisco Herrera,et al.  Learning from Imbalanced Data Sets , 2018, Springer International Publishing.

[23]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Shanjun Mao,et al.  A deep learning framework for hyperspectral image classification using spatial pyramid pooling , 2016 .

[25]  Baofeng Su,et al.  Significant Remote Sensing Vegetation Indices: A Review of Developments and Applications , 2017, J. Sensors.

[26]  Yu Zhang,et al.  Exploiting Depth and Highway Connections in Convolutional Recurrent Deep Neural Networks for Speech Recognition , 2016, INTERSPEECH.

[27]  E. Smirnov,et al.  Classification in Imbalanced Datasets , 2009 .

[28]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  J. West,et al.  Novel Technologies for the detection of Fusarium head blight disease and airborne inoculum , 2017, Tropical Plant Pathology.

[30]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[31]  David W. Messinger,et al.  Perceptual display strategies of hyperspectral imagery based on PCA and ICA , 2006, SPIE Defense + Commercial Sensing.

[32]  Mark A. Davis,et al.  Estimation of the Deoxynivalenol and Moisture Contents of Bulk Wheat Grain Samples by FT-NIR Spectroscopy , 2017 .

[33]  M. Shahin,et al.  Original paper: Detection of Fusarium damaged kernels in Canada Western Red Spring wheat using visible/near-infrared hyperspectral imaging and principal component analysis , 2011 .

[34]  Howon Kim,et al.  Classification performance using gated recurrent unit recurrent neural network on energy disaggregation , 2016, 2016 International Conference on Machine Learning and Cybernetics (ICMLC).

[35]  Ting Liu,et al.  Document Modeling with Gated Recurrent Neural Network for Sentiment Classification , 2015, EMNLP.

[36]  Chih-Jen Lin,et al.  A Learning-Rate Schedule for Stochastic Gradient Methods to Matrix Factorization , 2015, PAKDD.

[37]  Noel D.G. White,et al.  Extraction of Spectral Information from Hyperspectral Data and Application of Hyperspectral Imaging for Food and Agricultural Products , 2016, Food and Bioprocess Technology.

[38]  Sebastian Michel,et al.  Breeding strategies and advances in line selection for Fusarium head blight resistance in wheat , 2017, Tropical Plant Pathology.

[39]  Russell M. Mersereau,et al.  On the impact of PCA dimension reduction for hyperspectral detection of difficult targets , 2005, IEEE Geoscience and Remote Sensing Letters.

[40]  Marvin E. Klein,et al.  Quantitative Hyperspectral Reflectance Imaging , 2008, Sensors.

[41]  V. Lattanzio,et al.  Occurrence of deoxynivalenol and deoxynivalenol-3-glucoside in durum wheat from Argentina. , 2017, Food chemistry.

[42]  Samy Bengio,et al.  Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks , 2015, NIPS.

[43]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[44]  Marcus Liwicki,et al.  Scene labeling with LSTM recurrent neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[46]  Wenjiang Huang,et al.  Evaluation of wavelet spectral features in pathological detection and discrimination of yellow rust and powdery mildew in winter wheat with hyperspectral reflectance data , 2017 .

[47]  Claudia Kuenzer,et al.  Remote sensing of rice crop areas , 2013 .

[48]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[49]  Giansalvo Cirrincione,et al.  Dedicated hierarchy of neural networks applied to bearings degradation assessment , 2013, 2013 9th IEEE International Symposium on Diagnostics for Electric Machines, Power Electronics and Drives (SDEMPED).

[50]  Yueting Zhuang,et al.  Video Question Answering via Hierarchical Spatio-Temporal Attention Networks , 2017, IJCAI.

[51]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[52]  C. Krishnaveni,et al.  On the Classification of Imbalanced Datasets , 2022 .

[53]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Jayme Garcia Arnal Barbedo,et al.  Detecting Fusarium head blight in wheat kernels using hyperspectral imaging , 2015 .

[55]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[56]  Guolan Lu,et al.  Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging , 2017, Journal of biomedical optics.

[57]  Yuxin Peng,et al.  The application of two-level attention models in deep convolutional neural network for fine-grained image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Michele Colajanni,et al.  Trend-based Load Balancer for a Multi-tier Distributed System , 2007, 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[59]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[60]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[61]  Bartosz Krawczyk,et al.  Learning from imbalanced data: open challenges and future directions , 2016, Progress in Artificial Intelligence.

[62]  Yann LeCun,et al.  Regularization of Neural Networks using DropConnect , 2013, ICML.

[63]  Wei Xu,et al.  Bidirectional LSTM-CRF Models for Sequence Tagging , 2015, ArXiv.

[64]  D. Chakraborty,et al.  Hyperspectral remote sensing for growth-stage-specific water use in wheat , 2013 .

[65]  Karl-Heinz Dammer,et al.  Detection of head blight (Fusarium ssp.) in winter wheat by color and multispectral image analyses , 2011 .

[66]  Yelong Shen,et al.  A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval , 2014, CIKM.

[67]  Benoit Jaillais,et al.  Detection of Fusarium head blight contamination in wheat kernels by multivariate imaging , 2015 .

[68]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[69]  James F. Scholl,et al.  Fast wavelet based feature extraction of spatial and spectral information from hyperspectral datacubes , 2004, SPIE Optics + Photonics.

[70]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[71]  Hao Wu,et al.  Convolutional Recurrent Neural Networks forHyperspectral Data Classification , 2017, Remote. Sens..

[72]  Zhuowen Tu,et al.  Generalizing Pooling Functions in CNNs: Mixed, Gated, and Tree , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  H. Ramon,et al.  Early Disease Detection in Wheat Fields using Spectral Reflectance , 2003 .

[74]  S. Snyder,et al.  Novel neural modulators. , 2003, Annual review of neuroscience.

[75]  Ashish Ghosh,et al.  Band elimination of hyperspectral imagery using partitioned band image correlation and capacitory discrimination , 2014 .

[76]  Gang Wang,et al.  Convolutional recurrent neural networks: Learning spatial dependencies for image representation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[77]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[78]  Xiaojun Qiao,et al.  Utilization of spectral-spatial characteristics in shortwave infrared hyperspectral images to classify and identify fungi-contaminated peanuts. , 2017, Food chemistry.

[79]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.