Image Recognition Method Based on an Improved Convolutional Neural Network to Detect Impurities in Wheat

Impurities in wheat seriously affect wheat quality and food security. They are mainly produced during the operational process of combine harvesters. To solve the recognition and classification problems associated with impurities in wheat, a recognition method using an improved convolutional neural network is proposed in this article. A labeled dataset of normal wheat and five impurities is constructed, using which the Wiener filtering algorithm and the multi-scale Retinex enhancement algorithm are employed for image preprocessing. Based on network research using Inception_v3, improvement and optimization are undertaken before designing the WheNet convolutional neural network, which is intended for automatic recognition of wheat images. Under the same conditions, comparative experiments using the WheNet, ResNet_101 and Inception_v3 networks are conducted. Indexes such as receiver operating characteristic, area under curve (AUC), and recall rate are adopted to evaluate the experimental outcomes. Experimental results indicate that the WheNet network achieved the most efficient results. It also shows a shorter training time, and its recognition accuracies for Top_1 and Top_5 of the test set are 98.59% and 99.98%, respectively. The mean values of both the AUC and recall rate of the network on the recognition of various images of impurities are higher than those of the ResNet_101 and Inception_v3 networks. Consequently, the WheNet network can be a useful tool in recognizing impurities in wheat. Furthermore, this method can be used to detect impurities in other fields.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  U. Srinivasulu Reddy,et al.  Crop pest classification based on deep convolutional neural network and transfer learning , 2019, Comput. Electron. Agric..

[3]  Mingming Zhang,et al.  Identification of Maize Leaf Diseases Using Improved Deep Convolutional Neural Networks , 2018, IEEE Access.

[4]  Noel D.G. White,et al.  Fungal Damage Detection in Wheat Using Short-Wave Near-Infrared Hyperspectral and Digital Colour Imaging , 2012 .

[5]  David Hughes,et al.  Deep Learning for Image-Based Cassava Disease Detection , 2017, Front. Plant Sci..

[6]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Stephen J. Symons,et al.  Detection of fusarium damage in Canadian wheat using visible/near-infrared hyperspectral imaging , 2012, Journal of Food Measurement & Characterization.

[8]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[9]  Mostafa Mehdipour-Ghazi,et al.  Plant identification using deep neural networks via optimization of transfer learning parameters , 2017, Neurocomputing.

[10]  Peng Jiang,et al.  Real-Time Detection of Apple Leaf Diseases Using Deep Learning Approach Based on Improved Convolutional Neural Networks , 2019, IEEE Access.

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[13]  Nilanjan Dey,et al.  Multi-level image thresholding using Otsu and chaotic bat algorithm , 2016, Neural Computing and Applications.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Feng Huang,et al.  A Unified Matrix-Based Convolutional Neural Network for Fine-Grained Image Classification of Wheat Leaf Diseases , 2019, IEEE Access.

[16]  Hari Om,et al.  Newborn face recognition using deep convolutional neural network , 2017, Multimedia Tools and Applications.

[17]  Wei Wu,et al.  Detection of aphids in wheat fields using a computer vision technique , 2016 .

[18]  Tianxu Zhang,et al.  Framelet regularization for uneven intensity correction of color images with illumination and reflectance estimation , 2018, Neurocomputing.

[19]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[20]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[21]  Wei Zhang,et al.  Convolutional Neural Network Based Models for Improving Super-Resolution Imaging , 2019, IEEE Access.

[22]  Josse De Baerdemaeker,et al.  Hyperspectral waveband selection for on-line measurement of grain cleanness , 2009 .

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Hemerson Pistori,et al.  Weed detection in soybean crops using ConvNets , 2017, Comput. Electron. Agric..

[25]  Matthew J. Hausknecht,et al.  Beyond short snippets: Deep networks for video classification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Wang Pei,et al.  Convolutional neural network-based automatic image recognition for agricultural machinery , 2018 .

[27]  Saeid Minaei,et al.  Vision-based pest detection based on SVM classification method , 2017, Comput. Electron. Agric..

[28]  Silvia Serranti,et al.  The development of a hyperspectral imaging method for the detection of Fusarium-damaged, yellow berry and vitreous Italian durum wheat kernels , 2013 .

[29]  Md. Ashraf Shubana khan,et al.  Towards Detection of Bus Driver Fatigue based on Robust Visual Analysis of Eye State , 2019, JOURNAL OF MECHANICS OF CONTINUA AND MATHEMATICAL SCIENCES.

[30]  Graham W. Taylor,et al.  Automatic moth detection from trap images for pest management , 2016, Comput. Electron. Agric..

[31]  Alsayed Algergawy,et al.  A Deep Learning-based Approach for Banana Leaf Diseases Classification , 2017, BTW.

[32]  Zafer Cömert,et al.  Identification of haploid and diploid maize seeds using convolutional neural networks and a transfer learning approach , 2019, Comput. Electron. Agric..

[33]  Naoshi Kondo,et al.  Monitoring harvested paddy during combine harvesting using a machine vision-Double lighting system , 2017 .

[34]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.