An Improved CNN-Based Apple Appearance Quality Classification Method With Small Samples

Apple quality classification is an important means to refine apple sales market and promote apple sales. At present, most of classification methods based on a convolutional neural network (CNN) depend on the quantity of training samples to get good performance. But due to the lack of large-scale public apple appearance dataset, it is a big challenge to obtain high accuracy of apple appearance quality classification with small samples. Therefore, we propose an improved method based on CNN for apple appearance, quality classification with small samples. Firstly, support vector machine (SVM) is used for image segmentation to avoid the decrease of recognition accuracy caused by environmental noise. Secondly, the segmented image data are input into deep convolutional generative adversarial networks (DCGAN) model, which is used for data expansion. Thirdly, the improved ResNet50 (Imp-ResNet50) is proposed as follows: Replace the fully-connected layer with global average pooling layer; Add the dropout algorithm and batch normalization algorithm at the fully-connected layer; Replace the activation function ReLU with Swish. Through comparative experiments with 360 apple images, we verify the performance of the proposed method including the training image quality, the running time, and classification accuracy. The result shows that the proposed method can obtain high quality training samples and reduce the running time of the method effectively. At the same time, it can realize higher classification accuracy that is up to 96.5%, which is higher than the previous classification method.

[1]  Sarangi Sanat,et al.  Random forest based classification of diseases in grapes from images captured in uncontrolled environments , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[2]  Mingyang Wu,et al.  Depthwise separable convolution architectures for plant disease classification , 2019, Comput. Electron. Agric..

[3]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Muammer Turkoglu,et al.  Multi-model LSTM-based convolutional neural networks for detection of apple diseases and pests , 2019, Journal of Ambient Intelligence and Humanized Computing.

[5]  Idrissa Sarr,et al.  Wireless Underground Sensor Networks Path Loss Model for Precision Agriculture (WUSN-PLM) , 2020, IEEE Sensors Journal.

[6]  F. J. Pierce,et al.  ASPECTS OF PRECISION AGRICULTURE , 1999 .

[7]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[8]  Yuzhen Lu,et al.  Non-Destructive Defect Detection of Apples by Spectroscopic and Imaging Technologies: A Review , 2017 .

[9]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Baoyu Ma,et al.  A Method for Improving CNN-Based Image Recognition Using DCGAN , 2018 .

[12]  Junying Han,et al.  A Novel Identification Method for Apple (Malus domestica Borkh.) Cultivars Based on a Deep Convolutional Neural Network with Leaf Image Input , 2020, Symmetry.

[13]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[14]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[15]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[16]  László Tóth Phone recognition with deep sparse rectifier neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Ashutosh Kumar Bhatt,et al.  Automatic apple grading model development based on back propagation neural network and machine vision, and its performance evaluation , 2015, AI & SOCIETY.

[18]  Kazushi Ikeda,et al.  ResNet and Batch-normalization Improve Data Separability , 2019, ACML.

[19]  Sakshi Arora,et al.  Particle Swarm Optimization Based Support Vector Machine (P-SVM) for the Segmentation and Classification of Plants , 2019, IEEE Access.

[20]  Yun Zhang,et al.  Identification of Apple Leaf Diseases Based on Deep Convolutional Neural Networks , 2017, Symmetry.

[21]  Young Im Cho,et al.  An Improvement for Medical Image Analysis Using Data Enhancement Techniques in Deep Learning , 2018, 2018 International Conference on Information and Communication Technology Robotics (ICT-ROBOT).

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[24]  Amel H Abbas,et al.  Maize Leaf Images Segmentation Using Color Threshold and K-means Clustering Methods to Identify the Percentage of the Affected Areas , 2020 .

[25]  Qammer H. Abbasi,et al.  Precision Techniques and Agriculture 4.0 Technologies to Promote Sustainability in the Coffee Sector: State of the Art, Challenges and Future Trends , 2020, IEEE Access.

[26]  Hongxun Yao,et al.  Shallow and Deep Model Investigation for Distinguishing Corn and Weeds , 2017, PCM.

[27]  Dongjian He,et al.  Identification of Apple Tree Leaf Diseases Based on Deep Learning Models , 2020, Symmetry.

[28]  Faliang Huang,et al.  Integrating Local CNN and Global CNN for Script Identification in Natural Scene Images , 2019, IEEE Access.

[29]  Dipayan Biswas,et al.  Transfer Learning Based Plant Diseases Detection Using ResNet50 , 2019, 2019 4th International Conference on Electrical Information and Communication Technology (EICT).

[30]  Díbio Leandro Borges,et al.  Cotton pests classification in field-based images using deep residual networks , 2020, Comput. Electron. Agric..

[31]  Giulio Reina,et al.  A Survey of Ranging and Imaging Techniques for Precision Agriculture Phenotyping , 2017, IEEE/ASME Transactions on Mechatronics.

[32]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[33]  Dongjian He,et al.  Deep Learning Approach for Apple Edge Detection to Remotely Monitor Apple Growth in Orchards , 2020, IEEE Access.

[34]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[35]  Hossein Pourghassem,et al.  Computer vision-based apple grading for golden delicious apples based on surface features , 2017 .

[36]  Raja Purushothaman,et al.  Tomato crop disease classification using pre-trained deep learning algorithm , 2018 .

[37]  Noah Snavely,et al.  The Plant Pathology 2020 challenge dataset to classify foliar disease of apples , 2020, ArXiv.

[38]  Quoc V. Le,et al.  Searching for Activation Functions , 2018, arXiv.

[39]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[40]  Daoliang Li,et al.  An improved KK-means clustering algorithm for fish image segmentation , 2013, Math. Comput. Model..