Performance Analysis of Deep Learning CNN Models for Variety Classification in Hazelnut

In evaluating agricultural products, knowing the specific product varieties is important for the producer, the industrialist, and the consumer. Human labor is widely used in the classification of varieties. It is generally performed by visual examination of each sample by experts, which is very laborious and time-consuming with poor sensitivity. There is a need in commercial hazelnut production for a rapid, non-destructive and reliable variety classification in order to obtain quality nuts from the orchard to the consumer. In this study, a convolutional neural network, which is one of the deep learning methods, was preferred due to its success in computer vision. A total of 17 widely grown hazelnut varieties were classified. The proposed model was evaluated by comparing with pre-trained models. Accuracy, precision, recall, and F1-Score evaluation metrics were used to determine the performance of classifiers. It was found that the proposed model showed a better performance than pre-trained models in terms of performance evaluation criteria. The proposed model was found to produce 98.63% accuracy in the test set, including 510 images. This result has shown that the proposed model can be used practically in the classification of hazelnut varieties.

[1]  Sergio Benini,et al.  Deep Learning Meets Hyperspectral Image Analysis: A Multidisciplinary Review , 2019, J. Imaging.

[2]  Yi Chen,et al.  Fruit category classification via an eight-layer convolutional neural network with parametric rectified linear unit and dropout technique , 2018, Multimedia Tools and Applications.

[3]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[4]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[5]  Yang Li,et al.  ANN-Based Continual Classification in Agriculture , 2020, Agriculture.

[6]  Tristan Perez,et al.  DeepFruits: A Fruit Detection System Using Deep Neural Networks , 2016, Sensors.

[7]  Ali Amer Alwan,et al.  A Convolution Neural Network-Based Seed Classification System , 2020, Symmetry.

[8]  Sidan Du,et al.  Image based fruit category classification by 13-layer deep convolutional neural network and data augmentation , 2019, Multimedia Tools and Applications.

[9]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Valerio Cristofori,et al.  Nut and kernel traits and chemical composition of hazelnut (Corylus avellana L.) cultivars , 2008 .

[12]  R. Pourdarbani,et al.  Automatic Classification of Chickpea Varieties Using Computer Vision Techniques , 2019, Agronomy.

[13]  Arthur L. Samuel,et al.  Some studies in machine learning using the game of checkers , 2000, IBM J. Res. Dev..

[14]  Chen Li,et al.  High performance vegetable classification from images based on AlexNet deep learning model , 2018 .

[15]  Yuzhen Lu,et al.  Food Image Recognition by Using Convolutional Neural Networks (CNNs) , 2016, ArXiv.

[16]  Rui Li,et al.  Multi-level learning features for automatic classification of field crop pests , 2018, Comput. Electron. Agric..

[17]  Use of Nuclear and Mitochondrial Single Nucleotide Polymorphisms to Characterize English Walnut (Juglans regia L.) Genotypes , 2013, Plant Molecular Biology Reporter.

[18]  M. Abdipour,et al.  Artificial neural networks and multiple linear regression as potential methods for modeling seed yield of safflower (Carthamus tinctorius L.) , 2019, Industrial Crops and Products.

[19]  Chu Zhang,et al.  Variety Identification of Single Rice Seed Using Hyperspectral Imaging Combined with Convolutional Neural Network , 2018 .

[20]  Mihai Oltean Fruits 360 dataset , 2018 .

[21]  Mauro Castelli,et al.  Musculoskeletal Images Classification for Detection of Fractures Using Transfer Learning , 2020, J. Imaging.

[22]  Katarzyna,et al.  A Vision-Based Method Utilizing Deep Convolutional Neural Networks for Fruit Variety Classification in Uncertainty Conditions of Retail Sales , 2019, Applied Sciences.

[23]  Xin He,et al.  On line detection of defective apples using computer vision system combined with deep learning methods , 2020 .

[24]  Bayram Cetisli,et al.  Classification of processed hazelnuts with computer vision , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[25]  Keng Siau,et al.  Artificial Intelligence, Machine Learning, Automation, Robotics, Future of Work and Future of Humanity: A Review and Research Agenda , 2019, J. Database Manag..

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  Ben Coppin,et al.  Artificial Intelligence Illuminated , 2004 .

[28]  Shanjun Mao,et al.  A deep learning framework for hyperspectral image classification using spatial pyramid pooling , 2016 .

[29]  S. Solak,et al.  Detection and classification of hazelnut fruit by using image processing techniques and clustering methods , 2018 .

[30]  Shadman Sakib,et al.  Implementation of Fruits Recognition Classifier using Convolutional Neural Network Algorithm for Observation of Accuracies for Various Hidden Layers , 2019, ArXiv.

[31]  Stephan Hussmann,et al.  Real-time classification of weeds in organic carrot production using deep learning algorithms , 2019, Comput. Electron. Agric..

[32]  Alessandro Ulrici,et al.  Development of an automated method for the identification of defective hazelnuts based on RGB image analysis and colourgrams , 2018, Food Control.

[33]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[34]  Marco Mora,et al.  A Review of Convolutional Neural Network Applied to Fruit Image Processing , 2020, Applied Sciences.

[35]  Mostafa Mehdipour-Ghazi,et al.  Plant identification using deep neural networks via optimization of transfer learning parameters , 2017, Neurocomputing.

[36]  Andrzej Przybylak,et al.  Quality Evaluation of Potato Tubers Using Neural Image Analysis Method , 2020, Agriculture.

[37]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  D. Chicco,et al.  The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation , 2020, BMC Genomics.

[39]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Xinjie Yu,et al.  Nondestructive Freshness Discriminating of Shrimp Using Visible/Near-Infrared Hyperspectral Imaging Technique and Deep Learning Algorithm , 2018, Food Analytical Methods.

[41]  Federico Pallottino,et al.  Shape-based methodology for multivariate discrimination among Italian hazelnut cultivars , 2008 .

[42]  N. Bassil,et al.  Characterization of European hazelnut (Corylus avellana) cultivars using SSR markers , 2009, Genetic Resources and Crop Evolution.

[43]  Raymond Y. K. Lau,et al.  Hyperspectral Image Classification With Deep Learning Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Sildomar T. Monteiro,et al.  Machine learning based hyperspectral image analysis: A survey , 2018, ArXiv.

[45]  Zhihai Lu,et al.  Fruit Classification Based on Six Layer Convolutional Neural Network , 2018, 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP).

[46]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[47]  Caner Koç,et al.  Classification of hazelnut cultivars: comparison of DL4J and ensemble learning algorithms , 2020 .

[48]  Ram Pal Singh,et al.  Application of Extreme Learning Machine Method for Time Series Analysis , 2007 .

[49]  Guoxiang Zeng,et al.  Fruit and vegetables classification system using image saliency and convolutional neural network , 2017, 2017 IEEE 3rd Information Technology and Mechatronics Engineering Conference (ITOEC).

[50]  Elena Marchiori,et al.  Convolutional neural networks for vibrational spectroscopic data analysis. , 2017, Analytica chimica acta.

[51]  K. Walsh,et al.  Deep Learning for Mango (Mangifera indica) Panicle Stage Classification , 2020 .

[52]  Mihai Oltean,et al.  Fruit recognition from images using deep learning , 2017, Acta Universitatis Sapientiae, Informatica.

[53]  Zhuowen Tu,et al.  Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Tree , 2015, AISTATS.

[54]  Yibin Ying,et al.  DeepSpectra: An end-to-end deep learning approach for quantitative spectral analysis. , 2019, Analytica chimica acta.