Implementation of Transfer Learning Using VGG16 on Fruit Ripeness Detection

In previous studies, researchers have determined the classification of fruit ripeness using the feature descriptor using color features (RGB, GSL, HSV, and L * a * b *). However, the performance from the experimental results obtained still yields results that are less than the maximum, viz the maximal accuracy is only 76%. Today, transfer learning techniques have been applied successfully in many real-world applications. For this reason, researchers propose transfer learning techniques using the VGG16 model. The proposed architecture uses VGG16 without the top layer. The top layer of the VGG16 replaced by adding a Multilayer Perceptron (MLP) block. The MLP block contains Flatten layer, a Dense layer, and Regularizes. The output of the MLP block uses the softmax activation function. There are three Regularizes that considered in the MLP block namely Dropout, Batch Normalization, and Regularizes kernels. The Regularizes selected are intended to reduce overfitting. The proposed architecture conducted on a fruit ripeness dataset that was created by researchers. Based on the experimental results found that the performance of the proposed architecture has better performance. Determination of the type of Regularizes is very influential on system performance. The best performance obtained on the MLP block that has Dropout 0.5 with increased accuracy reaching 18.42%. The Batch Normalization and the Regularizes kernels performance increased the accuracy amount of 10.52% and 2.63%, respectively. This study shows that the performance of deep learning using transfer learning always gets better performance than using machine learning with traditional feature extraction to determines fruit ripeness detection. This study gives also declaring that Dropout is the best technique to reduce overfitting in transfer learning.

[1]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[2]  Ashwini P. Patil,et al.  Deep Learning based Computer Vision: A Review , 2018 .

[3]  Anuja Bhargava,et al.  Fruits and vegetables quality evaluation using computer vision: A review , 2021, J. King Saud Univ. Comput. Inf. Sci..

[4]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[5]  Samy Bengio,et al.  A Study on Overfitting in Deep Reinforcement Learning , 2018, ArXiv.

[6]  Meenakshi Pawar,et al.  Transfer Learning for Image Classification , 2018, 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA).

[7]  Marie-Francine Moens,et al.  Transfer Learning for Named Entity Recognition in Financial and Biomedical Documents , 2019, Inf..

[8]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[9]  Zongxu Pan,et al.  Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data , 2017, Remote. Sens..

[10]  R. N. Shebiah,et al.  Fruit Recognition using Color and Texture Features , 2010 .

[11]  Fatma M. A. Mazen,et al.  Ripeness Classification of Bananas Using an Artificial Neural Network , 2019, Arabian Journal for Science and Engineering.

[12]  Aboul Ella Hassenian,et al.  Automatic Fruit Image Recognition System Based on Shape and Color Features , 2014, AMLTA.

[13]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[14]  G. Fitzgerald,et al.  'I. , 2019, Australian journal of primary health.

[15]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[16]  A. Manickavasagan,et al.  Comprehensive ripeness-index for prediction of ripening level in mangoes by multivariate modelling of ripening behaviour , 2017 .

[17]  Jordan J. Bird,et al.  A Study on CNN Transfer Learning for Image Classification , 2018, UKCI.

[18]  Dong Xu,et al.  Recent Advances in Transfer Learning for Cross-Dataset Visual Recognition , 2017, ACM Comput. Surv..

[19]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[20]  Xiuwen Liu,et al.  Overfitting Mechanism and Avoidance in Deep Neural Networks , 2019, ArXiv.

[21]  Mona Attariyan,et al.  Parameter-Efficient Transfer Learning for NLP , 2019, ICML.

[22]  Guangyu Sun,et al.  Reducing Overfitting in Deep Convolutional Neural Networks Using Redundancy Regularizer , 2017, ICANN.

[23]  Anand Singh Jalal,et al.  Fusing Color and Texture Cues to Categorize the Fruit Diseases from Images , 2014, ArXiv.

[24]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[25]  Improving the Performance of CBIR Using XGBoost Classifier with Deep CNN-Based Feature Extraction , 2019, 2019 International Conference on Data and Software Engineering (ICoDSE).

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  Xue Ying,et al.  An Overview of Overfitting and its Solutions , 2019, Journal of Physics: Conference Series.

[28]  Qianhua He,et al.  Automatic Fruit Recognition Based on DCNN for Commercial Source Trace System , 2018, International Journal on Computational Science & Applications.

[29]  Jasman Pardede,et al.  Fruit Ripeness Based on RGB, HSV, HSL, L*a*b* Color Feature Using SVM , 2019, 2019 International Conference of Computer Science and Information Technology (ICoSNIKOM).

[30]  Alexei A. Koulakov,et al.  Representations of Sound in Deep Learning of Audio Features from Music , 2017, ArXiv.

[31]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[32]  Takanori Fukao,et al.  An automated fruit harvesting robot by using deep learning , 2019, ROBOMECH Journal.

[33]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[34]  Franck Dernoncourt,et al.  Transfer Learning for Named-Entity Recognition with Neural Networks , 2017, LREC.

[35]  V. K. Banga,et al.  Color Image Segmentation for Fruit Ripeness Detection: A Review , 2012 .

[36]  Jasman Pardede,et al.  COMPARISON OF VSM, GVSM, AND LSI IN INFORMATION RETRIEVAL FOR INDONESIAN TEXT , 2016 .

[37]  Lukáš Danev Fruit and vegetable classification from live video , 2017 .

[38]  Bankim Patel,et al.  Machine Vision based Fruit Classification and Grading - A Review , 2017 .

[39]  Mihai Oltean,et al.  Fruit recognition from images using deep learning , 2017, Acta Universitatis Sapientiae, Informatica.

[40]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.