Maturity status classification of papaya fruits based on machine learning and transfer learning approach

Abstract Papaya (Carica papaya) is a tropical fruit having commercial importance because of its high nutritive and medicinal value. The packaging of papaya fruit as per its maturity status is an essential task in the fruit industry. The manual grading of papaya fruit based on human visual perception is time-consuming and destructive. The objective of this paper is to suggest a novel non-destructive maturity status classification of papaya fruits. The paper suggested two approaches based on machine learning and transfer learning for classification of papaya maturity status. Also, a comparative analysis is carried out with different methods of machine learning and transfer learning. The experimentation is carried out with 300 papaya fruit sample images which includes 100 of each three maturity stages. The machine learning approach includes three sets of features and three classifiers with their different kernel functions. The features and classifiers used in machine learning approaches are local binary pattern (LBP), histogram of oriented gradients (HOG), Gray Level Co-occurrence Matrix (GLCM) and k-nearest neighbour (KNN), support vector machine (SVM), Naive Bayes respectively. The transfer learning approach includes seven pre-trained models such as ResNet101, ResNet50, ResNet18, VGG19, VGG16, GoogleNet and AlexNet. The weighted KNN with HOG feature outperforms other machine learning-based classification model with 100% of accuracy and 0.0995 s training time. Again, among the transfer learning approach based classification model VGG19 performs better with 100% accuracy and 1 min 52 s training time with consideration of early stop training. The proposed classification method for maturity classification of papaya fruits, i.e. VGG19 based on transfer learning approach achieved 100% accuracy which is 6% more than the existing method.

[1]  Yudong Zhang,et al.  Fruit classification using computer vision and feedforward neural network , 2014 .

[2]  Sylvio Barbon Junior,et al.  Predicting the ripening of papaya fruit with digital imaging and random forests , 2018, Comput. Electron. Agric..

[3]  A. Hobani,et al.  Development of a Neural Network Classifier for Date Fruit Varieties Using Some Physical Attributes , 2003 .

[4]  Jochen Hemming,et al.  Fruit Detectability Analysis for Different Camera Positions in Sweet-Pepper † , 2014, Sensors.

[6]  M. A. Khan,et al.  Machine vision system: a tool for quality inspection of food and agricultural products , 2012, Journal of Food Science and Technology.

[7]  Reza Ehsani,et al.  Classification of oil palm fresh fruit bunches based on their maturity using portable four-band sensor system , 2012 .

[8]  Wiqas Ghai,et al.  Performance analysis of deep learning CNN models for disease detection in plants using image segmentation , 2020, Information Processing in Agriculture.

[9]  Jean-Louis Damez,et al.  Meat quality assessment using biophysical methods related to meat structure. , 2008, Meat science.

[10]  S. Mohamed Mansoor Roomi,et al.  Particle Swarm Optimized Fuzzy Model for the Classification of Banana Ripeness , 2017, IEEE Sensors Journal.

[11]  Yousef Al Ohali,et al.  Original Article: Computer vision based date fruit grading system: Design and implementation , 2011 .

[12]  J. Satheesh Kumar,et al.  Assessment of banana fruit maturity by image processing technique , 2015 .

[13]  Umezuruike Linus Opara,et al.  Analytical methods for determination of sugars and sweetness of horticultural products—A review , 2015 .

[14]  Monai Krairiksh,et al.  Rician k-Factors-Based Sensor for Fruit Classification by Maturity Stage , 2016, IEEE Sensors Journal.

[15]  Anand Singh Jalal,et al.  Application of Image Processing in Fruit and Vegetable Analysis: A Review , 2015, J. Intell. Syst..

[16]  Manoj Karkee,et al.  Apple fruit size estimation using a 3D machine vision system , 2018, Information Processing in Agriculture.

[17]  S. Varadarajan,et al.  Defect Fruit Image Analysis using Advanced Bacterial Foraging Optimizing Algorithm , 2013 .

[18]  Sunan Wang,et al.  The Recognition of Overlapping Apple Fruits Based on Boundary Curvature Estimation , 2015, 2015 Sixth International Conference on Intelligent Systems Design and Engineering Applications (ISDEA).

[19]  Seyed Hadi Mirisaee,et al.  A new method for fruits recognition system , 2009, 2009 International Conference on Electrical Engineering and Informatics.

[20]  Changhong Liu,et al.  Application of Multispectral Imaging to Determine Quality Attributes and Ripeness Stage in Strawberry Fruit , 2014, PloS one.

[21]  Mukesh Tripathi,et al.  A role of computer vision in fruits and vegetables among various horticulture products of agriculture fields: A survey , 2020 .

[22]  Basavaraj S. Anami,et al.  Grading of Bulk Food Grains and Fruits Using Computer Vision , 2015 .

[23]  Yudong Zhang,et al.  Classification of Fruits Using Computer Vision and a Multiclass Support Vector Machine , 2012, Sensors.

[24]  Bipan Tudu,et al.  A Machine Vision-Based Maturity Prediction System for Sorting of Harvested Mangoes , 2014, IEEE Transactions on Instrumentation and Measurement.

[25]  Yang Rui,et al.  Detecting sugarcane borer diseases using support vector machine , 2017 .

[26]  Jacques Wainer,et al.  Automatic fruit and vegetable classification from images , 2010 .

[27]  Daniel E. Guyer,et al.  Comparison of Artificial Neural Networks and Statistical Classifiers in Apple Sorting using Textural Features , 2004 .

[28]  Harpuneet Kaur,et al.  Evaluation of plum fruit maturity by image processing techniques , 2018, Journal of Food Science and Technology.

[29]  Qiufeng Wu,et al.  Automatic grape leaf diseases identification via UnitedModel based on multiple convolutional neural networks , 2020 .

[30]  Ms.Rupali S.Jadhav A Fruit Quality Management System Based On Image Processing , 2013 .

[31]  M. Omid,et al.  Estimating volume and mass of citrus fruits by image processing technique , 2010 .

[32]  Hong Cheng,et al.  Early Yield Prediction Using Image Analysis of Apple Fruit and Tree Canopy Features with Neural Networks , 2017, J. Imaging.