Automatic Detection and Grading of Multiple Fruits by Machine Learning

Classification of various types of fruits and identification of the grading of fruit is a burdensome challenge due to the mass production of fruit products. In order to distinguish and evaluate the quality of fruits more precisely, this paper presents a system that discriminates among four types of fruits and analyzes the rank of the fruit-based on its quality. Firstly, the algorithm extracts the red, green, and blue values of the images and then the background of images was detached by the split-and-merge algorithm. Next, the multiple features (30 features) namely color, statistical, textural, and geometrical features are extracted. To differentiate between the fruit type, only geometrical features (12 features), other features are used in the quality evaluation of fruit. Furthermore, four different classifiers k-nearest neighbor (k-NN), support vector machine (SVM), sparse representative classifier (SRC), and artificial neural network (ANN) are used to classify the quality. The classifier has been contemplated with four different databases of fruits: one having 4359 color images of apples; out of which 2342, are with various defects, second having 918 color images of avocado out of which 491 are of with various defects, third having 3805 color images of banana out of which 2224 are with various defects, and fourth having 3050 color images of oranges out of which 1590 are with various defects. The system performance has been validated using the k-fold cross-validation technique by considering different values of k. The maximum accuracy achieved for fruit detection is 80.00% (k-NN), 85.51% (SRC), 91.03% (ANN), and 98.48% (SVM) for k  = 10.The classification among Rank1, Rank2, and defected maximum accuracy is 77.24% (k-NN), 82.75% (SRC), 88.27% (ANN), and 95.72% (SVM) achieved by the system. SVM has seen to be more effective in quality evaluation and results obtained are encouraging and comparable with the state of art techniques.

[1]  Paul J. Scott,et al.  Algorithms for Morphological Profile Filters and their Comparison , 2012 .

[2]  Di Wu,et al.  Colour measurements by computer vision for food quality control – A review , 2013 .

[3]  Tomas Malmer Image segmentation using , 2010 .

[4]  Syed Khaleel Ahmed,et al.  Classification of fruits using Probabilistic Neural Networks - Improvement using color features , 2011, TENCON 2011 - 2011 IEEE Region 10 Conference.

[5]  Perry Xiao,et al.  In vivo skin capacitive imaging analysis by using grey level co-occurrence matrix (GLCM). , 2014, International journal of pharmaceutics.

[6]  Francisco Manzano-Agugliaro,et al.  High speed intelligent classifier of tomatoes by colour, size and weight , 2012 .

[7]  Bernard Gosselin,et al.  Original paper: Automatic grading of Bi-colored apples by multispectral machine vision , 2011 .

[8]  Xiao Chen,et al.  A parallel and robust object tracking approach synthesizing adaptive Bayesian learning and improved incremental subspace learning , 2019, Frontiers of Computer Science.

[9]  Muin J. Khoury,et al.  Application of support vector machine modeling for prediction of common diseases: the case of diabetes and pre-diabetes , 2010, BMC Medical Informatics Decis. Mak..

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  Xu Liming,et al.  Automated strawberry grading system based on image processing , 2010 .

[12]  Nagendra Pratap Singh,et al.  Machine Learning-Based Classification of Good and Rotten Apple , 2018, Lecture Notes in Electrical Engineering.

[13]  Varun Jaiswal,et al.  DRPPP: A machine learning based tool for prediction of disease resistance proteins in plants , 2016, Comput. Biol. Medicine.

[14]  Daniel E. Guyer,et al.  Evaluation of different pattern recognition techniques for apple sorting , 2008 .

[15]  Dieter Filbert,et al.  CLASSIFICATION OF POTENTIAL DEFECTS IN THE AUTOMATIC INSPECTION OF ALUMINIUM CASTINGS USING STATISTICAL PATTERN RECOGNITION , 2002 .

[16]  Anuja Bhargava,et al.  Fruits and vegetables quality evaluation using computer vision: A review , 2021, J. King Saud Univ. Comput. Inf. Sci..

[17]  D. Surya Prabha,et al.  Assessment of banana fruit maturity by image processing technique , 2015, Journal of Food Science and Technology.

[18]  Anand Singh Jalal,et al.  Apple disease classification using color, texture and shape features from images , 2016, Signal Image Video Process..

[19]  Da-Wen Sun,et al.  Principles and Applications of Hyperspectral Imaging in Quality Evaluation of Agro-Food Products: A Review , 2012, Critical reviews in food science and nutrition.

[20]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[21]  Bankim Patel,et al.  Thermal imaging with fuzzy classifier for maturity and size based non-destructive mango (Mangifera Indica L.) grading , 2017, 2017 International Conference on Emerging Trends & Innovation in ICT (ICEI).

[22]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  P. Deepa,et al.  A Comparative Analysis of Watershed and Color based segmentation for Fruit Grading 12 2 , 2012 .

[25]  Fazhi He,et al.  A correlative classifiers approach based on particle filter and sample set for tracking occluded target , 2017 .

[26]  Seyed Hadi Mirisaee,et al.  A new method for fruits recognition system , 2009, 2009 International Conference on Electrical Engineering and Informatics.

[27]  Vinay Kumar,et al.  Maturity and disease detection in tomato using computer vision , 2016, 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC).

[28]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[29]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Marsyita Hanafi,et al.  Comparative study of transform-based image texture analysis for the evaluation of banana quality using an optical backscattering system , 2018 .

[31]  Hossein Pourghassem,et al.  Computer vision-based apple grading for golden delicious apples based on surface features , 2017 .

[32]  José Blasco,et al.  In-line sorting of irregular potatoes by using automated computer-based machine vision system , 2012 .

[33]  Jyoti Jhawar Orange Sorting by Applying Pattern Recognition on Colour Image , 2016 .

[34]  Sindi Simelane,et al.  Mechanical Properties of Heat‐cured Whey Protein‐based Edible Films Compared with Collagen Casings under Sausage Manufacturing Conditions , 2005 .

[35]  P. Butz,et al.  Recent Developments in Noninvasive Techniques for Fresh Fruit and Vegetable Internal Quality Analysis , 2006 .

[36]  Sylvio Barbon Junior,et al.  Predicting the ripening of papaya fruit with digital imaging and random forests , 2018, Comput. Electron. Agric..

[37]  José Blasco,et al.  Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features , 2009 .

[38]  Dennis Jarvis,et al.  Estimation of mango crop yield using image analysis - Segmentation method , 2013 .

[39]  Xiuqin Rao,et al.  Computer vision detection of surface defect on oranges by means of a sliding comparison window local segmentation algorithm , 2017, Comput. Electron. Agric..

[40]  Nigel Collier,et al.  A framework for enhancing spatial and temporal granularity in report-based health surveillance systems , 2010, BMC Medical Informatics Decis. Mak..

[41]  Yiteng Pan,et al.  A novel Enhanced Collaborative Autoencoder with knowledge distillation for top-N recommender systems , 2019, Neurocomputing.

[42]  Dr. P. M. Mahajan,et al.  A Fruit Detecting and Grading System Based on Image Processing-Review , 2016 .

[43]  Fazhi He,et al.  Service-Oriented Feature-Based Data Exchange for Cloud-Based Design and Manufacturing , 2018, IEEE Transactions on Services Computing.

[44]  Malrey Lee,et al.  An yield estimation in citrus orchards via fruit detection and counting using image processing , 2017, Comput. Electron. Agric..

[45]  Vani Ashok,et al.  Automatic quality evaluation of fruits using Probabilistic Neural Network approach , 2014, 2014 International Conference on Contemporary Computing and Informatics (IC3I).

[46]  Navid Razmjooy,et al.  A real-time mathematical computer method for potato inspection using machine vision , 2012, Comput. Math. Appl..

[47]  José Blasco,et al.  Machine Vision System for Automatic Quality Grading of Fruit , 2003 .

[48]  David C. Slaughter,et al.  RTK GPS mapping of transplanted row crops , 2010 .

[49]  Khursheed Aurangzeb,et al.  An Optimized Method for Segmentation and Classification of Apple Diseases Based on Strong Correlation and Genetic Algorithm Based Feature Selection , 2019, IEEE Access.

[50]  Yuan Cheng,et al.  Integrating selective undo of feature-based modeling operations for real-time collaborative CAD systems , 2019, Future Gener. Comput. Syst..

[51]  Ankit Chaudhary,et al.  Fabric defect detection based on GLCM and Gabor filter: A comparison , 2013 .

[52]  Dameshwari Sahu,et al.  Defect Identification and Maturity Detection of Mango Fruits Using Image Analysis , 2017 .

[53]  Joan Serra,et al.  Image segmentation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[54]  Faisal R. Al-Osaimi,et al.  Illumination normalization of facial images by reversing the process of image formation , 2011, Machine Vision and Applications.

[55]  Chuanqi Zhang,et al.  Artificial neural network modeling of dissolved oxygen in the Heihe River, Northwestern China , 2013, Environmental Monitoring and Assessment.

[56]  Devrim Unaya,et al.  Automatic grading of Bicolored apples by multispectral machine vision , 2010 .

[57]  Li Liu,et al.  Texture feature extracting method based on local relative phase binary pattern , 2016, 2016 5th International Conference on Computer Science and Network Technology (ICCSNT).

[58]  Mohd Zubir MatJafri,et al.  Non-destructive quality evaluation of fruit by color based on RGB LEDs system , 2014, 2014 2nd International Conference on Electronic Design (ICED).

[59]  Mahmod Othman,et al.  Mango Grading By Using Fuzzy Image Analysis , 2012 .