Fruits and vegetables quality evaluation using computer vision: A review

Abstract In agriculture science, automation increases the quality, economic growth and productivity of the country. The export market and quality evaluation are affected by assorting of fruits and vegetables. The crucial sensory characteristic of fruits and vegetables is appearance that impacts their market value, the consumer’s preference and choice. Although, the sorting and grading can be done by human but it is inconsistent, time consuming, variable, subjective, onerous, expensive and easily influenced by surrounding. Hence, an astute fruit grading system is needed. In recent years, various algorithms for sorting and grading are done by various researchers using computer vision. This paper presents a detailed overview of various methods i.e. preprocessing, segmentation, feature extraction, classification which addressed fruits and vegetables quality based on color, texture, size, shape and defects. In this paper, a critical comparison of different algorithm proposed by researchers for quality inspection of fruits and vegetables has been carried out.

[1]  XU Zheng-gang.  Non-Destructive Maturity Evaluation of Citrus by Hue Frequency Sequence Method , 2006 .

[2]  G. Downey,et al.  Hyperspectral imaging combined with principal component analysis for bruise damage detection on white mushrooms (Agaricus bisporus) , 2008 .

[3]  D. Surya Prabha,et al.  Assessment of banana fruit maturity by image processing technique , 2015, Journal of Food Science and Technology.

[4]  G. Camps-Valls,et al.  Hyperspectral system for early detection of rottenness caused by Penicillium digitatum in mandarins , 2008 .

[5]  Jayamala K. Patil,et al.  Advances in Image Processing for Detection of Plant Disease , 2017 .

[6]  R. N. Shebiah,et al.  Fruit Recognition using Color and Texture Features , 2010 .

[7]  David C. Slaughter,et al.  RTK GPS mapping of transplanted row crops , 2010 .

[8]  José Blasco,et al.  Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features , 2009 .

[9]  Vani Ashok,et al.  Automatic quality evaluation of fruits using Probabilistic Neural Network approach , 2014, 2014 International Conference on Contemporary Computing and Informatics (IC3I).

[10]  Nuria Aleixos,et al.  Erratum to: Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[11]  A. P. Singh,et al.  Intelligent Estimator for Assessing Apple Fruit Quality , 2012 .

[12]  Sylvio Barbon Junior,et al.  Predicting the ripening of papaya fruit with digital imaging and random forests , 2018, Comput. Electron. Agric..

[13]  Moon S. Kim,et al.  Correlation analysis of hyperspectral imagery for multispectral wavelength selection for detection of defects on apples , 2008 .

[14]  Josse De Baerdemaeker,et al.  Combination of chemometric tools and image processing for bruise detection on apples , 2007 .

[15]  Malrey Lee,et al.  An yield estimation in citrus orchards via fruit detection and counting using image processing , 2017, Comput. Electron. Agric..

[16]  José Blasco,et al.  Computer vision detection of peel defects in citrus by means of a region oriented segmentation algorithm , 2007 .

[17]  Panitnat Yimyam,et al.  Agricultural produce grading by computer vision using Genetic Programming , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[18]  Mahmoud Omid,et al.  Development of a lemon sorting system based on color and size. , 2010 .

[19]  Roelof K. Brouwer,et al.  Modified fuzzy c-means for ordinal valued attributes with particle swarm for optimization , 2010, Fuzzy Sets Syst..

[20]  D. E. Chan,et al.  Development of Hyperspectral Imaging Technique for the Detection of Chilling Injury in Cucumbers; Spectral and Image Analysis , 2006 .

[21]  Jianwei Qin,et al.  DETECTION OF PITS IN TART CHERRIES BY HYPERSPECTRAL TRANSMISSION IMAGING , 2005 .

[22]  Jiewen Zhao,et al.  Detection of Bruise on Pear by Hyperspectral Imaging Sensor with Different Classification Algorithms , 2010 .

[23]  Bankim Patel,et al.  Machine Vision based Fruit Classification and Grading - A Review , 2017 .

[24]  Mavanur R. Suresh,et al.  Texture Features and Decision Trees based Vegetables Classification , 2012 .

[25]  Dameshwari Sahu,et al.  Defect Identification and Maturity Detection of Mango Fruits Using Image Analysis , 2017 .

[26]  Murali Krishnan,et al.  Pest Control in Agricultural Plantations Using Image Processing , 2013 .

[27]  Petr Dejmek,et al.  Calibrated color measurements of agricultural foods using image analysis , 2006 .

[28]  Baohua Zhang,et al.  A comparative study for the quantitative determination of soluble solids content, pH and firmness of pears by Vis/NIR spectroscopy , 2013 .

[29]  Anand Singh Jalal,et al.  Application of Image Processing in Fruit and Vegetable Analysis: A Review , 2015, J. Intell. Syst..

[30]  Naoshi Kondo,et al.  Extraction methods of color and shape features for tomato grading , 2006 .

[31]  K. Vijayarekha.  Multivariate image analysis for defect identification of apple fruit images , 2008, 2008 34th Annual Conference of IEEE Industrial Electronics.

[32]  Ranjan Parekh,et al.  Automatic fruit recognition from natural images using color and texture features , 2017, 2017 Devices for Integrated Circuit (DevIC).

[33]  Z. Effendi,et al.  Pattern recognition system of Jatropha curcas fruits using back propagation , 2009, 2009 IEEE International Conference on Signal and Image Processing Applications.

[34]  Dennis Jarvis,et al.  Estimation of mango crop yield using image analysis - Segmentation method , 2013 .

[35]  Bernard Gosselin,et al.  Artificial neural network-based segmentation and apple grading by machine vision , 2005, IEEE International Conference on Image Processing 2005.

[36]  Bankim Patel,et al.  Thermal imaging with fuzzy classifier for maturity and size based non-destructive mango (Mangifera Indica L.) grading , 2017, 2017 International Conference on Emerging Trends & Innovation in ICT (ICEI).

[37]  Tristan Perez,et al.  DeepFruits: A Fruit Detection System Using Deep Neural Networks , 2016, Sensors.

[38]  Shivleela R Arlimatti.  Window Based Method for Automatic Classification of Apple Fruit Shivleela R Arlimatti , 2012 .

[39]  Menghan Hu,et al.  The Potential of Double K‐Means Clustering for Banana Image Segmentation , 2014 .

[40]  Arun S. Mujumdar,et al.  Influence of green banana flour substitution for cassava starch on the nutrition, color, texture and sensory quality in two types of snacks , 2012 .

[41]  Dhanashree Jawale,et al.  Real time automatic bruise detection in (Apple) fruits using thermal camera , 2017, 2017 International Conference on Communication and Signal Processing (ICCSP).

[42]  Jiangbo Li,et al.  Automatic detection of common surface defects on oranges using combined lighting transform and image ratio methods , 2013 .

[43]  Byung Ryong Lee,et al.  An image segmentation approach for fruit defect detection using k-means clustering and graph-based algorithm , 2015, Vietnam Journal of Computer Science.

[44]  P. Deepa,et al.  A Comparative Analysis of Watershed and Color based segmentation for Fruit Grading 12 2 , 2012 .

[45]  F. Mendoza,et al.  Determination of senescent spotting in banana (Musa cavendish) using fractal texture Fourier image , 2008 .

[46]  Mohammad Gholami,et al.  DETERMINATION OF KIWIFRUIT VOLUME USING IMAGE PROCESSING , 2007 .

[47]  Rajesh Yakkundimath,et al.  Grading and Classification of Anthracnose Fungal Disease of Fruits based on Statistical Texture Features , 2013 .

[48]  Qin Zhang,et al.  Features Extraction for Eggplant Fruit Grading System Using Machine Vision , 2008 .

[49]  James Archibald,et al.  Development of a machine vision system for automatic date grading using digital reflective near-infrared imaging , 2008 .

[50]  Piotr Boniecki,et al.  Application of neural image analysis in evaluating the quality of greenhouse tomatoes , 2017 .

[51]  Juliana Sanches,et al.  Image processing techniques for lemons and tomatoes classification , 2008 .

[52]  Junzo Kamata,et al.  Eggplant Grading System Including Rotary Tray Assisted Machine Vision Whole Fruit Inspection , 2007 .

[53]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[54]  Sumio Kawano,et al.  Automatic image analysis and spot classification for detection of fruit fly infestation in hyperspectral images of mangoes , 2013 .

[55]  Colm P. O'Donnell,et al.  Identification of mushrooms subjected to freeze damage using hyperspectral imaging. , 2009 .

[56]  Mohammed A. H. Ali,et al.  Automated fruit grading system , 2017, 2017 IEEE 3rd International Symposium in Robotics and Manufacturing Automation (ROMA).

[57]  Paul J. Williams,et al.  Classification of white maize defects with multispectral imaging. , 2018, Food chemistry.

[58]  J. Gómez-Sanchís,et al.  Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[59]  Umezuruike Linus Opara,et al.  Non-destructive prediction of internal and external quality attributes of fruit with thick rind: A review , 2018 .

[60]  Basavaraj S. Anami,et al.  Mean and Range Color Features Based Identification of Common Indian Leafy Vegetables , 2012 .

[61]  Ning Wang,et al.  Early detection of apple bruises on different background colors using hyperspectral imaging , 2008 .

[62]  Yudong Zhang,et al.  Fruit classification by biogeography‐based optimization and feedforward neural network , 2016, Expert Syst. J. Knowl. Eng..

[63]  Yudong Zhang,et al.  Classification of Fruits Using Computer Vision and a Multiclass Support Vector Machine , 2012, Sensors.

[64]  José Blasco,et al.  Machine Vision System for Automatic Quality Grading of Fruit , 2003 .

[65]  A. S. Jalal,et al.  Detection and Classification of Apple Fruit Diseases Using Complete Local Binary Patterns , 2012, 2012 Third International Conference on Computer and Communication Technology.

[66]  Bipan Tudu,et al.  A Machine Vision Technique for Grading of Harvested Mangoes Based on Maturity and Quality , 2016, IEEE Sensors Journal.

[67]  Anand Singh Jalal,et al.  Fruit disease recognition using improved sum and difference histogram from images , 2014, Int. J. Appl. Pattern Recognit..

[68]  Bernard Gosselin,et al.  Original paper: Automatic grading of Bi-colored apples by multispectral machine vision , 2011 .

[69]  Xiao Yu,et al.  Green apple recognition method based on the combination of texture and shape features , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[70]  J. Pujari,et al.  Reduced Color and Texture features based Identification and Classification of Affected and Normal fruits ’ images , 2013 .

[71]  Ning Wang,et al.  Detecting chilling injury in Red Delicious apple using hyperspectral imaging and neural networks , 2009 .

[72]  Vladimir B. Pavlović,et al.  Digital parameterization of apple fruit size, shape and surface spottiness , 2011 .

[73]  Mahmod Othman,et al.  Mango Grading By Using Fuzzy Image Analysis , 2012 .

[74]  D. Savakar,et al.  Identification and Classification of Bulk Fruits Images using Artificial Neural Networks , 2012 .

[75]  Moon S. Kim,et al.  Hyperspectral reflectance and fluorescence line-scan imaging for online defect and fecal contamination inspection of apples , 2007 .

[76]  Zou Xiaobo,et al.  In-line detection of apple defects using three color cameras system , 2010 .

[77]  Moon S. Kim,et al.  Multispectral fluorescence lifetime imaging of feces-contaminated apples by time-resolved laser-induced fluorescence imaging system with tunable excitation wavelengths. , 2008, Applied optics.

[78]  Cheng-Liang Liu,et al.  [Detection of slight bruises on apples based on hyperspectral imaging and MNF transform]. , 2014, Guang pu xue yu guang pu fen xi = Guang pu.

[79]  Suchitra A. Khoje,et al.  Automated Skin Defect Identification System for Fruit Grading Based on Discrete Curvelet Transform , 2013 .

[80]  Xiaoyan Chen,et al.  Prediction of apple internal qualities using hyperspectral imaging techniques , 2017, 2017 International Conference on Advanced Mechatronic Systems (ICAMechS).

[81]  Xiuqin Rao,et al.  Computer vision detection of surface defect on oranges by means of a sliding comparison window local segmentation algorithm , 2017, Comput. Electron. Agric..

[82]  Elmer P. Dadios,et al.  Application of fuzzy logic in recognition of tomato fruit maturity in smart farming , 2016, 2016 IEEE Region 10 Conference (TENCON).

[83]  Yasmeen M. George,et al.  Automated cell nuclei segmentation for breast fine needle aspiration cytology , 2013, Signal Process..

[84]  Yang Tao,et al.  Gabor feature-based apple quality inspection using kernel principal component analysis , 2007 .

[85]  Maria Lodovica Gullino,et al.  Selection and evaluation of new antagonists for their efficacy against postharvest brown rot of peaches , 2010 .

[86]  Anand Singh Jalal,et al.  Apple disease classification using color, texture and shape features from images , 2016, Signal Image Video Process..

[87]  Anderson Rocha,et al.  Automatic Classifier Fusion for Produce Recognition , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[88]  Punit Kumar Johari,et al.  A Comparative Study on Feature Extraction using Texture and Shape for Content Based Image Retrieval , 2015 .

[89]  Hossein Pourghassem,et al.  Computer vision-based apple grading for golden delicious apples based on surface features , 2017 .

[90]  Suchitra Khoje,et al.  Performance Comparison of Fourier Transform and Its Derivatives as Shape Descriptors for Mango Grading , 2012 .

[91]  Xuhui Zhao,et al.  Development of a two-band spectral imaging system for real-time citrus canker detection , 2012 .

[92]  S. M. Mazloumzadeh,et al.  Using adaptive neuro-fuzzy inference system for classify date fruits , 2013 .

[93]  S. Riyadi,et al.  Shape Characteristics Analysis for Papaya Size Classification , 2007, 2007 5th Student Conference on Research and Development.

[94]  Pankaj B. Pathare,et al.  Colour Measurement and Analysis in Fresh and Processed Foods: A Review , 2012, Food and Bioprocess Technology.

[95]  Jyoti Jhawar.  Orange Sorting by Applying Pattern Recognition on Colour Image , 2016 .

[96]  Mitsuji Monta,et al.  Application of NIR-color CCD camera to Eggplant Grading Machine , 2005 .

[97]  Baohua Zhang,et al.  Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review , 2014 .

[98]  P. Baranowski,et al.  Detection of early bruises in apples using hyperspectral data and thermal imaging , 2012 .

[99]  José Manuel Amigo,et al.  Grading and color evolution of apples using RGB and hyperspectral imaging vision cameras , 2012 .

[100]  José Blasco,et al.  Detecting rottenness caused by Penicillium genus fungi in citrus fruits using machine learning techniques , 2012, Expert Syst. Appl..

[101]  Colm P. O'Donnell,et al.  The potential of visible-near infrared hyperspectral imaging to discriminate between casing soil, enzymatic browning and undamaged tissue on mushroom (Agaricus bisporus) surfaces , 2011 .

[102]  Jagadeesh D. Pujari,et al.  Recognition and classification of Produce affected by identically looking Powdery Mildew disease , 2014 .

[103]  Mohd Zubir MatJafri,et al.  Non-destructive quality evaluation of fruit by color based on RGB LEDs system , 2014, 2014 2nd International Conference on Electronic Design (ICED).

[104]  Xiuqin Rao,et al.  Detection of common defects on oranges using hyperspectral reflectance imaging , 2011 .

[105]  Mahmoud Omid,et al.  Determination of Tangerine Volume Using Image Processing Methods , 2010 .

[106]  Hosein Navid,et al.  Potato Sorting Based on Size and Color in Machine Vision System , 2012 .

[107]  Jacques Wainer,et al.  Automatic fruit and vegetable classification from images , 2010 .

[108]  Xuhui Zhao,et al.  Digital Microscopic Imaging for Citrus Peel Disease Classification Using Color Texture Features , 2009 .

[109]  Ryutaro Tateishi,et al.  Particular agricultural land cover classification case study of Tsagaannuur, Mongolia , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[110]  Nursuriati Jamil,et al.  A rule-based segmentation method for fruit images under natural illumination , 2014, 2014 International Conference on Computer, Control, Informatics and Its Applications (IC3INA).

[111]  W. S. Lee,et al.  Identification of citrus disease using color texture features and discriminant analysis , 2006 .

[112]  Navid Razmjooy,et al.  A real-time mathematical computer method for potato inspection using machine vision , 2012, Comput. Math. Appl..

[113]  José Blasco,et al.  In-line sorting of irregular potatoes by using automated computer-based machine vision system , 2012 .

[114]  Shintaroh Ohashi,et al.  Detection of external insect infestations in jujube fruit using hyperspectral reflectance imaging , 2011 .

[115]  Yudong Zhang,et al.  Fruit classification using computer vision and feedforward neural network , 2014 .

[116]  Meftah Salem M. Alfatni,et al.  Oil palm fruit bunch grading system using red, green and blue digital number. , 2008 .

[117]  Megha P. Arakeri,et al.  Computer Vision Based Fruit Grading System for Quality Evaluation of Tomato in Agriculture industry , 2016 .

[118]  Yousef Al-Ohali,et al.  Computer vision based date fruit grading system: Design and implementation , 2011, J. King Saud Univ. Comput. Inf. Sci..

[119]  Amy Tabb,et al.  Identifying Apple Surface Defects Using Principal Components Analysis and Artificial Neural Networks , 2007 .

[120]  Virendra Tewari,et al.  Estimation of plant nitrogen content using digital image processing , 2013 .

[121]  Naoshi Kondo,et al.  Automation on fruit and vegetable grading system and food traceability. , 2010 .

[122]  Ali Jafari,et al.  Classification and analysis of fruit shapes in long type watermelon using image processing , 2007 .

[123]  Li Liu,et al.  Texture feature extracting method based on local relative phase binary pattern , 2016, 2016 5th International Conference on Computer Science and Network Technology (ICCSNT).

[124]  Jasper G. Tallada,et al.  Bruise Detection using NIR Hyperspectral Imaging for Strawberry (Fragaria * ananassa Duch.) , 2006 .

[125]  F. Albert,et al.  In-Line Estimation of the Standard Colour Index of Citrus Fruits Using a Computer Vision System Developed For a Mobile Platform , 2013, Food and Bioprocess Technology.

[126]  Ping Zhang,et al.  Study on fruit quality measurement and evaluation based on color identification , 2009, International Conference on Optical Instruments and Technology.

[127]  Moon S. Kim,et al.  Development of hyperspectral imaging technique for the detection of chilling injury in cucumbers , 2004, SPIE Optics East.

[128]  N. Alavi,et al.  Date grading using rule-based fuzzy inference system , 2012 .

[129]  Daniel E. Guyer,et al.  Near-infrared hyperspectral reflectance imaging for detection of bruises on pickling cucumbers , 2006, Computers and Electronics in Agriculture.

[130]  S. Sankaran,et al.  Potato Tuber Length-Width Ratio Assessment Using Image Analysis , 2017, American Journal of Potato Research.

[131]  Xu Liming,et al.  Automated strawberry grading system based on image processing , 2010 .

[132]  A. S. Fathinul-Syahir,et al.  Discrimination and classification of fresh-cut starfruits (Averrhoa carambola L.) using automated machine vision system , 2006 .

[133]  Grzegorz Cielniak,et al.  Visual detection of blemishes in potatoes using minimalist boosted classifiers , 2010 .

[134]  Yudong Zhang,et al.  Fruit Classification by Wavelet-Entropy and Feedforward Neural Network Trained by Fitness-Scaled Chaotic ABC and Biogeography-Based Optimization , 2015, Entropy.

[135]  J. Blasco,et al.  Recent Advances and Applications of Hyperspectral Imaging for Fruit and Vegetable Quality Assessment , 2012, Food and Bioprocess Technology.

[136]  Mark,et al.  Apples Grading based on SVM Classifier , 2020 .

[137]  Federico Pallottino,et al.  Quantitative evaluation of Tarocco sweet orange fruit shape using optoelectronic elliptic Fourier based analysis , 2009 .

[138]  Monika Jhuria,et al.  Image processing for smart farming: Detection of disease and fruit grading , 2013, 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013).

[139]  Naoshi Kondo,et al.  Robotization in fruit grading system , 2009 .

[140]  Jorge Chanona-Pérez,et al.  Evaluation of the ripening stages of apple (Golden Delicious) by means of computer vision system , 2017 .

[141]  Andrew R. East,et al.  Colour vision system evaluation of bicolour fruit: A case study with ‘B74’ mango , 2008 .

[142]  Md.Towhid Chowdhury.  Vegetables detection from the glossary shop for the blind. , 2013 .

[143]  Suwanee Boonmung,et al.  Physical Properties Analysis of Mango using Computer Vision , 2005 .

[144]  Bernard Gosselin,et al.  Automatic defect segmentation of ‘Jonagold’ apples on multi-spectral images: A comparative study , 2006 .

[145]  Vinay Kumar,et al.  Maturity and disease detection in tomato using computer vision , 2016, 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC).

[146]  A. A. Masoumi,et al.  Digital image processing for quality ranking of saffron peach , 2010 .

[147]  Syed Khaleel Ahmed,et al.  Classification of fruits using Probabilistic Neural Networks - Improvement using color features , 2011, TENCON 2011 - 2011 IEEE Region 10 Conference.

[148]  Bim Prasad Shrestha,et al.  Integrating multispectral reflectance and fluorescence imaging for defect detection on apples , 2006 .

[149]  H. P. W. Jayasuriya,et al.  Development of a low cost machine vision system for sorting of tomatoes , 2013 .

[150]  Zou Xiaobo,et al.  Apple color grading based on organization feature parameters , 2007 .

[151]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[152]  D. L. Peterson,et al.  Identifying defects in images of rotating apples , 2005 .

[153]  Renfu Lu,et al.  Detection of fruit fly infestation in pickling cucumbers using a hyperspectral reflectance/transmittance imaging system , 2013 .

[154]  D. Bulanon,et al.  Classification of grapefruit peel diseases using color texture feature analysis , 2009 .

[155]  A. Gopal,et al.  Classification of color objects like fruits using probability density function (PDF) , 2012, 2012 International Conference on Machine Vision and Image Processing (MVIP).

[156]  Mousa Shamsi,et al.  Segmentation of Apple Color Images Utilizing Fuzzy Clustering Algorithms , 2012 .

[157]  Bart Nicolai,et al.  Non-destructive measurement of bitter pit in apple fruit using NIR hyperspectral imaging , 2006 .

[158]  Giovanni Attolico,et al.  Non-destructive automatic quality evaluation of fresh-cut iceberg lettuce through packaging material , 2018 .

[159]  José Blasco,et al.  Development of a machine for the automatic sorting of pomegranate (Punica granatum) arils based on computer vision , 2009 .

[160]  Josse De Baerdemaeker,et al.  Detecting Bruises on ‘Golden Delicious’ Apples using Hyperspectral Imaging with Multiple Wavebands , 2005 .

[161]  Chi Zhang,et al.  Apple stem-end/calyx identification using a speckle-array encoding pattern , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[162]  Gustavo Camps-Valls,et al.  Automatic correction of the effects of the light source on spherical objects. An application to the analysis of hyperspectral images of citrus fruits , 2008 .