Shape determination of horticultural produce using two-dimensional computer vision – A review

Abstract Shape uniformity of fruits and vegetables is important whether they are to be fresh marketed or processed. To achieve the desired uniformity, fruits must be inspected and classified. Although manual sorting of agricultural products is potentially accurate, in practice it reveals subjective and inconsistent. Computer vision has become a proven, reliable tool for describing product shape. Depending on the product, misshapenness or malformation expresses as poor axial symmetry, excessive curvature of the fruit longitudinal axis, several types of protruding zones and abnormal concavities, lack of cross section circularity, etc. Here we review some two-dimensional computer vision methods applied throughout the past 25 years for determining the shape of horticultural produce. While a number of the works cited achieved high classification accuracy in two categories (well-formed, misshapen), only a few of the systems referred were able to classify in more than two classes, or have been tested online.

[1]  Hiroyoshi Iwata,et al.  Fruit shape variation in Fraxinus mandshurica var. japonica characterized using elliptic Fourier descriptors and the effect on flight duration , 2005, Ecological Research.

[2]  H. Blum Biological shape and visual science (part I) , 1973 .

[3]  Fernando A. Quintana,et al.  Nonparametric Bayesian data analysis , 2004 .

[4]  Zou Xiaobo,et al.  Apples Shape Grading by Fourier Expansion and Genetic Program Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[5]  Mary Lu Arpaia,et al.  Avocado Fruit Abnormalities and Defects Revisited , 2002 .

[6]  Da-Wen Sun,et al.  Recent developments in the applications of image processing techniques for food quality evaluation , 2004 .

[7]  Qin Zhang,et al.  Features Extraction for Eggplant Fruit Grading System Using Machine Vision , 2008 .

[8]  Kim ChangSik,et al.  Curvature angular descriptor (CAD) for anomalous shape recognition. , 2000 .

[9]  Herbert Freeman,et al.  Computer Processing of Line-Drawing Images , 1974, CSUR.

[10]  A. S. Fathinul-Syahir,et al.  Discrimination and classification of fresh-cut starfruits (Averrhoa carambola L.) using automated machine vision system , 2006 .

[11]  José Blasco,et al.  Original paper: Automatic sorting of satsuma ( Citrus unshiu ) segments using computer vision and morphological features , 2009 .

[12]  Wijitha Senadeera,et al.  Influence of shapes of selected vegetable materials on drying kinetics during fluidized bed drying , 2003 .

[13]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[14]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[15]  Sundaram Gunasekaran,et al.  Shape feature extraction and classification of food material using computer vision , 1994 .

[16]  C. T. Morrow,et al.  Comparison of a Neural Network and Traditional Classifier for Machine Vision Inspection of Potatoes , 1995 .

[17]  Blas J. BARLElTA,et al.  Fractal Analysis to Characterize Ruggedness Changes in Tapped Agglomerated Food Powders , 1993 .

[18]  S. Yokoyama,et al.  Three-dimensional shape measurement of strawberries by volume intersection method , 2006 .

[19]  Ali Jafari,et al.  Classification and analysis of fruit shapes in long type watermelon using image processing , 2007 .

[20]  Clifford J Studman,et al.  Computers and electronics in postharvest technology : a review , 2001 .

[21]  M. J. Delwiche,et al.  Machine vision methods for defect sorting stonefruit , 1994 .

[22]  Mohamed S. Kamel,et al.  Wavelet approximation-based affine invariant shape representation functions , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Peter A Mossey,et al.  Size and shape measurement in contemporary cephalometrics. , 2003, European journal of orthodontics.

[24]  C. T. Morrow,et al.  Grading of Mushrooms Using a Machine Vision System , 1994 .

[25]  Carlos H. Crisosto,et al.  Stone fruit maturity indices: a descriptive review , 1994 .

[26]  Hirohisa Nesumi,et al.  Quantitative evaluation of the three-dimensional fruit shape and size of Citrus species based on spherical harmonic descriptors , 2000, Euphytica.

[27]  C. T. Morrow,et al.  Fourier-based Separation Technique for Shape Grading of Potatoes Using Machine Vision , 1995 .

[28]  B. Mandelbrot,et al.  Fractals: Form, Chance and Dimension , 1978 .

[29]  A.J.M. Timmermans Innovative applications in the agro and food industry , 2006 .

[30]  E. Hines,et al.  Wavelet transform based image texture analysis for size estimation applied to the sorting of tea granules , 2007 .

[31]  Paul Scheunders,et al.  Wavelets for texture analysis, an overview , 1997 .

[32]  Itaru Sotome,et al.  3D SURFACE MODELING WITH STEREOVISION , 2005 .

[33]  Da-Wen Sun,et al.  CLASSIFICATION OF TENDERNESS OF LARGE COOKED BEEF JOINTS USING WAVELET AND GABOR TEXTURAL FEATURES , 2006 .

[34]  Stephen W. Searcy,et al.  Estimation of tip shape for carrot classification by machine vision , 1992 .

[35]  Xu Liming,et al.  Automated strawberry grading system based on image processing , 2010 .

[36]  Zhi-yuan Wen,et al.  Color and shape grading of citrus fruit based on machine vision with fractal dimension , 2010, 2010 3rd International Congress on Image and Signal Processing.

[37]  Naoshi Kondo,et al.  Automation on fruit and vegetable grading system and food traceability. , 2010 .

[38]  M. A. Easterbrook,et al.  Relationships between the occurrence of misshapen fruit on late‐season strawberry in the United Kingdom and infestation by insects, particularly the European tarnished plant bug, Lygus rugulipennis , 2000 .

[39]  Bernard Cuq,et al.  Morphological characterization of wheat powders, how to characterize the shape of particles? , 2011 .

[40]  F. Rohlf,et al.  A COMPARISON OF FOURIER METHODS FOR THE DESCRIPTION OF WING SHAPE IN MOSQUITOES (DIPTERA: CULICIDAE) , 1984 .

[41]  William M. Wells,et al.  An EM algorithm for shape classification based on level sets , 2005, Medical Image Anal..

[42]  Jiangsheng Gui,et al.  Fruit shape classification using Zernike moments , 2010, International Conference on Image Processing and Pattern Recognition in Industrial Engineering.

[43]  Seiji Matsuura,et al.  Evaluation of variation of root shape of Japanese radish (Raphanus sativus L.) based on image analysis using elliptic Fourier descriptors , 1998, Euphytica.

[44]  Naoshi Kondo,et al.  Classification of Shape of Bell Pepper by Machine Vision System , 2006 .

[45]  Theodosios Pavlidis,et al.  A review of algorithms for shape analysis , 1978 .

[46]  David G. Stork,et al.  Pattern Classification , 1973 .

[47]  Akio Matsuzaki,et al.  Two-dimensional image analysis of the shape of rice and its application to separating varieties , 1996 .

[48]  Federico Pallottino,et al.  Quantitative evaluation of Tarocco sweet orange fruit shape using optoelectronic elliptic Fourier based analysis , 2009 .

[49]  Qixin Cao,et al.  Study on sorting system for strawberry using machine vision (part 2): development of sorting system with direction and judgement functions for strawberry (Akihime variety). , 2000 .

[50]  Manjit K. Misra,et al.  Evaluations of fractal geometry and invariant moments for shape classification of corn germplasm , 1998 .

[51]  John R. Clark,et al.  Fruit Shape Analysis of Vitis Using Digital Photography , 2008 .

[52]  M. Swaminathan,et al.  Determining Orientation and Shape of Bell Peppers by Machine Vision , 1987 .

[53]  Charles R. Giardina,et al.  Elliptic Fourier features of a closed contour , 1982, Comput. Graph. Image Process..

[54]  Rouben Rostamian,et al.  Theoretical Analysis of Stability of Axially Symmetric Rotating Objects with Regard to Orienting Apples , 2008 .

[55]  G. F. J. Milford,et al.  The growth and development of the storage root of sugar beet , 1973 .

[56]  Hugo Magein,et al.  Vision artificielle et quantification de la forme de pommes , 1997 .

[57]  C.-C. Jay Kuo,et al.  Wavelet descriptor of planar curves: theory and applications , 1996, IEEE Trans. Image Process..

[58]  Eddie Schrevens,et al.  Use of Image Analysis to Investigate Human Quality Classification of Apples , 1997 .

[59]  Y. Hashimoto,et al.  Pattern recognition of fruit shape based on the concept of chaos and neural networks , 2000 .

[60]  F. J. García-Ramos,et al.  Non-destructive technologies for fruit and vegetable size determination - a review , 2009 .

[61]  A. K. Thompson,et al.  Postharvest Technology of Fruit and Vegetables , 1996 .

[62]  Mark D. Normand,et al.  Characterization of the Ruggedness of Instant Coffee Particle Shape by Natural Fractals , 1985 .

[63]  Jiangsheng Gui,et al.  A novel fruit shape classification method based on multi-scale analysis , 2005, SPIE Optics East.

[64]  Dengsheng Zhang,et al.  An Efficient and Robust Technique for Region Based Shape Representation and Retrieval , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[65]  Joshua D. Schwartz,et al.  Hierarchical Matching of Deformable Shapes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[66]  Filson H. Glanz,et al.  An Autoregressive Model Approach to Two-Dimensional Shape Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  José Miguel Aguilera,et al.  An application of image analysis to dehydration of apple discs , 2005 .

[69]  David G. Kendall,et al.  [Size and Shape Spaces for Landmark Data in Two Dimensions]: Comment , 1986 .

[70]  Wang Cong-qing,et al.  Fruit shape classification based on wavelet descriptor. , 2010 .

[71]  Ning Jiang,et al.  Morphological Variation of Tomato Fruit A Retrotransposon-Mediated Gene Duplication Underlies , 2014 .

[72]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[73]  C. T. Morrow,et al.  Machine Vision Inspection of ‘Golden Delicious’ Apples , 1995 .

[74]  K. Jesionkowska,et al.  Studies on the usefulness of Cucurbita maxima for the production of ready-to-eat dried vegetable snacks with a high carotenoid content , 2010 .

[75]  Jacco C. Noordam,et al.  High-speed potato grading and quality inspection based on a color vision system , 2000, Electronic Imaging.

[76]  R. R. Wolfe,et al.  Feature Extraction Techniques for Sorting Tomatoes by Computer Vision , 1985 .

[77]  Bundit Jarimopas,et al.  An experimental machine vision system for sorting sweet tamarind , 2008 .

[78]  Da-Wen Sun,et al.  Shape Analysis of Agricultural Products: A Review of Recent Research Advances and Potential Application to Computer Vision , 2011 .

[79]  Andrzej Lenart,et al.  The effect of blanching and freezing on osmotic dehydration of pumpkin , 2008 .

[80]  José Jorge Chanona-Pérez,et al.  Image Processing Methods and Fractal Analysis for Quantitative Evaluation of Size, Shape, Structure and Microstructure in Food Materials , 2008 .

[81]  Gustavo Camps-Valls,et al.  Automatic correction of the effects of the light source on spherical objects. An application to the analysis of hyperspectral images of citrus fruits , 2008 .

[82]  Sakamon Devahastin,et al.  Determination of deformation of a food product undergoing different drying methods and conditions via evolution of a shape factor , 2007 .

[83]  Jin Hu,et al.  Genetic analysis of fruit shape traits at different maturation stages in sponge gourd , 2007, Journal of Zhejiang University SCIENCE B.

[84]  Yoshiyasu Tamura,et al.  Protrusion Fourier Descriptor: Skeleton-based Representation of Open Curves , 2008 .

[85]  Gösta H. Granlund,et al.  Fourier Preprocessing for Hand Print Character Recognition , 1972, IEEE Transactions on Computers.

[86]  Digvir S. Jayas,et al.  Multi-layer neural networks for image analysis of agricultural products , 2000 .

[87]  Noureddine Chatti,et al.  Historical biogeography of olive domestication (Olea europaea L.) as revealed by geometrical morphometry applied to biological and archaeological material , 2004 .

[88]  Dinggang Shen,et al.  Discriminative wavelet shape descriptors for recognition of 2-D patterns , 1999, Pattern Recognit..

[89]  Da-Wen Sun,et al.  Shape extraction and classification of pizza base using computer vision , 2004 .

[90]  Amara Lynn Graps,et al.  An introduction to wavelets , 1995 .

[91]  Emmanuel Purlis,et al.  Three-dimensional reconstruction of irregular foodstuffs , 2007 .

[92]  N. E. Fanourakis,et al.  Correlated inheritance of fruit neck with fruit length and linkage relations with 10 other characteristics of cucumber , 2004, Euphytica.

[93]  Federico Pallottino,et al.  Shape-based methodology for multivariate discrimination among Italian hazelnut cultivars , 2008 .

[94]  D. Garrick,et al.  Quantitative evaluation of apple (Malus × domestica Borkh.) fruit shape by principal component analysis of Fourier descriptors , 2000, Euphytica.

[95]  Horst Bunke,et al.  Applications of approximate string matching to 2D shape recognition , 1993, Pattern Recognit..

[96]  Musa Mohd Mokji,et al.  Starfruit Shape Defect Estimation Based on Concave and Convex Area of a Closed Planar Curve , 2008 .

[97]  M. Knoche,et al.  Analysing fruit shape in sweet cherry (Prunus avium L.) , 2002 .

[98]  Jiangsheng Gui,et al.  Apple Shape Classification Using Level Set and Motion Estimation , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[99]  P. Allen,et al.  Comparison of various wavelet texture features to predict beef palatability. , 2009, Meat science.

[100]  J Considine,et al.  Physical Aspects of Fruit Growth : THEORETICAL ANALYSIS OF DISTRIBUTION OF SURFACE GROWTH FORCES IN FRUIT IN RELATION TO CRACKING AND SPLITTING. , 1981, Plant physiology.

[101]  Mark A. Ritenour,et al.  Growth conditions, crop load and fruit size affect sheepnosing in grapefruit , 2005 .

[102]  Alberto M. Sereno,et al.  Shrinkage, density, porosity and shape changes during dehydration of pumpkin (Cucurbita pepo L.) fruits , 2011 .

[103]  Kenneth C. Gehrt,et al.  Competitive Market Analysis of U.S. Apples in the Japanese Market , 2002 .

[104]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[105]  S. Riyadi,et al.  Wavelet-based feature extraction technique for fruit shape classification , 2008, 2008 5th International Symposium on Mechatronics and Its Applications.

[106]  Christophe Godin,et al.  Original paper: A novel profile based model for virtual representation of quasi-symmetric plant organs , 2011 .

[107]  Satoshi Yonekawa,et al.  Three-dimensional image analysis of the shape of soybean seed , 1992 .

[108]  Digvir S. Jayas,et al.  Wavelet Analysis of Signals in Agriculture and Food Quality Inspection , 2010 .

[109]  Moon S. Kim,et al.  Hyperspectral reflectance and fluorescence line-scan imaging for online defect and fecal contamination inspection of apples , 2007 .

[110]  F. Bookstein Size and Shape Spaces for Landmark Data in Two Dimensions , 1986 .

[111]  Steven H. Strogatz,et al.  Complex systems: Romanesque networks , 2005, Nature.

[112]  Karri Muinonen,et al.  Three-dimensional Stochastic Shape Modelling for Potato Tubers , 2006, Potato Research.

[113]  Yang Tao,et al.  DETECTING STEM AND SHAPE OF PEARS USING FOURIER TRANSFORMATION AND AN ARTIFICIAL NEURAL NETWORK , 2003 .

[114]  Emile Fiesler,et al.  Neural Network Topologies , 1996 .

[115]  N. Maslaris,et al.  Sugar beet root shape and its relation with yield and quality , 2010, Sugar Tech.

[116]  Haim Nerson,et al.  Relationship between Fruit Shape and Seed Yield in Cucurbita pepo , 2001 .