Recent developments and applications of image features for food quality evaluation and inspection – a review

This paper reviews the techniques available for image feature extraction and their applications in the food industry up to now according to the four major kinds of image features, i.e., colour, size, shape, and texture. Results from previous studies have shown that each kind of image features contained important information required for food quality evaluation and inspection. Furthermore, the proper combination of different kinds of image features can normally increase the accuracy of the evaluation results; sometimes such a combination might even reveal some quality attributes that cannot be identified by using only a single kind of image features. Further to this, the feature extraction techniques were compared with each other, and their advantages, disadvantages, and feasibilities in different applications were also discussed.

[1]  Kit L. Yam,et al.  A simple digital imaging method for measuring and analyzing color of food surfaces , 2004 .

[2]  James N. Ianelli,et al.  Estimating the size selectivity and catching efficiency of a survey bottom trawl for thornyheads, Sebastolobus spp. using a towed video camera sled , 2004 .

[3]  Da-Wen Sun,et al.  CLASSIFICATION OF TENDERNESS OF LARGE COOKED BEEF JOINTS USING WAVELET AND GABOR TEXTURAL FEATURES , 2006 .

[4]  Vincent Leemans,et al.  Defects segmentation on 'Golden Delicious' apples by using colour machine vision , 1998 .

[5]  Tom C. Pearson.  Machine Vision System for Automated Detection of Stained Pistachio Nuts , 1996 .

[6]  X. Gao,et al.  SEM IMAGE PROCESSING FOR FOOD STRUCTURE ANALYSIS , 1997 .

[7]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[8]  Mauro Barni,et al.  Colour-based detection of defects on chicken meat , 1997, Image Vis. Comput..

[9]  Donald G. Mercer,et al.  Determination of acceptability and shelf life of ready-to-use lettuce by digital image analysis , 2004 .

[10]  D. V. Byrne,et al.  Evaluation of pork colour: prediction of visual sensory quality of meat from instrumental and computer vision methods of colour analysis. , 2003, Meat science.

[11]  Kazuhiko Shiranita,et al.  Determination of meat quality by texture analysis , 1998, Pattern Recognit. Lett..

[12]  H. Schwarcz,et al.  MEASUREMENT OF PARTICLE SHAPE BY FOURIER ANALYSIS , 1969 .

[13]  H. Ni,et al.  Image processing algorithm for cheese shred evaluation , 2004 .

[14]  J. M. Bunn,et al.  Tomato Maturity Evaluation Using Color Image Analysis , 1995 .

[15]  Anjan Sarkar,et al.  An identification approach for 2-D autoregressive models in describing textures , 1991, CVGIP Graph. Model. Image Process..

[16]  I. Paulus,et al.  Shape Characterization of New Apple Cultivars by Fourier Expansion of Digitized Images , 1999 .

[17]  Michael J. Delwiche,et al.  A Color Vision System for Peach Grading , 1988 .

[18]  E. R. Davies,et al.  The use of convolution operators for detecting contaminants in food images , 1996, Pattern Recognit..

[19]  Chaoxin Zheng,et al.  Correlating colour to moisture content of large cooked beef joints by computer vision , 2006 .

[20]  B. Nicolai,et al.  Use of laser‐scattering imaging to study tomato‐fruit quality in relation to acoustic and compression measurements , 2000 .

[21]  J. Tan,et al.  Beef Marbling and Color Score Determination by Image Processing , 1996 .

[22]  Cristina L. M. Silva,et al.  Quantification of microstructural changes during first stage air drying of grape tissue , 2004 .

[23]  J. Tan,et al.  Classification of tough and tender beef by image texture analysis. , 2001, Meat science.

[24]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[25]  D. Garrick,et al.  Quantitative evaluation of apple (Malus × domestica Borkh.) fruit shape by principal component analysis of Fourier descriptors , 2000, Euphytica.

[26]  X. Gao,et al.  Analysis of expanded-food texture by image processing : Part II : Mechanical properties , 1996 .

[27]  Da-Wen Sun,et al.  Shape extraction and classification of pizza base using computer vision , 2004 .

[28]  Cheng-Jin Du,et al.  CORRELATING SHRINKAGE WITH YIELD, WATER CONTENT AND TEXTURE OF PORK HAM BY COMPUTER VISION , 2005 .

[29]  Vincent Leemans,et al.  A real-time grading method of apples based on features extracted from defects , 2004 .

[30]  L.M.M. Tijskens,et al.  Effects of storage temperature and fruit ripening on firmness of fresh cut tomatoes , 2005 .

[31]  M. Z. Abdullah,et al.  Stepwise Discriminant Analysis for Colour Grading of Oil Palm Using Machine Vision System , 2001 .

[32]  Y. J. Han,et al.  Frequency Domain Image Analysis for Detecting Stress Cracks in Corn Kernels , 1996 .

[33]  Vincent Leemans,et al.  Selection of the most efficient wavelength bands for ‘Jonagold’ apple sorting , 2003 .

[34]  Dwight D. Day,et al.  Fourier-Based Texture Measures with Application to the Analysis of the Cell Structure of Baked Products , 1996, Digit. Signal Process..

[35]  Marvin R Paulsen,et al.  Real-Time Detection of Colour and Surface Defects of Maize Kernels Using Machine Vision , 1994 .

[36]  J. Tan,et al.  Determination of animal skeletal maturity by image processing. , 2003, Meat science.

[37]  William G. Wee,et al.  Neighboring gray level dependence matrix for texture classification , 1982, Comput. Graph. Image Process..

[38]  Akio Matsuzaki,et al.  Two-dimensional image analysis of the shape of rice and its application to separating varieties , 1996 .

[39]  Digvir S. Jayas,et al.  CLASSIFICATION OF CEREAL GRAINS USING MACHINE VISION: III. TEXTURE MODELS , 2000 .

[40]  Cheng-Jin Du,et al.  Comparison of three methods for classification of pizza topping using different colour space transformations , 2005 .

[41]  Royann J. Petrell,et al.  Accuracy of a machine-vision pellet detection system , 2003 .

[42]  J Ophir,et al.  The use of elastography to measure quality characteristics of pork semimembranosus muscle. , 1999, Meat science.

[43]  Bosoon Park,et al.  Co-occurrence matrix texture features of multi-spectral images on poultry carcasses , 2001 .

[44]  Fabienne Guillon,et al.  Mechanical breakdown and cell wall structure of mealy tomato pericarp tissue , 2005 .

[45]  A. D. Whittaker,et al.  Fat Estimation in Beef Ultrasound Images Using Texture and Adaptive Logic Networks , 1994 .

[46]  Graeme D. Coles,et al.  Estimating potato crisp colour variability using image analysis and a quick visual method , 1993, Potato Research.

[47]  R. B. Dodd,et al.  Nondestructive detection of split-pit peaches. , 1992 .

[48]  J. Blasco,et al.  Comparison of three algorithms in the classification of table olives by means of computer vision , 2004 .

[49]  Cheng-Jin Du,et al.  Estimating the surface area and volume of ellipsoidal ham using computer vision , 2006 .

[50]  Kurt C. Lawrence,et al.  Discriminant analysis of dual-wavelength spectral images for classifying poultry carcasses , 2002 .

[51]  S. Shouche,et al.  Shape analysis of grains of Indian wheat varieties , 2001 .

[52]  M. Destain,et al.  Development of a multi-spectral vision system for the detection of defects on apples , 2005 .

[53]  Gerhard Jahns,et al.  Measuring image analysis attributes and modelling fuzzy consumer aspects for tomato quality grading , 2001 .

[54]  D. Mery,et al.  Segmentation of colour food images using a robust algorithm , 2005 .

[55]  Boaz Zion,et al.  Sorting fish by computer vision , 1999 .

[56]  Samir Majumdar,et al.  Classification of cereal grains using machine vision , 1997 .

[57]  J. Lu,et al.  Evaluation of pork color by using computer vision. , 2000, Meat science.

[58]  Da-Wen Sun,et al.  Recent applications of image texture for evaluation of food qualities—a review , 2006 .

[59]  N. S. Visen,et al.  Cereal Grain and Dockage Identification using Machine Vision , 2003 .

[60]  Da-Wen Sun,et al.  Evaluation of the functional properties of Cheddar Cheese using a computer vision method , 2001 .

[61]  Jean-Marie Bonny,et al.  Ex‐vivo magnetic resonance image texture analysis can discriminate genotypic origin in bovine meat , 2005 .

[62]  R. R. Wolfe,et al.  Feature Extraction Techniques for Sorting Tomatoes by Computer Vision , 1985 .

[63]  Gerrit Polder,et al.  Accurate Measurement of Size and Shape of Cucumber Fruits with Image Analysis , 1998 .

[64]  Benno Kunz,et al.  Modeling the respiration of Pseudomonas fluorescens on solid-state lettuce-juice agar , 2006 .

[65]  J. Macgregor,et al.  Image texture analysis: methods and comparisons , 2004 .

[66]  Rangasami L. Kashyap,et al.  Characterization and estimation of two-dimensional ARMA models , 1984, IEEE Trans. Inf. Theory.

[67]  A. Davenel,et al.  Determination of the lean meat percentage of pig carcasses using magnetic resonance imaging. , 2005, Meat science.

[68]  M. Knoche,et al.  Analysing fruit shape in sweet cherry (Prunus avium L.) , 2002 .

[69]  Christoph Palm,et al.  Color texture classification by integrative Co-occurrence matrices , 2004, Pattern Recognit..

[70]  Jinglu Tan,et al.  Evaluating expanded-food sensory properties by image analysis , 1999 .

[71]  Da-Wen Sun,et al.  Pizza quality evaluation using computer vision: Part 2. Pizza topping analysis , 2003 .

[72]  S. Limsiroratana,et al.  On image analysis for harvesting tropical fruits , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[73]  John Furst,et al.  Microstructural changes of starch in cooked wheat grains as affected by cooking temperatures and times , 2006 .

[74]  Søren G. H. Erbou,et al.  Salt distribution in dry-cured ham measured by computed tomography and image analysis. , 2005, Meat science.

[75]  Fred A. Payne,et al.  COLOR AND DEFECT SORTING OF BELL PEPPERS USING MACHINE VISION , 1990 .

[76]  A. Ghazanfari,et al.  Classification of Pistachio Nuts Using a String Matching Technique , 1996 .

[77]  Da-Wen Sun,et al.  Pizza sauce spread classification using colour vision and support vector machines , 2005 .

[78]  Noel D.G. White,et al.  Comparison of a Neural Network and a Non-parametric Classifier for Grain Kernel Identification , 2003 .

[79]  J. Tan,et al.  ANALYSIS of EXPANDED-FOOD TEXTURE BY IMAGE PROCESSING PART I: GEOMETRIC PROPERTIES , 1996 .

[80]  Philippe Loisel,et al.  Quality traits of brown trouts (Salmo trutta) cutlets described by automated color image analysis , 2004 .

[81]  Da-Wen Sun,et al.  Recent developments in the applications of image processing techniques for food quality evaluation , 2004 .

[82]  T. C. Pearson,et al.  Machine Vision Detection of Early Split Pistachio Nuts , 1996 .

[83]  Anette Kistrup Thybo,et al.  Prediction of sensory texture quality attributes of cooked potatoes by NMR-imaging (MRI) of raw potatoes in combination with different image analysis methods , 2004 .

[84]  D. L. Peterson,et al.  Identifying defects in images of rotating apples , 2005 .

[85]  Rae-Hong Park,et al.  Texture periodicity detection: features, properties, and comparisons , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[86]  Robert King,et al.  Textural features corresponding to textural properties , 1989, IEEE Trans. Syst. Man Cybern..

[87]  Da-Wen Sun,et al.  Pizza quality evaluation using computer vision: Part 1. Pizza base and sauce spread , 2003 .

[88]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[89]  Filiberto Pla,et al.  A thinning-based algorithm to characterize fruit stems from profile images , 1995 .

[90]  H. Heymann,et al.  Image texture features as indicators of beef tenderness. , 1999, Meat science.

[91]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[92]  Meegalla R. Chandraratne,et al.  Prediction of lamb tenderness using image surface texture features , 2006 .

[93]  Haruhiko Murase,et al.  Machine vision based quality evaluation of Iyokan orange fruit using neural networks , 2000 .

[94]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[95]  Chaoxin Zheng,et al.  Estimating shrinkage of large cooked beef joints during air-blast cooling by computer vision , 2006 .

[96]  Alejandro G. Marangoni,et al.  Monitoring and quantifying of oil migration in cocoa butter using a flatbed scanner and fluorescence light microscopy , 2005 .

[97]  Pierre Loonis,et al.  A novel colorimetry analysis used to compare different drying fish processes , 2004 .

[98]  Chaoxin Zheng,et al.  Predicting shrinkage of ellipsoid beef joints as affected by water immersion cooking using image analysis and neural network , 2007 .

[99]  Manjit K. Misra,et al.  Evaluations of fractal geometry and invariant moments for shape classification of corn germplasm , 1998 .

[100]  Noel D.G. White,et al.  Identification of wheat kernels damaged by the red flour beetle using X-ray images , 2004 .

[101]  José Miguel Aguilera,et al.  An application of image analysis to dehydration of apple discs , 2005 .

[102]  Achim Kohler,et al.  Sensory qualities of whole wheat pan bread : influence of farming system, milling and baking technique , 2004 .

[103]  David L. MacAdam,et al.  Sources of Color Science , 1972 .

[104]  Pablo García Rodríguez,et al.  Analyzing magnetic resonance images of Iberian pork loin to predict its sensorial characteristics , 2005, Comput. Vis. Image Underst..

[105]  Olivier Basset,et al.  Application of texture image analysis for the classification of bovine meat , 2000 .

[106]  A. D. Whittaker,et al.  WAVELET TEXTURAL FEATURES FROM ULTRASONIC ELASTOGRAMS FOR MEAT QUALITY , 1997 .

[107]  José Miguel Aguilera,et al.  Image analysis of changes in surface color of chocolate , 2005 .

[108]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[109]  Milan Hájek,et al.  MRI ‘texture’ analysis of MR images of apples during ripening and storage , 2003 .

[110]  F. Teuscher,et al.  Application of computer image analysis to measure pork marbling characteristics. , 2005, Meat science.

[111]  Thomas Young,et al.  II. The Bakerian Lecture. On the theory of light and colours , 1802, Philosophical Transactions of the Royal Society of London.

[112]  Niklas Lorén,et al.  Measuring shapes for application in complex food structures , 2006 .

[113]  Stephen J. Symons,et al.  Developments in the use of image analysis for the assessment of oriental noodle appearance and colour , 2004 .

[114]  M. Z. Abdullah,et al.  Automated inspection system for colour and shape grading of starfruit (Averrhoa carambola L.) using machine vision sensor , 2005 .

[115]  J. Tan,et al.  Analysis of image-based measurements and USDA characteristics as predictors of beef lean yield. , 2004, Meat science.

[116]  José Blasco,et al.  On-line Fusion of Colour Camera and Spectrophotometer for Sugar Content Prediction of Apples , 1999 .

[117]  M. J. Delwiche,et al.  Machine vision methods for defect sorting stonefruit , 1994 .

[118]  José Miguel Aguilera,et al.  Description of food surfaces and microstructural changes using fractal image texture analysis , 2002 .

[119]  Jinglu Tan,et al.  Meat quality evaluation by computer vision , 2004 .

[120]  Boaz Zion,et al.  In-vivo fish sorting by computer vision , 2000 .

[121]  Suwanee Boonmung,et al.  Physical Properties Analysis of Mango using Computer Vision , 2005 .

[122]  Iwona Konopka,et al.  Lipids and carotenoids of wheat grain and flour and attempt of correlating them with digital image analysis of kernel surface and cross-sections , 2004 .

[123]  Da-Wen Sun,et al.  Melting characteristics of cheese: analysis of effect of cheese dimensions using computer vision techniques , 2002 .

[124]  G. Dalen.  Determination of the size distribution and percentage of broken kernels of rice using flatbed scanning and image analysis , 2004 .

[125]  Daniel E. Guyer,et al.  APPLE SORTING USING ARTIFICIAL NEURAL NETWORKS AND SPECTRAL IMAGING , 2002 .