Applications of Computer Vision for Assessing Quality of Agri-food Products: A Review of Recent Research Advances

With consumer concerns increasing over food quality and safety, the food industry has begun to pay much more attention to the development of rapid and reliable food-evaluation systems over the years. As a result, there is a great need for manufacturers and retailers to operate effective real-time assessments for food quality and safety during food production and processing. Computer vision, comprising a nondestructive assessment approach, has the aptitude to estimate the characteristics of food products with its advantages of fast speed, ease of use, and minimal sample preparation. Specifically, computer vision systems are feasible for classifying food products into specific grades, detecting defects, and estimating properties such as color, shape, size, surface defects, and contamination. Therefore, in order to track the latest research developments of this technology in the agri-food industry, this review aims to present the fundamentals and instrumentation of computer vision systems with details of applications in quality assessment of agri-food products from 2007 to 2013 and also discuss its future trends in combination with spectroscopy.

[1]  Carmen Rosselló,et al.  Ultrasonic determination of the composition of a meat-based product , 2003 .

[2]  Da-Wen Sun,et al.  Desorption isotherms for cooked and cured beef and pork , 2002 .

[3]  Bernard Gosselin,et al.  Original paper: Automatic grading of Bi-colored apples by multispectral machine vision , 2011 .

[4]  P. Allen,et al.  Identification of important image features for pork and turkey ham classification using colour and wavelet texture features and genetic selection. , 2010, Meat science.

[5]  Moon S. Kim,et al.  Hyperspectral reflectance and fluorescence line-scan imaging for online defect and fecal contamination inspection of apples , 2007 .

[6]  W. R. Windham,et al.  Contaminant classification of poultry hyperspectral imagery using a spectral angle mapper algorithm , 2007 .

[7]  Renfu Lu,et al.  Hyperspectral laser-induced fluorescence imaging for assessing apple fruit quality , 2007 .

[8]  P. Allen,et al.  Comparison of various wavelet texture features to predict beef palatability. , 2009, Meat science.

[9]  Sundaram Gunasekaran,et al.  Computer vision technology for food quality assurance , 1996 .

[10]  Fernando López-García,et al.  Automatic detection of skin defects in citrus fruits using a multivariate image analysis approach , 2010 .

[11]  Klaus Gottschalk,et al.  An Approach for Monitoring the Moisture Content Changes of Drying Banana Slices with Laser Light Backscattering Imaging , 2008 .

[12]  P. Allen,et al.  The use of lacunarity for visual texture characterization of pre-sliced cooked pork ham surface intensities , 2010 .

[13]  Cheng-Jin Du,et al.  Prediction of beef eating quality from colour, marbling and wavelet texture features. , 2008, Meat science.

[14]  Renfu Lu,et al.  Detection of Internal Defect in Pickling Cucumbers Using Hyperspectral Transmittance Imaging , 2008 .

[15]  J. L. Woods,et al.  SIMULATION OF THE HEAT AND MOISTURE TRANSFER PROCESS DURING DRYING IN DEEP GRAIN BEDS , 1997 .

[16]  Andrew R. East,et al.  Colour vision system evaluation of bicolour fruit: A case study with ‘B74’ mango , 2008 .

[17]  Yousef Al Ohali,et al.  Original Article: Computer vision based date fruit grading system: Design and implementation , 2011 .

[18]  D. Jayas,et al.  Identification of wheat classes using wavelet features from near infrared hyperspectral images of bulk samples. , 2009 .

[19]  Manabendra Bhuyan,et al.  Non-destructive testing of tea fermentation using image processing , 2003 .

[20]  José Blasco,et al.  Computer vision detection of peel defects in citrus by means of a region oriented segmentation algorithm , 2007 .

[21]  郭峰,et al.  NIR Hyperspectral Imaging Measurement of Sugar Content in Peach Using PLS Regression , 2007 .

[22]  Da-Wen Sun,et al.  CFD simulation of heat and moisture transfer for predicting cooling rate and weight loss of cooked ham during air-blast chilling process , 2000 .

[23]  T. L. Williams,et al.  Applications of Thermal Imaging , 1988 .

[24]  Fernando Mendoza,et al.  Characterization of fat-connective tissue size distribution in pre-sliced pork hams using multifractal analysis. , 2009, Meat science.

[25]  Da-Wen Sun,et al.  Correlation between Cheese Meltability Determined with a Computer Vision Method and with Arnott and Schreiber Tests , 2002 .

[26]  Da-Wen Sun,et al.  Computer vision technology for food quality evaluation , 2008 .

[27]  D. Jayas,et al.  Applications of Thermal Imaging in Agriculture and Food Industry—A Review , 2011 .

[28]  Da-Wen Sun,et al.  Selection of EMC/ERH Isotherm Equations for Rapeseed , 1998 .

[29]  Roger Ruan,et al.  Assessment of color development due to twin-screw extrusion of rice-glucose-lysine blend using image analysis , 2007 .

[30]  R. Lu,et al.  Prediction of Apple Internal Quality Using Spectral Absorption and Scattering Properties , 2009 .

[31]  Irwin R. Donis-González,et al.  Assessment of chestnut (Castanea spp.) slice quality using color images , 2013 .

[32]  Mahmoud Omid,et al.  Color image segmentation with genetic algorithm in a raisin sorting system based on machine vision in variable conditions , 2011, Expert Syst. Appl..

[33]  Ning Xu,et al.  Determination of Branched-Amino Acid Content in Fermented Cordyceps sinensis Mycelium by Using FT-NIR Spectroscopy Technique , 2013, Food and Bioprocess Technology.

[34]  Da-Wen Sun,et al.  Comparison and selection of EMC/ERH isotherm equations for rice , 1999 .

[35]  F. Mendoza,et al.  Application of Image Analysis for Classification of Ripening Bananas , 2006 .

[36]  Mario Perez,et al.  Structural and physical modifications of corn biscuits during baking process , 2011 .

[37]  Da-Wen Sun,et al.  Inspecting pizza topping percentage and distribution by a computer vision method , 2000 .

[38]  D. Lorente,et al.  Development of a Hyperspectral Computer Vision System Based on Two Liquid Crystal Tuneable Filters for Fruit Inspection. Application to Detect Citrus Fruits Decay , 2014, Food and Bioprocess Technology.

[39]  Sing Kiong Nguang,et al.  Low cost sensor for volume and surface area computation of axi-symmetric agricultural products , 2007 .

[40]  Da-Wen Sun,et al.  Colour calibration of a laboratory computer vision system for quality evaluation of pre-sliced hams. , 2009, Meat science.

[41]  Zayde Alçiçek,et al.  Development and application of “The Two Image” method for accurate object recognition and color analysis , 2012 .

[42]  C. Schebor,et al.  Water content effect on the chromatic attributes of dehydrated strawberries during storage, as evaluated by image analysis , 2013 .

[43]  Fabio Napolitano,et al.  Measurement of meat color using a computer vision system. , 2013, Meat science.

[44]  J. L. Woods,et al.  The Moisture Content/Relative Humidity Equilibrium Relationship Of Wheat - A Review , 1993 .

[45]  Piotr Zapotoczny,et al.  Computer vision algorithm for barley kernel identification, orientation estimation and surface structure assessment , 2012 .

[46]  Ferruh Erdogdu,et al.  Potential use of 3-dimensional scanners for food process modeling , 2009 .

[47]  Cheng-Jin Du,et al.  Comparison of three methods for classification of pizza topping using different colour space transformations , 2005 .

[48]  .. Nashata,et al.  upport vector machine approach to real-time inspection of iscuits on moving conveyor belt , 2010 .

[49]  Da-Wen Sun,et al.  Inspection of the distribution and amount of ingredients in pasteurized cheese by computer vision , 2007 .

[50]  Mirosław Słowiński,et al.  Lightness of the color measured by computer image analysis as a factor for assessing the quality of pork meat. , 2011, Meat science.

[51]  Da-Wen Sun,et al.  Prediction of beef eating qualities from colour, marbling and wavelet surface texture features using homogenous carcass treatment , 2009, Pattern Recognit..

[52]  P. Allen,et al.  Prediction of beef palatability from colour, marbling and surface texture features of longissimus dorsi , 2010 .

[53]  José Blasco,et al.  In-line sorting of irregular potatoes by using automated computer-based machine vision system , 2012 .

[54]  Søren G. H. Erbou,et al.  Salt distribution in dry-cured ham measured by computed tomography and image analysis. , 2005, Meat science.

[55]  Fernando Mendoza,et al.  Supervised neural network classification of pre-sliced cooked pork ham images using quaternionic singular values. , 2010, Meat science.

[56]  Zou Xiaobo,et al.  In-line detection of apple defects using three color cameras system , 2010 .

[57]  Da-Wen Sun,et al.  Preservation of kiwifruit coated with an edible film at ambient temperature , 2001 .

[58]  Deepak Bhatnagar,et al.  Fluorescence Excitation–Emission Features of Aflatoxin and Related Secondary Metabolites and Their Application for Rapid Detection of Mycotoxins , 2014, Food and Bioprocess Technology.

[59]  Patrick Jackman,et al.  Correlation of consumer assessment of longissimus dorsi beef palatability with image colour, marbling and surface texture features. , 2010, Meat science.

[60]  E. Hines,et al.  Wavelet transform based image texture analysis for size estimation applied to the sorting of tea granules , 2007 .

[61]  Emmanuel Purlis,et al.  Bread browning kinetics during baking , 2007 .

[62]  Hong Zheng,et al.  A least-squares support vector machine (LS-SVM) based on fractal analysis and CIELab parameters for the detection of browning degree on mango (Mangifera indica L.) , 2012 .

[63]  Patrick Jackman,et al.  Comparison of the predictive power of beef surface wavelet texture features at high and low magnification. , 2009, Meat science.

[64]  Gamal ElMasry,et al.  Near-infrared hyperspectral imaging for predicting colour, pH and tenderness of fresh beef , 2012 .

[65]  Bundit Jarimopas,et al.  An experimental machine vision system for sorting sweet tamarind , 2008 .

[66]  Gamal ElMasry,et al.  Prediction of some quality attributes of lamb meat using near-infrared hyperspectral imaging and multivariate analysis. , 2012, Analytica chimica acta.

[67]  C. Igathinathane,et al.  Major orthogonal dimensions measurement of food grains by machine vision using ImageJ , 2009 .

[68]  Fernanda Peyronel,et al.  In Situ Ultrasonic Characterization of Cocoa Butter Using a Chirp , 2014, Food and Bioprocess Technology.

[69]  Ning Wang,et al.  Detecting chilling injury in Red Delicious apple using hyperspectral imaging and neural networks , 2009 .

[70]  Yankun Peng,et al.  A machine vision system for identification of micro-crack in egg shell , 2012 .

[71]  O. Paquet-Durand,et al.  Monitoring baking processes of bread rolls by digital image analysis , 2012 .

[72]  José Blasco,et al.  Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features , 2009 .

[73]  Da-Wen Sun,et al.  Emerging non-contact imaging, spectroscopic and colorimetric technologies for quality evaluation and control of hams: a review , 2010 .

[74]  Da-Wen Sun,et al.  Shape Analysis of Agricultural Products: A Review of Recent Research Advances and Potential Application to Computer Vision , 2011 .

[75]  M Wicke,et al.  Non-destructive estimation of the intramuscular fat content of the longissimus muscle of pigs by means of spectral analysis of ultrasound echo signals. , 2005, Meat science.

[76]  Ya Hu,et al.  Bruise detection on red bayberry (Myrica rubra Sieb. & Zucc.) using fractal analysis and support vector machine , 2011 .

[77]  Noel D.G. White,et al.  Feasibility of near-infrared hyperspectral imaging to differentiate Canadian wheat classes , 2008 .

[78]  Giorgia Foca,et al.  Automated identification and visualization of food defects using RGB imaging: Application to the detection of red skin defect of raw hams , 2012 .

[79]  Hans Steinhart,et al.  Recent developments in instrumental analysis for food quality , 2007 .

[80]  Gregory A. Baxes,et al.  Digital image processing - principles and applications , 1994 .

[81]  Jorge Chanona-Pérez,et al.  Computer Vision System Applied to Classification of “Manila” Mangoes During Ripening Process , 2014, Food and Bioprocess Technology.

[82]  Lourdes Lleó,et al.  A multispectral vision system to evaluate enzymatic browning in fresh-cut apple slices , 2011 .

[83]  Da-Wen Sun,et al.  Multi-classification of pizza using computer vision and support vector machine , 2008 .

[84]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[85]  Da-Wen Sun,et al.  Recent advances in the use of computer vision technology in the quality assessment of fresh meats , 2011 .

[86]  Gamal ElMasry,et al.  High-speed assessment of fat and water content distribution in fish fillets using online imaging spectroscopy. , 2008, Journal of agricultural and food chemistry.

[87]  Nuria Aleixos,et al.  Erratum to: Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[88]  Meegalla R. Chandraratne,et al.  Classification of lamb carcass using machine vision: Comparison of statistical and neural network analyses , 2007 .

[89]  Franco Pedreschi,et al.  Description of the kinetic enzymatic browning in banana (Musa cavendish) slices using non-uniform color information from digital images , 2009 .

[90]  Chenglong Wang,et al.  Recognition of worm-eaten chestnuts based on machine vision , 2011, Math. Comput. Model..

[91]  Ashok Samal,et al.  Visible/near-infrared hyperspectral imaging for beef tenderness prediction , 2008 .

[92]  Da-Wen Sun,et al.  Automatic segmentation of beef longissimus dorsi muscle and marbling by an adaptable algorithm. , 2009, Meat science.

[93]  Kang Tu,et al.  Eggshell crack detection based on computer vision and acoustic response by means of back-propagation artificial neural network , 2011 .

[94]  Berkan Dulek,et al.  Computer vision-based image analysis for the estimation of acrylamide concentrations of potato chips and french fries , 2007 .

[95]  Andrés Caro,et al.  Monitoring the ripening process of Iberian ham by computer vision on magnetic resonance imaging. , 2007, Meat science.

[96]  Soleiman Hosseinpour,et al.  Application of computer vision technique for on-line monitoring of shrimp color changes during drying , 2013 .

[97]  Da-Wen Sun,et al.  Computer vision technology in the food and beverage industries. , 2012 .

[98]  M. Chmiel,et al.  Application of computer vision systems for estimation of fat content in poultry meat , 2011 .

[99]  Gamal ElMasry,et al.  Application of NIR hyperspectral imaging for discrimination of lamb muscles , 2011 .

[100]  Yousef Al-Ohali,et al.  Computer vision based date fruit grading system: Design and implementation , 2011, J. King Saud Univ. Comput. Inf. Sci..

[101]  José Blasco,et al.  Development of a machine for the automatic sorting of pomegranate (Punica granatum) arils based on computer vision , 2009 .

[102]  S. P. Kang,et al.  Simple colour image segmentation of bicolour food products for quality measurement , 2009 .

[103]  Qamar Uz Zaman,et al.  Computer vision system for wild blueberry fruit yield mapping , 2010 .

[104]  Yuchou Chang,et al.  Robust color space conversion and color distribution analysis techniques for date maturity evaluation , 2008 .

[105]  Fernando Mendoza,et al.  Classification of pre-sliced pork and Turkey ham qualities based on image colour and textural features and their relationships with consumer responses. , 2010, Meat science.

[106]  Franco Pedreschi,et al.  Enzymatic browning in sliced and puréed avocado: A fractal kinetic study , 2011 .

[107]  Navid Razmjooy,et al.  A real-time mathematical computer method for potato inspection using machine vision , 2012, Comput. Math. Appl..

[108]  Changming Sun,et al.  Thickness measurement and crease detection of wheat grains using stereo vision , 2007, Pattern Recognit. Lett..

[109]  Chaleeda Borompichaichartkul,et al.  Nuclear magnetic resonance (NMR) and magnetic resonance imaging (MRI) studies of corn at subzero temperatures , 2005 .

[110]  José Blasco,et al.  Citrus sorting by identification of the most common defects using multispectral computer vision , 2007 .

[111]  J. Gómez-Sanchís,et al.  Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[112]  Emmanuel Purlis,et al.  Modelling the browning of bread during baking , 2009 .

[113]  Daniele D. Giusto,et al.  Detection of foreign bodies in food by thermal image processing , 2004, IEEE Transactions on Industrial Electronics.

[114]  Bin Zhu,et al.  Novel separation method of black walnut meat from shell using invariant features and a supervised self-organizing map , 2008 .

[115]  S. Matiacevich,et al.  Prediction of Mechanical Properties of Corn and Tortilla Chips by Using Computer Vision , 2012, Food and Bioprocess Technology.

[116]  Qi Wang,et al.  Outdoor color rating of sweet cherries using computer vision , 2012 .

[117]  Yong He,et al.  Comparison of Infrared Spectroscopy and Nuclear Magnetic Resonance Techniques in Tandem with Multivariable Selection for Rapid Determination of ω-3 Polyunsaturated Fatty Acids in Fish Oil , 2014, Food and Bioprocess Technology.

[118]  Yong He,et al.  Application of image texture for the sorting of tea categories using multi-spectral imaging technique and support vector machine , 2008 .

[119]  S. Nashat,et al.  Original paper: Support vector machine approach to real-time inspection of biscuits on moving conveyor belt , 2011 .

[120]  Achim Kohler,et al.  Noncontact salt and fat distributional analysis in salted and smoked salmon fillets using X-ray computed tomography and NIR interactance imaging. , 2009, Journal of agricultural and food chemistry.

[121]  José Miguel Aguilera,et al.  Quantification of enzymatic browning kinetics in pear slices using non-homogenous L∗ color information from digital images , 2009 .

[122]  Liyun Zheng,et al.  Influence of Ultrasound on Freezing Rate of Immersion-frozen Apples , 2009 .

[123]  Domingo Mery,et al.  Automated Design of a Computer Vision System for Visual Food Quality Evaluation , 2013, Food and Bioprocess Technology.

[124]  Josse De Baerdemaeker,et al.  Combination of chemometric tools and image processing for bruise detection on apples , 2007 .

[125]  Wang Yingkuan.  Computer Vision Technology for Food Quality Evaluation , 2009 .

[126]  F. Mendoza,et al.  Determination of senescent spotting in banana (Musa cavendish) using fractal texture Fourier image , 2008 .

[127]  S. Prasher,et al.  Pork quality and marbling level assessment using a hyperspectral imaging system , 2007 .

[128]  Gamal ElMasry,et al.  Non-destructive determination of water-holding capacity in fresh beef by using NIR hyperspectral imaging , 2011 .

[129]  P. Allen,et al.  Development of a hybrid image processing algorithm for automatic evaluation of intramuscular fat content in beef M. longissimus dorsi. , 2008, Meat science.

[130]  Petr Dejmek,et al.  Predicting ripening stages of bananas (Musa cavendish) by computer vision , 2005 .

[131]  Chaoxin Zheng,et al.  Predicting shrinkage of ellipsoid beef joints as affected by water immersion cooking using image analysis and neural network , 2007 .

[132]  Q. Shen,et al.  Discrimination of Edible Vegetable Oil Adulteration with Used Frying Oil by Low Field Nuclear Magnetic Resonance , 2013, Food and Bioprocess Technology.

[133]  Sundaram Gunasekaran,et al.  Using computer vision for food quality evaluation : Applications of immunobiosensors and bioelectronics in food sciences and quality control , 1994 .

[134]  Aldo Cipriano,et al.  Quality classification of corn tortillas using computer vision , 2010 .

[135]  J. Aguilera,et al.  Computer Vision and Stereoscopy for Estimating Firmness in the Salmon (Salmon salar) Fillets , 2010 .

[136]  José M. Barat,et al.  Control of ham salting by using image segmentation , 2008 .

[137]  Devrim Unaya,et al.  Automatic grading of Bicolored apples by multispectral machine vision , 2010 .

[138]  Franco Pedreschi,et al.  Color of Salmon Fillets By Computer Vision and Sensory Panel , 2010 .

[139]  Fred Godtliebsen,et al.  Ridge detection with application to automatic fish fillet inspection , 2009 .

[140]  Konstantinos Drakakis,et al.  Detecting fractal power-law long-range dependence in pre-sliced cooked pork ham surface intensity patterns using Detrended Fluctuation Analysis. , 2010, Meat science.

[141]  Ning Wang,et al.  AdaBoost classifiers for pecan defect classification , 2011 .

[142]  Silvia Matiacevich,et al.  Quality assessment of blueberries by computer vision , 2011 .

[143]  E. Šárka,et al.  Size properties of legume seeds of different varieties using image analysis , 2010 .

[144]  Hamit Köksel,et al.  A classification system for beans using computer vision system and artificial neural networks , 2007 .

[145]  P. Allen,et al.  Texture appearance characterization of pre-sliced pork ham images using fractal metrics: Fourier analysis dimension and lacunarity , 2009 .

[146]  K. J. Chen,et al.  Color grading of beef fat by using computer vision and support vector machine , 2010 .

[147]  Annia García Pereira,et al.  Non-destructive measurement of acidity, soluble solids and firmness of Satsuma mandarin using Vis/NIR-spectroscopy techniques , 2006 .

[148]  Da-Wen Sun,et al.  Rapid cooling of porous and moisture foods by using vacuum cooling technology , 2001 .

[149]  Giovanni Attolico,et al.  Relationship between visual appearance and browning as evaluated by image analysis and chemical traits in fresh-cut nectarines , 2011 .

[150]  R. Lu,et al.  Analysis of spatially resolved hyperspectral scattering images for assessing apple fruit firmness and soluble solids content , 2008 .

[151]  Nyuk Ling Chin,et al.  Bread crust thickness measurement using digital imaging and L a b colour system , 2009 .

[152]  J. L. Woods,et al.  Low temperature moisture transfer characteristics of Barley: thin-layer models and equilibrium isotherms , 1994 .

[153]  Junichi Sugiyama,et al.  Nondestructive Hygiene Monitoring on Pork Meat Surface Using Excitation–Emission Matrices with Two-Dimensional Savitzky–Golay Second-Order Differentiation , 2014, Food and Bioprocess Technology.

[154]  Michael J. McCarthy,et al.  Magnetic Resonance Imaging In Foods , 1995, Springer US.