Recent Advances and Applications of Hyperspectral Imaging for Fruit and Vegetable Quality Assessment

Hyperspectral imaging systems are starting to be used as a scientific tool for food quality assessment. A typical hyperspectral image is composed of a set of a relatively wide range of monochromatic images corresponding to continuous wavelengths that normally contain redundant information or may exhibit a high degree of correlation. In addition, computation of the classifiers used to deal with the data obtained from the images can become excessively complex and time-consuming for such high-dimensional datasets, and this makes it difficult to incorporate such systems into an industry that demands standard protocols or high-speed processes. Therefore, recent works have focused on the development of new systems based on this technology that are capable of analysing quality features that cannot be inspected using visible imaging. Many of those studies have also centred on finding new statistical techniques to reduce the hyperspectral images to multispectral ones, which are easier to implement in automatic, non-destructive systems. This article reviews recent works that use hyperspectral imaging for the inspection of fruit and vegetables. It explains the different technologies available to acquire the images and their use for the non-destructive inspection of the internal and external features of these products. Particular attention is paid to the works aimed at reducing the dimensionality of the images, with details of the statistical techniques most commonly used for this task.

[1]  D. L. Peterson,et al.  Performance of a System for Apple Surface Defect Identification in Near-infrared Images , 2005 .

[2]  Y. R. Chen,et al.  HYPERSPECTRAL REFLECTANCE AND FLUORESCENCE IMAGING SYSTEM FOR FOOD QUALITY AND SAFETY , 2001 .

[3]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[4]  Colm P. O'Donnell,et al.  Comparison of hyperspectral imaging with conventional RGB imaging for quality evaluation of Agaricus bisporus mushrooms , 2011 .

[5]  I. Jolliffe Principal Component Analysis , 2002 .

[6]  Da-Wen Sun,et al.  Retrospective Shading Correction of Confocal Laser Scanning Microscopy Beef Images for Three-Dimensional Visualization , 2009 .

[7]  J. Aguilera,et al.  Computer Vision and Stereoscopy for Estimating Firmness in the Salmon (Salmon salar) Fillets , 2010 .

[8]  Ning Wang,et al.  Early detection of apple bruises on different background colors using hyperspectral imaging , 2008 .

[9]  Ling Bei,et al.  Acousto-optic tunable filters: fundamentals and applications as applied to chemical analysis techniques [review article] , 2004 .

[10]  Colm P. O'Donnell,et al.  Hyperspectral imaging – an emerging process analytical tool for food quality and safety control , 2007 .

[11]  A. Peirs,et al.  Starch Index Determination of Apple Fruit by Means of a Hyperspectral near Infrared Reflectance Imaging System , 2003 .

[12]  R. Lu,et al.  An lctf-based multispectral imaging system for estimation of apple fruit firmness: Part I. Acquisition and characterization of scattering images , 2006 .

[13]  Da-Wen Sun,et al.  Computer vision technology for food quality evaluation , 2008 .

[14]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[15]  Marino Uceda,et al.  A sensor-software based on artificial neural network for the optimization of olive oil elaboration process , 2008 .

[16]  R. Lu,et al.  Analysis of spatially resolved hyperspectral scattering images for assessing apple fruit firmness and soluble solids content , 2008 .

[17]  Yukihiro Ozaki,et al.  Near-infrared spectroscopy in food science and technology , 2007 .

[18]  Luis Gómez-Chova,et al.  Segmentation of Hyperspectral Images for the Detection of Rotten Mandarins , 2008, ICIAR.

[19]  Paul Geladi,et al.  Calibration Standards and Image Calibration , 2007 .

[20]  Colm P. O'Donnell,et al.  Use of near Infrared Hyperspectral Imaging to Identify Water Matrix Co-Ordinates in Mushrooms (Agaricus Bisporus) Subjected to Mechanical Vibration , 2009 .

[21]  F. Kianifard Applied Multivariate Data Analysis: Volume II: Categorical and Multivariate Methods , 1994 .

[22]  Hiroshi Okamoto,et al.  Discrimination between potato tubers and clods by detecting the significant wavebands , 2008 .

[23]  Frank Y. Shih,et al.  Image Processing and Pattern Recognition: Fundamentals and Techniques , 2010 .

[24]  Jorge L. C. Sanz,et al.  Advances in Machine Vision , 1988, Springer Series in Perception Engineering.

[25]  Peter J. A. Shaw,et al.  Multivariate Statistics for the Environmental Sciences , 2003 .

[26]  Moon S. Kim,et al.  Development of a Simple Algorithm for the Detection of Chilling Injury in Cucumbers from Visible/Near-Infrared Hyperspectral Imaging , 2005, Applied spectroscopy.

[27]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Colm P. O'Donnell,et al.  Identification of mushrooms subjected to freeze damage using hyperspectral imaging. , 2009 .

[29]  Moon S. Kim,et al.  Development of hyperspectral imaging technique for the detection of apple surface defects and contaminations , 2004 .

[30]  Alan M. Lefcourt,et al.  A novel integrated PCA and FLD method on hyperspectral image feature extraction for cucumber chilling damage inspection , 2004 .

[31]  Clément Vigneault,et al.  Spectral methods for measuring quality changes of fresh fruits and vegetables , 2008 .

[32]  J. Gómez-Sanchís,et al.  Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[33]  Robert F. Ling,et al.  Applied Multivariate Data Analysis, Vol. I: Regression and Experimental Design (J. D. Jobson) , 1992, SIAM Rev..

[34]  E. Tollner,et al.  Shortwave infrared hyperspectral imaging for detecting sour skin (Burkholderiacepacia)-infected onions , 2012 .

[35]  R. Lu,et al.  Hyperspectral Scattering for assessing Peach Fruit Firmness , 2006 .

[36]  R. Lu,et al.  DETECTION OF BRUISES ON APPLES USING NEAR – INFRARED HYPERSPECTRAL IMAGING , 2003 .

[37]  A. Gowen,et al.  Use of hyperspectral imaging for evaluation of the shelf-life of fresh white button mushrooms (Agaricus bisporus) stored in different packaging films , 2010 .

[38]  Gerrit Polder,et al.  Tomato sorting using independent component analysis on spectral images , 2003, Real Time Imaging.

[39]  Ernest W. Tollner,et al.  A liquid crystal tunable filter based shortwave infrared spectral imaging system: Design and integration , 2012 .

[40]  Noel D.G. White,et al.  Wheat Class Identification Using Thermal Imaging , 2010 .

[41]  Stanley J. Kays,et al.  Preharvest factors affecting appearance , 1999 .

[42]  Bart Nicolai,et al.  Non-destructive measurement of bitter pit in apple fruit using NIR hyperspectral imaging , 2006 .

[43]  Yud-Ren Chen,et al.  Systematic approach for using hyperspectral imaging data to develop multispectral imagining systems: Detection of feces on apples , 2006 .

[44]  Da-Wen Sun,et al.  Hyperspectral imaging for food quality analysis and control , 2010 .

[45]  Angelo Zanella,et al.  Supervised Multivariate Analysis of Hyper-spectral NIR Images to Evaluate the Starch Index of Apples , 2009 .

[46]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[47]  Nuria Aleixos,et al.  Erratum to: Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[48]  Ning Wang,et al.  Studies on banana fruit quality and maturity stages using hyperspectral imaging , 2012 .

[49]  Gustavo Camps-Valls,et al.  Automatic correction of the effects of the light source on spherical objects. An application to the analysis of hyperspectral images of citrus fruits , 2008 .

[50]  D. L. Peterson,et al.  Identifying defects in images of rotating apples , 2005 .

[51]  Renfu Lu,et al.  Integrated spectral and image analysis of hyperspectral scattering data for prediction of apple fruit firmness and soluble solids content , 2011 .

[52]  José Antonio Cayuela,et al.  NIR prediction of fruit moisture, free acidity and oil content in intact olives. , 2009 .

[53]  Yiqun Huang,et al.  Applications of Artificial Neural Networks (ANNs) in Food Science , 2007, Critical reviews in food science and nutrition.

[54]  G. Camps-Valls,et al.  Hyperspectral system for early detection of rottenness caused by Penicillium digitatum in mandarins , 2008 .

[55]  Joost van de Weijer,et al.  Color in Computer Vision , 2008 .

[56]  Wynne W. Chin,et al.  Handbook of Partial Least Squares , 2010 .

[57]  Xuhui Zhao,et al.  Development of a two-band spectral imaging system for real-time citrus canker detection , 2012 .

[58]  P. Gass Acousto-Optic Devices and Applications , 1991 .

[59]  D. P. Ariana,et al.  Evaluation of internal defect and surface color of whole pickles using hyperspectral imaging. , 2010 .

[60]  Daniel E. Guyer,et al.  Near-infrared hyperspectral reflectance imaging for detection of bruises on pickling cucumbers , 2006, Computers and Electronics in Agriculture.

[61]  Bart Nicolai,et al.  Prediction of optimal cooking time for boiled potatoes by hyperspectral imaging , 2011 .

[62]  M. Destain,et al.  Development of a multi-spectral vision system for the detection of defects on apples , 2005 .

[63]  Junichi Sugiyama,et al.  NIR spectral imaging with discriminant analysis for detecting foreign materials among blueberries , 2010 .

[64]  Wouter Saeys,et al.  NIR Spectroscopy Applications for Internal and External Quality Analysis of Citrus Fruit—A Review , 2012, Food and Bioprocess Technology.

[65]  Renfu Lu,et al.  Original paper: Hyperspectral waveband selection for internal defect detection of pickling cucumbers and whole pickles , 2010 .

[66]  P Jancsók,et al.  Stem-end/Calyx Identification on Apples using Contour Analysis in Multispectral Images , 2007 .

[67]  Colm P. O'Donnell,et al.  The potential of visible-near infrared hyperspectral imaging to discriminate between casing soil, enzymatic browning and undamaged tissue on mushroom (Agaricus bisporus) surfaces , 2011 .

[68]  Pedro Melo-Pinto,et al.  Determination of anthocyanin concentration in whole grape skins using hyperspectral imaging and adaptive boosting neural networks , 2011 .

[69]  Daniel Q. Naiman Pattern Recognition in Practice II , 1988 .

[70]  Renfu Lu,et al.  MODELING MULTISPECTRAL SCATTERING PROFILES FOR PREDICTION OF APPLE FRUIT FIRMNESS , 2005 .

[71]  Jean-Michel Roger,et al.  Comparison of multispectral indexes extracted from hyperspectral images for the assessment of fruit ripening , 2011 .

[72]  Gerrit Polder,et al.  Hyperspectral image analysis for measuring ripeness of tomatoes. , 2000 .

[73]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[74]  Y. Yardimci,et al.  Detection of contaminated hazelnuts and ground red chili pepper flakes by multispectral imaging , 2011 .

[75]  José Blasco,et al.  Multispectral inspection of citrus in real-time using machine vision and digital signal processors , 2002 .

[76]  Da-Wen Sun,et al.  Shape Analysis of Agricultural Products: A Review of Recent Research Advances and Potential Application to Computer Vision , 2011 .

[77]  Margarita Ruiz-Altisent,et al.  Monitoring of fresh-cut spinach leaves through a multispectral vision system , 2012 .

[78]  Javier Calpe-Maravilla,et al.  Design of a configurable multispectral imaging system based on an AOTF , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[79]  Eddie Schrevens,et al.  Use of Image Analysis to Investigate Human Quality Classification of Apples , 1997 .

[80]  Jianwei Qin,et al.  DETECTION OF PITS IN TART CHERRIES BY HYPERSPECTRAL TRANSMISSION IMAGING , 2005 .

[81]  Devrim Unaya,et al.  Automatic grading of Bicolored apples by multispectral machine vision , 2010 .

[82]  M. Ngadi,et al.  Hyperspectral imaging for nondestructive determination of some quality attributes for strawberry , 2007 .

[83]  A. de Juan,et al.  Multivariate image analysis: a review with applications , 2011 .

[84]  Franco Pedreschi,et al.  Color of Salmon Fillets By Computer Vision and Sensory Panel , 2010 .

[85]  A. Peirs,et al.  Nondestructive measurement of fruit and vegetable quality by means of NIR spectroscopy: A review , 2007 .

[86]  D. E. Chan,et al.  Development of Hyperspectral Imaging Technique for the Detection of Chilling Injury in Cucumbers; Spectral and Image Analysis , 2006 .

[87]  Shintaroh Ohashi,et al.  Detection of external insect infestations in jujube fruit using hyperspectral reflectance imaging , 2011 .

[88]  Jorge Chanona-Pérez,et al.  Evaluation of Image Analysis Tools for Characterization of Sweet Bread Crumb Structure , 2012, Food and Bioprocess Technology.

[89]  Filiberto Pla,et al.  SmartSpectra: Applying multispectral imaging to industrial environments , 2005, Real Time Imaging.

[90]  Paul Geladi,et al.  Comprar Techniques and Applications of Hyperspectral Image Analysis | Paul Geladi | 9780470010860 | Wiley , 2007 .

[91]  Nuria Aleixos,et al.  Selection of Optimal Wavelength Features for Decay Detection in Citrus Fruit Using the ROC Curve and Neural Networks , 2013, Food and Bioprocess Technology.

[92]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[93]  Da-Wen Sun Infrared spectroscopy for food quality analysis and control , 2009 .

[94]  Michael Egmont-Petersen,et al.  Image processing with neural networks - a review , 2002, Pattern Recognit..

[95]  José Blasco,et al.  Citrus sorting by identification of the most common defects using multispectral computer vision , 2007 .

[96]  Xiuqin Rao,et al.  Detection of common defects on oranges using hyperspectral reflectance imaging , 2011 .

[97]  Amy Tabb,et al.  Identifying Apple Surface Defects Using Principal Components Analysis and Artificial Neural Networks , 2007 .

[98]  G. Bearman,et al.  Biological imaging spectroscopy , 2001 .

[99]  H. Noh,et al.  Integration of Hyperspectral Reflectance and Fluorescence Imaging for Assessing Apple Maturity , 2007 .

[100]  Ning Wang,et al.  Detecting chilling injury in Red Delicious apple using hyperspectral imaging and neural networks , 2009 .

[101]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[102]  Paul Geladi,et al.  Techniques and applications of hyperspectral image analysis , 2007 .

[103]  José Blasco,et al.  Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features , 2009 .

[104]  G. Downey,et al.  Hyperspectral imaging combined with principal component analysis for bruise damage detection on white mushrooms (Agaricus bisporus) , 2008 .

[105]  Hector Erives,et al.  Automated registration of hyperspectral images for precision agriculture , 2005 .

[106]  Josse De Baerdemaeker,et al.  Combination of chemometric tools and image processing for bruise detection on apples , 2007 .

[107]  Wang Yingkuan Computer Vision Technology for Food Quality Evaluation , 2009 .

[108]  Bim Prasad Shrestha,et al.  Integrating multispectral reflectance and fluorescence imaging for defect detection on apples , 2006 .

[109]  Gerrit Polder,et al.  Measuring surface distribution of carotenes and chlorophyll in ripening tomatoes using imaging spectrometry , 2004 .

[110]  G. McLachlan Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[111]  Adolfo Martínez Usó,et al.  Multispectral Image Segmentation by Energy Minimization for Fruit Quality Estimation , 2005, IbPRIA.

[112]  Zhao Jiewen,et al.  Nondestructive measurement of sugar content of apple using hyperspectral imaging technique. , 2009 .

[113]  Jiewen Zhao,et al.  Detection of Bruise on Pear by Hyperspectral Imaging Sensor with Different Classification Algorithms , 2010 .

[114]  M. Ruiz-Altisent,et al.  Multispectral images of peach related to firmness and maturity at harvest , 2009 .

[115]  Svante Wold,et al.  PLS DISCRIMINANT PLOTS , 1986 .

[116]  Da-Wen Sun,et al.  Learning techniques used in computer vision for food quality evaluation: a review , 2006 .

[117]  Josse De Baerdemaeker,et al.  Bruise detection on ‘Jonagold’ apples using hyperspectral imaging , 2005 .

[118]  Bernard Gosselin,et al.  Original paper: Automatic grading of Bi-colored apples by multispectral machine vision , 2011 .

[119]  Bernard Gosselin,et al.  Automatic defect segmentation of ‘Jonagold’ apples on multi-spectral images: A comparative study , 2006 .

[120]  Renfu Lu,et al.  Hyperspectral laser-induced fluorescence imaging for assessing apple fruit quality , 2007 .

[121]  Josse De Baerdemaeker,et al.  Detecting Bruises on ‘Golden Delicious’ Apples using Hyperspectral Imaging with Multiple Wavebands , 2005 .

[122]  Shaoyun Wang,et al.  Infrared Spectroscopy for Food Quality Analysis and Control , 2010 .

[123]  Javier Calpe-Maravilla,et al.  Analysis of acousto-optic tunable filter performance for imaging applications , 2010 .

[124]  José Blasco,et al.  Detecting rottenness caused by Penicillium genus fungi in citrus fruits using machine learning techniques , 2012, Expert Syst. Appl..

[125]  I. Chang I. Acoustooptic Devices and Applications , 1976, IEEE Transactions on Sonics and Ultrasonics.

[126]  J. Qin,et al.  Detection of citrus canker using hyperspectral reflectance imaging with spectral information divergence , 2009 .

[127]  Shiv O. Prasher,et al.  Application of Hyperspectral Technique for Color Classification Avocados Subjected to Different Treatments , 2009, Food and Bioprocess Technology.