From hyperspectral imaging to multispectral imaging: Portability and stability of HIS-MIS algorithms for common defect detection

Abstract The portability and stability of algorithms from hyperspectral imaging (HIS) to multispectral imaging (MIS) for detection of common defects on fruits is limiting the commercialization of multispectral inspection systems. The efficiency of selected wavelengths, the robustness to physical and biological variability, and the transplantation of the classification algorithms affect the portability and stability of algorithms from HIS to MIS. Apples with wind damage, insect damage, bruises, decay, hail, russeting, spot, scar, stem, calyx, as well as with sound surfaces were studied. Different image recognition methods were proposed according to the defect type and spectral characters. For common defects, the overall detection accuracy of 93.6% for HIS data and 91.4% for MIS with the same wavelengths and same methods was obtained. The uneven lightness distribution in the spectral images was also investigated and eliminated by the band math or partial least squares (PLS) model based methods Principal component analysis, minimum noise fraction, band math, particle least square model based methods were also investigated and compared. Results show that band math and model based method possess a higher portability and stability from HIS to MIS, and the proposed methods could make the variation of illumination, physical and biological variability as negligible interference in common defect detection. This study could provide potential reference for promoting the development of MIS and the applications of transplantable algorithms in HIS.

[1]  J. Baerdemaeker,et al.  Combining multispectral reflectance and fluorescence imaging for identifying bruises and stem-end/calyx regions on Golden Delicious apples , 2007 .

[2]  Bart Nicolai,et al.  Non-destructive measurement of bitter pit in apple fruit using NIR hyperspectral imaging , 2006 .

[3]  Colm P. O'Donnell,et al.  Hyperspectral imaging – an emerging process analytical tool for food quality and safety control , 2007 .

[4]  Baohua Zhang,et al.  Detection of Early Rottenness on Apples by Using Hyperspectral Imaging Combined with Spectral Analysis and Image Processing , 2015, Food Analytical Methods.

[5]  Baohua Zhang,et al.  Prediction of soluble solids content of apple using the combination of spectra and textural features of hyperspectral reflectance imaging data , 2016 .

[6]  Renfu Lu,et al.  Hyperspectral and multispectral imaging for evaluating food safety and quality , 2013 .

[7]  Ning Wang,et al.  Detecting chilling injury in Red Delicious apple using hyperspectral imaging and neural networks , 2009 .

[8]  P. Baranowski,et al.  Detection of early bruises in apples using hyperspectral data and thermal imaging , 2012 .

[9]  Ning Wang,et al.  Water Content and Weight Estimation for Potatoes Using Hyperspectral Imaging , 2005 .

[10]  Da-Wen Sun,et al.  Principles and Applications of Hyperspectral Imaging in Quality Evaluation of Agro-Food Products: A Review , 2012, Critical reviews in food science and nutrition.

[11]  Josse De Baerdemaeker,et al.  Combination of chemometric tools and image processing for bruise detection on apples , 2007 .

[12]  He Jianguo,et al.  Detection of common defects on jujube using Vis-NIR and NIR hyperspectral imaging , 2016 .

[13]  Josse De Baerdemaeker,et al.  Bruise detection on ‘Jonagold’ apples using hyperspectral imaging , 2005 .

[14]  José Blasco,et al.  Multispectral inspection of citrus in real-time using machine vision and digital signal processors , 2002 .

[15]  J. Qin,et al.  Detecting pits in tart cherries by hyperspectral transmission imaging , 2004, SPIE Optics East.

[16]  Won Suk Lee,et al.  Citrus greening disease detection using aerial hyperspectral and multispectral imaging techniques , 2012 .

[17]  Da-Wen Sun,et al.  Advances in Feature Selection Methods for Hyperspectral Image Processing in Food Industry Applications: A Review , 2015, Critical reviews in food science and nutrition.

[18]  R. Lu,et al.  Structured-illumination reflectance imaging (SIRI) for enhanced detection of fresh bruises in apples , 2016 .

[19]  Yud-Ren Chen,et al.  Systematic approach for using hyperspectral imaging data to develop multispectral imagining systems: Detection of feces on apples , 2006 .

[20]  Wenqian Huang,et al.  Development of a multispectral imaging system for online detection of bruises on apples , 2015 .

[21]  Baohua Zhang,et al.  Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review , 2014 .

[22]  Di Wu,et al.  Advanced applications of hyperspectral imaging technology for food quality and safety analysis and assessment: A review — Part II: Applications , 2013 .

[23]  Da-Wen Sun,et al.  Recent Progress of Hyperspectral Imaging on Quality and Safety Inspection of Fruits and Vegetables: A Review. , 2015, Comprehensive reviews in food science and food safety.

[24]  Liang Gong,et al.  Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier , 2015 .

[25]  P. Baranowski,et al.  Supervised classification of bruised apples with respect to the time after bruising on the basis of hyperspectral imaging data , 2013 .

[26]  Xiuqin Rao,et al.  Detection of common defects on oranges using hyperspectral reflectance imaging , 2011 .

[27]  Jiangbo Li,et al.  Automatic detection of common surface defects on oranges using combined lighting transform and image ratio methods , 2013 .

[28]  Moon S. Kim,et al.  Hyperspectral Imaging for Detecting Defect on Apples , 2005 .

[29]  Da-Wen Sun,et al.  Learning techniques used in computer vision for food quality evaluation: a review , 2006 .

[30]  Xuhui Zhao,et al.  Development of a two-band spectral imaging system for real-time citrus canker detection , 2012 .

[31]  Moon S. Kim,et al.  Detection of cuticle defects on cherry tomatoes using hyperspectral fluorescence imagery , 2013 .

[32]  Dan Liu,et al.  Recent Developments and Applications of Hyperspectral Imaging for Quality Evaluation of Agricultural Products: A Review , 2015, Critical reviews in food science and nutrition.

[33]  Fei Liu,et al.  Application of Visible and Near-Infrared Hyperspectral Imaging for Detection of Defective Features in Loquat , 2014, Food and Bioprocess Technology.

[34]  Daniel E. Guyer,et al.  Near-infrared hyperspectral reflectance imaging for detection of bruises on pickling cucumbers , 2006, Computers and Electronics in Agriculture.

[35]  M. Destain,et al.  Development of a multi-spectral vision system for the detection of defects on apples , 2005 .

[36]  Yong He,et al.  Identification of crack features in fresh jujube using Vis/NIR hyperspectral imaging combined with image processing , 2014 .

[37]  Baohua Zhang,et al.  Influence of physical and biological variability and solution methods in fruit and vegetable quality nondestructive inspection by using imaging and near-infrared spectroscopy techniques: A review , 2018, Critical reviews in food science and nutrition.

[38]  Chunjiang Zhao,et al.  Fast detection and visualization of early decay in citrus using Vis-NIR hyperspectral imaging , 2016, Comput. Electron. Agric..

[39]  Moon S. Kim,et al.  Development of simple algorithms for the detection of fecal contaminants on apples from visible/near infrared hyperspectral reflectance imaging , 2007 .

[40]  Da-Wen Sun,et al.  Recent Advances in Wavelength Selection Techniques for Hyperspectral Image Processing in the Food Industry , 2014, Food and Bioprocess Technology.

[41]  Da-Wen Sun,et al.  Application of Hyperspectral Imaging in Food Safety Inspection and Control: A Review , 2012, Critical reviews in food science and nutrition.

[42]  Chun-Chieh Yang,et al.  Development of multispectral imaging algorithm for detection of frass on mature red tomatoes , 2014 .

[43]  Nuria Aleixos,et al.  Selection of Optimal Wavelength Features for Decay Detection in Citrus Fruit Using the ROC Curve and Neural Networks , 2013, Food and Bioprocess Technology.

[44]  José Blasco,et al.  Citrus sorting by identification of the most common defects using multispectral computer vision , 2007 .

[45]  Zou Xiaobo,et al.  In-line detection of apple defects using three color cameras system , 2010 .

[46]  Fumiomi Takeda,et al.  Nondestructive Detection and Quantification of Blueberry Bruising using Near-infrared (NIR) Hyperspectral Reflectance Imaging , 2016, Scientific Reports.

[47]  Stephen R. Delwiche,et al.  Hyperspectral near-infrared imaging for the detection of physical damages of pear , 2014 .

[48]  Baohua Zhang,et al.  Hyperspectral imaging combined with multivariate analysis and band math for detection of common defects on peaches (Prunus persica) , 2015, Comput. Electron. Agric..