Detection of subsurface bruising in fresh pickling cucumbers using structured-illumination reflectance imaging

Abstract Pickling cucumbers are susceptible to bruising during harvest and postharvest handling. It is thus desirable to segregate bruised fruit before they are marketed as fresh products or processed as pickles. Structured-illumination reflectance imaging (SIRI) is an emerging optical imaging modality for food quality inspection. This study reported the first demonstration of SIRI for detecting subsurface bruising in fresh pickling cucumbers. Two independent sets of images, i.e., direct component (DC) and amplitude component (AC), were demodulated from phase-shifted sinusoidal pattern images at 740 nm; AC was found more effective than DC for ascertaining bruises that exhibited no visual symptoms. Classification models based on support vector machine were built using extracted image features, to classify cucumbers into bruised and normal classes. The highest classification accuracy of 91 % was achieved by the ensemble of DC, AC and their ratio (AC/DC) images, which represented 7.6 percentage-point improvement over that obtained using the DC images alone. Using features selection for five sets of image features led to further improvements in the classification performance. Incremental evaluation of top 50 most informative features resulted in an averaged overall accuracy of 94 %, with the highest accuracy of 97 % attained by 31 features; and using a subset of only 5 features, 3 from AC and 2 from DC, also produced a high overall accuracy of 96 %. This study demonstrates that SIRI can provide a potentially effective means for visualizing subsurface bruising in pickling cucumbers, which otherwise could barely be achieved by imaging under uniform illumination, and thus for enhancing the differentiation of normal and bruised fruit. More research is, however, needed to optimize and implement SIRI for real-time inspection of cucumber defects.

[1]  W. J. Langford Statistical Methods , 1959, Nature.

[2]  A. R. Miller,et al.  Mechanical Stress, Storage Time, and Temperature Influence Cell Wall-degrading Enzymes, Firmness, and Ethylene Production by Cucumbers , 1987, Journal of the American Society for Horticultural Science.

[3]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[4]  A. R. Miller,et al.  Harvest and Handling Injury: Physiology, Biochemistry, and Detection , 2002 .

[5]  Yuzhen Lu,et al.  Hyperspectral imaging technology for quality and safety evaluation of horticultural products: A review and celebration of the past 20-year progress , 2020 .

[6]  Yibin Ying,et al.  Spatial-frequency domain imaging coupled with frequency optimization for estimating optical properties of two-layered food and agricultural products , 2020 .

[7]  A. R. Miller,et al.  Mechanical Stress Stimulates Peroxidase Activity in Cucumber Fruit , 1989, HortScience.

[8]  Yuzhen Lu,et al.  Fast demodulation of pattern images by spiral phase transform in structured-illumination reflectance imaging for detection of bruises in apples , 2016, Comput. Electron. Agric..

[9]  Xiaping Fu,et al.  Spatial frequency domain imaging for determining absorption and scattering properties of bruised pears based on profile corrected diffused reflectance , 2021 .

[10]  Yuzhen Lu,et al.  Detection of Surface and Subsurface Defects of Apples Using Structured- Illumination Reflectance Imaging with Machine Learning Algorithms , 2018 .

[11]  Yuzhen Lu,et al.  Innovative Hyperspectral Imaging-Based Techniques for Quality Evaluation of Fruits and Vegetables: A Review , 2017 .

[12]  G. Ware,et al.  Producing vegetable crops , 1980 .

[13]  Ajay Kumar,et al.  Defect detection in textured materials using Gabor filters , 2000, Conference Record of the 2000 IEEE Industry Applications Conference. Thirty-Fifth IAS Annual Meeting and World Conference on Industrial Applications of Electrical Energy (Cat. No.00CH37129).

[14]  L. J. Segerlind,et al.  Influence of Handling on Pickling Cucumber Quality , 1976 .

[15]  Yuzhen Lu,et al.  Gram-Schmidt orthonormalization for retrieval of amplitude images under sinusoidal patterns of illumination. , 2016, Applied optics.

[16]  Anthony J. Durkin,et al.  Quantitation and mapping of tissue optical properties using modulated imaging. , 2009, Journal of biomedical optics.

[17]  Yuzhen Lu,et al.  Fast Bi-dimensional empirical mode decomposition as an image enhancement technique for fruit defect detection , 2018, Comput. Electron. Agric..

[18]  B. D. White,et al.  Nondestructive Evaluation of Pickling Cucumbers Using Visible-Infrared Light Transmission , 1995 .

[19]  Yuzhen Lu,et al.  Detection of early decay in peaches by structured-illumination reflectance imaging , 2019, Postharvest Biology and Technology.

[20]  Yuzhen Lu,et al.  Histogram-based automatic thresholding for bruise detection of apples by structured-illumination reflectance imaging , 2017 .

[21]  Peter A. Flach,et al.  Machine Learning - The Art and Science of Algorithms that Make Sense of Data , 2012 .

[22]  Wei Yang,et al.  Neighborhood Component Feature Selection for High-Dimensional Data , 2012, J. Comput..

[23]  Yuzhen Lu,et al.  Structured Illumination Reflectance Imaging for Enhanced Detection of Subsurface Tissue Bruising in Apples , 2018 .

[24]  P. Bex,et al.  Spatial frequency, phase, and the contrast of natural images. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  Renfu Lu,et al.  Original paper: Hyperspectral waveband selection for internal defect detection of pickling cucumbers and whole pickles , 2010 .

[26]  Yuzhen Lu,et al.  Structured-illumination reflectance imaging for the detection of defects in fruit: Analysis of resolution, contrast and depth-resolving features , 2019, Biosystems Engineering.

[27]  R. Lu,et al.  Structured-illumination reflectance imaging (SIRI) for enhanced detection of fresh bruises in apples , 2016 .

[28]  Judith A. Abbott,et al.  Detection of Mechanical Injury and Physiological Breakdown of Cucumbers Using Delayed Light Emission , 1991 .

[29]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[30]  Yuzhen Lu,et al.  Development of a Multispectral Structured Illumination Reflectance Imaging (SIRI) System and Its Application to Bruise Detection of Apples , 2017 .

[31]  D. E. Marshall,et al.  Physical and Quality Factors of Pickling Cucumbers as Affected by Mechanical Harvesting , 1972 .

[32]  Wilfried Uhring,et al.  Single snapshot of optical properties image quality improvement using anisotropic two-dimensional windows filtering , 2019, Journal of biomedical optics.

[33]  Yuzhen Lu,et al.  Using composite sinusoidal patterns in structured-illumination reflectance imaging (SIRI) for enhanced detection of apple bruise ☆ , 2017 .

[34]  Daniel E. Guyer,et al.  Near-infrared hyperspectral reflectance imaging for detection of bruises on pickling cucumbers , 2006, Computers and Electronics in Agriculture.

[35]  Yuzhen Lu,et al.  Enhancing chlorophyll fluorescence imaging under structured illumination with automatic vignetting correction for detection of chilling injury in cucumbers , 2020, Comput. Electron. Agric..

[36]  Renfu Lu,et al.  Hyperspectral Imaging-Based Classification and Wavebands Selection for Internal Defect Detection of Pickling Cucumbers , 2013, Food and Bioprocess Technology.

[37]  Sylvain Gioux,et al.  Single snapshot imaging of optical properties. , 2013, Biomedical optics express.

[38]  Daniel M. Ennis,et al.  CUCUMBER QUALITY - A REVIEW , 1979 .

[39]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Renfu Lu,et al.  Quality evaluation of pickling cucumbers using hyperspectral reflectance and transmittance imaging—Part II. Performance of a prototype , 2008 .

[41]  W. Walter,et al.  Wound Healing in Cucumber Fruit , 1990 .

[42]  R. Lu,et al.  Detection of Chilling Injury in Pickling Cucumbers Using Dual-Band Chlorophyll Fluorescence Imaging , 2021, Foods.

[43]  Yuzhen Lu,et al.  siritool: A Matlab Graphical User Interface for Image Analysis in Structured-Illumination Reflectance Imaging for Fruit Defect Detection , 2020 .

[44]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[45]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.