Using composite sinusoidal patterns in structured-illumination reflectance imaging (SIRI) for enhanced detection of apple bruise ☆

Abstract Structured-illumination reflectance imaging (SIRI) provides a new means for enhanced detection of defects in horticultural products. Implementing the technique relies on retrieving amplitude images by illuminating the object with sinusoidal patterns of single spatial frequencies, which, however, are limited in interrogating the tissues at different depths. This study presented a first exploration of using composite sinusoidal patterns that integrated two and three spatial frequencies of interest, in SIRI for enhanced detection of defects in food (e.g., bruises in apples). Three methods based on Fourier transform were proposed to retrieve amplitude images at different frequencies by using either phase shifting with or without spiral phase transform (SPT) or frequency-domain filtering. The phase-shifting method involves solving a linear system that is composed of multiple phase-shifted pattern images in the Fourier space, and SPT that acts as a two-dimensional quadrature transform operator is used to reduce the images needed for amplitude retrieval; while the filtering-based method directly extracts different frequency components from only one pattern image that are then subjected to SPT processing. The three methods were tested for dual-frequency and triple-frequency patterns through numerical simulations and experiments on the detection of fresh bruises in apples by SIRI. The phase-shifting methods showed good performance in terms of small demodulation errors and strong image contrast for bruise detection; the filtering-based method, although viable in numerical simulation, needed improvement due to the worst practical performance. In addition, more frequency components introduced in the pattern would deteriorate the performance of these methods, and grid composite patterns were superior over the fringe ones due to reduced interactions between different frequency components.

[1]  Anthony J. Durkin,et al.  Method for depth-resolved quantitation of optical properties in layered media using spatially modulated quantitative spectroscopy. , 2011, Journal of biomedical optics.

[2]  R. Lu,et al.  Predicting bruise susceptibility of ‘Golden Delicious’ apples using hyperspectral scattering technique , 2016 .

[3]  Anthony J. Durkin,et al.  Detection of bruises on golden delicious apples using spatial- frequency-domain imaging , 2007, SPIE BiOS.

[4]  Yuzhen Lu,et al.  Fast demodulation of pattern images by spiral phase transform in structured-illumination reflectance imaging for detection of bruises in apples , 2016, Comput. Electron. Agric..

[5]  Sylvain Gioux,et al.  Structured illumination enhances resolution and contrast in thick tissue fluorescence imaging. , 2010, Journal of biomedical optics.

[6]  C. A. García-Isáis,et al.  One shot profilometry using a composite fringe pattern , 2014 .

[7]  T. G. Crowe,et al.  Real-time Defect Detection in Fruit — Part I: Design Concepts and Development of Prototype Hardware , 1996 .

[8]  Anthony J. Durkin,et al.  Quantitative optical tomography of sub-surface heterogeneities using spatially modulated structured light. , 2009, Optics express.

[9]  T. G. Crowe,et al.  Real-time Defect Detection in Fruit — Part II: An Algorithm and Performance of a Prototype System , 1996 .

[10]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[11]  Rinaldo Cubeddu,et al.  Detection of inhomogeneities in diffusive media using spatially modulated light. , 2009, Optics letters.

[12]  Noé Alcalá Ochoa,et al.  Improvement on fringe projection profilometry , 2015 .

[13]  Song Zhang Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .

[14]  Renfu Lu,et al.  Spectral Absorption and Scattering Properties of Normal and Bruised Apple Tissue , 2010 .

[15]  Q. Yang,et al.  Finding stalk and calyx of apples using structured lighting , 1993 .

[16]  Renfu Lu,et al.  Measurement of Food Optical Properties , 2015 .

[17]  X. Su,et al.  Fourier transform profilometry based on composite structured light pattern , 2007 .

[18]  Benjamin Thomas,et al.  Enhanced resolution through thick tissue with structured illumination and adaptive optics , 2015, Journal of biomedical optics.

[19]  E. Peli Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[20]  R. Lu,et al.  Structured-illumination reflectance imaging (SIRI) for enhanced detection of fresh bruises in apples , 2016 .

[21]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[22]  Anthony J. Durkin,et al.  Quantitation and mapping of tissue optical properties using modulated imaging. , 2009, Journal of biomedical optics.

[23]  L. O. Svaasand,et al.  Properties of photon density waves in multiple-scattering media. , 1993, Applied optics.

[24]  Anthony J. Durkin,et al.  Modulated imaging: quantitative analysis and tomography of turbid media in the spatial-frequency domain. , 2005, Optics letters.

[25]  Ming-teng Lu,et al.  Improved composite Fourier transform profilometry , 2012 .

[26]  C Guan,et al.  Composite structured light pattern for three-dimensional video. , 2003, Optics express.

[27]  Yuzhen Lu,et al.  Gram-Schmidt orthonormalization for retrieval of amplitude images under sinusoidal patterns of illumination. , 2016, Applied optics.

[28]  Qingsheng Yang,et al.  Apple Stem and Calyx Identification with Machine Vision , 1996 .

[29]  T. Wilson,et al.  Method of obtaining optical sectioning by using structured light in a conventional microscope. , 1997, Optics letters.

[30]  P. Pathare,et al.  Bruise damage measurement and analysis of fresh horticultural produce-A review , 2014 .

[31]  M. Gustafsson Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.

[32]  Lihong V. Wang,et al.  Biomedical Optics: Principles and Imaging , 2007 .