Histogram-based automatic thresholding for bruise detection of apples by structured-illumination reflectance imaging

Thresholding is an important step in the segmentation of image features, and the existing methods are not all effective when the image histogram exhibits a unimodal pattern, which is common in defect detection of fruit. This study was aimed at developing a general automatic thresholding methodology for fast and effective segmentation of bruises from the images acquired by structured-illumination reflectance imaging (SIRI). SIRI images, under sinusoidal patterns of illumination at a spatial frequency of 100 cycles m −1 , were acquired from 120 apple samples of four varieties with artificially created bruises and from another 40 apples with naturally occurred bruises. Subsequently, three sets of images, i.e., amplitude component (AC), direct component (DC) and ratio (i.e., dividing AC by DC), were derived from the original SIRI images. A unimodal thresholding method, called UNIMODE, was first applied to DC images for background removal, and then nine automatic thresholding techniques, including one unimodal and eight bimodal, were applied to the ratio images for bruise segmentation. It was found that severe over-segmentation occurred when using the bimodal thresholding methods, and this problem was mitigated by confining threshold selection to the lower part of the histogram that contained bruise information. Three bimodal thresholding techniques, i.e., INTERMODE (histogram valley emphasized), RIDLER (iterative thresholding), OTSU (clustering based) achieved the best bruise detection results with the overall accuracies of more than 90%. The overall detection results were further improved by integrating these techniques with the unimodal thresholding, due to reductions in the false positive error. The three bimodal thresholding techniques resulted in overall detection accuracies of 77–85% for naturally occurred bruises. This study has showed that the proposed automatic thresholding methodology provides a simple and effective tool for bruise detection of apples.

[1]  Wen-Hsiang Tsai,et al.  Moment-preserving thresolding: A new approach , 1985, Comput. Vis. Graph. Image Process..

[2]  M L Mendelsohn,et al.  THE ANALYSIS OF CELL IMAGES * , 1966, Annals of the New York Academy of Sciences.

[3]  Renfu Lu,et al.  An image segmentation method for apple sorting and grading using support vector machine and Otsu's method , 2013 .

[4]  P. Baranowski,et al.  Supervised classification of bruised apples with respect to the time after bruising on the basis of hyperspectral imaging data , 2013 .

[5]  T. W. Ridler,et al.  Picture thresholding using an iterative selection method. , 1978 .

[6]  Josse De Baerdemaeker,et al.  Combination of chemometric tools and image processing for bruise detection on apples , 2007 .

[7]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[8]  J. B. Li,et al.  Machine vision technology for detecting the external defects of fruits — a review , 2015 .

[9]  Vincent Leemans,et al.  A real-time grading method of apples based on features extracted from defects , 2004 .

[10]  Wenqian Huang,et al.  Development of a multispectral imaging system for online detection of bruises on apples , 2015 .

[11]  Yuzhen Lu,et al.  Fast demodulation of pattern images by spiral phase transform in structured-illumination reflectance imaging for detection of bruises in apples , 2016, Comput. Electron. Agric..

[12]  Renfu Lu,et al.  Detection of bruises on apples using near-infrared hyperspectral imaging , 2003 .

[13]  Hamid R. Arabnia,et al.  Apple classification based on surface bruises using image processing and neural networks , 2002 .

[14]  Vincent Leemans,et al.  Regular ArticleAE—Automation and Emerging Technologies: On-line Fruit Grading according to their External Quality using Machine Vision , 2002 .

[15]  Weikang Gu,et al.  Computer vision based system for apple surface defect detection , 2002 .

[16]  Yuzhen Lu,et al.  Development of a Multispectral Structured Illumination Reflectance Imaging (SIRI) System and Its Application to Bruise Detection of Apples , 2017 .

[17]  Bim Prasad Shrestha,et al.  Integrating multispectral reflectance and fluorescence imaging for defect detection on apples , 2006 .

[18]  Koki Kyo,et al.  Wavelength selection in vis/NIR spectra for detection of bruises on apples by ROC analysis , 2012 .

[19]  Lianghai Jin,et al.  Characteristic analysis of Otsu threshold and its applications , 2011, Pattern Recognit. Lett..

[20]  R. Lu,et al.  Structured-illumination reflectance imaging (SIRI) for enhanced detection of fresh bruises in apples , 2016 .

[21]  Bernard Gosselin,et al.  Automatic defect segmentation of ‘Jonagold’ apples on multi-spectral images: A comparative study , 2006 .

[22]  Tim Holmes,et al.  Quantifying the Diffuse Reflectance Change Caused by Fresh Bruises on Apples , 2014 .

[23]  Josse De Baerdemaeker,et al.  Detecting Bruises on ‘Golden Delicious’ Apples using Hyperspectral Imaging with Multiple Wavebands , 2005 .

[24]  P.K Sahoo,et al.  A survey of thresholding techniques , 1988, Comput. Vis. Graph. Image Process..

[25]  Chris A. Glasbey,et al.  An Analysis of Histogram-Based Thresholding Algorithms , 1993, CVGIP Graph. Model. Image Process..

[26]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[27]  D. L. Peterson,et al.  Performance of a System for Apple Surface Defect Identification in Near-infrared Images , 2005 .

[28]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[29]  Richard Li.  Development of a structured illumination reflectance imaging system for enhanced detection of subsurface and surface defects in apple fruit , 2016 .

[30]  Yuzhen Lu,et al.  Gram-Schmidt orthonormalization for retrieval of amplitude images under sinusoidal patterns of illumination. , 2016, Applied optics.

[31]  Amy Tabb,et al.  Identifying Apple Surface Defects Using Principal Components Analysis and Artificial Neural Networks , 2007 .

[32]  Joan S. Weszka,et al.  A survey of threshold selection techniques , 1978 .

[33]  James A. Throop,et al.  An Image Processing Algorithm to Find New and Old Bruises , 1995 .

[34]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[35]  Yuzhen Lu,et al.  Quality Evaluation of Apples , 2016 .

[36]  Xiukun Yang,et al.  Use of genetic artificial neural networks and spectral imaging for defect detection on cherries , 2000 .

[37]  Hui-Fuang Ng.  Automatic thresholding for defect detection , 2006, Pattern Recognit. Lett..

[38]  Liang Gong,et al.  Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier , 2015 .

[39]  James A. Throop,et al.  Quality evaluation of apples based on surface defects: development of an automated inspection system , 2005 .

[40]  Ning Wang,et al.  Early detection of apple bruises on different background colors using hyperspectral imaging , 2008 .