Original paper: Automatic grading of Bi-colored apples by multispectral machine vision

In this paper we present a novel application work for grading of apple fruits by machine vision. Following precise segmentation of defects by minimal confusion with stem/calyx areas on multispectral images, statistical, textural and geometric features are extracted from the segmented area. Using these features, statistical and syntactical classifiers are trained for two- and multi-category grading of the fruits. Results showed that feature selection provided improved performance by retaining only the important features, and statistical classifiers outperformed their syntactical counterparts. Compared to the state-of-the-art, our two-category grading solution achieved better recognition rates (93.5% overall accuracy). In this work we further provided a more realistic multi-category grading solution, where different classification architectures are evaluated. Our observations showed that the single-classifier architecture is computationally less demanding, while the cascaded one is more accurate.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[3]  Bernard C. Jiang,et al.  Machine vision-based gray relational theory applied to IC marking inspection , 2002 .

[4]  A. E. Maxwell Comparing the Classification of Subjects by Two Independent Judges , 1970, British Journal of Psychiatry.

[5]  R. G. Diener,et al.  Using an X-ray image scan to sort bruised apples. , 1970 .

[6]  John Bibby,et al.  The Analysis of Contingency Tables , 1978 .

[7]  Stephen V. Stehman,et al.  Selecting and interpreting measures of thematic classification accuracy , 1997 .

[8]  Bernard Gosselin,et al.  Stem and calyx recognition on ‘Jonagold’ apples by pattern recognition , 2007 .

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Vincent Leemans,et al.  A real-time grading method of apples based on features extracted from defects , 2004 .

[11]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[12]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[13]  Zou Xiaobo,et al.  In-line detection of apple defects using three color cameras system , 2010 .

[14]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[15]  James A. Throop,et al.  Quality evaluation of apples based on surface defects: development of an automated inspection system , 2005 .

[16]  Da-Wen Sun,et al.  Hyperspectral imaging for food quality analysis and control , 2010 .

[17]  F. Sevila,et al.  Automatic detection of surface defects on fruit by using a vision system , 1988 .

[18]  Bernard Gosselin,et al.  Automatic defect segmentation of ‘Jonagold’ apples on multi-spectral images: A comparative study , 2006 .

[19]  Vincent Leemans,et al.  Selection of the most efficient wavelength bands for ‘Jonagold’ apple sorting , 2003 .

[20]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[21]  Hamid R. Arabnia,et al.  Apple classification based on surface bruises using image processing and neural networks , 2002 .

[22]  R. Lu,et al.  Analysis of spatially resolved hyperspectral scattering images for assessing apple fruit firmness and soluble solids content , 2008 .

[23]  Vincent Leemans,et al.  Regular ArticleAE—Automation and Emerging Technologies: On-line Fruit Grading according to their External Quality using Machine Vision , 2002 .

[24]  Daniel E. Guyer,et al.  Comparison of Artificial Neural Networks and Statistical Classifiers in Apple Sorting using Textural Features , 2004 .

[25]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[26]  Yang Tao,et al.  Building a rule-based machine-vision system for defect inspection on apple sorting and packing lines , 1999 .

[27]  Renfu Lu,et al.  Detection of bruises on apples using near-infrared hyperspectral imaging , 2003 .

[28]  J. A. Throop,et al.  OPTICAL DETECTION OF BRUISES AND EARLY FROST DAMAGE ON APPLES , 1991 .

[29]  T. G. Crowe,et al.  Real-time Defect Detection in Fruit — Part I: Design Concepts and Development of Prototype Hardware , 1996 .

[30]  Bim Prasad Shrestha,et al.  Integrating multispectral reflectance and fluorescence imaging for defect detection on apples , 2006 .

[31]  Xianghua Xie,et al.  Colour tonality inspection using eigenspace features , 2005, Machine Vision and Applications.

[32]  M. Destain,et al.  Development of a multi-spectral vision system for the detection of defects on apples , 2005 .

[33]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[34]  Moon S. Kim,et al.  Development of hyperspectral imaging technique for the detection of apple surface defects and contaminations , 2004 .

[35]  José Blasco,et al.  Machine Vision System for Automatic Quality Grading of Fruit , 2003 .

[36]  Nuria Aleixos,et al.  Erratum to: Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[37]  A. Stuart A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION , 1955 .

[38]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[39]  U. M. Peiper,et al.  A Spectrophotometric Method for Detecting Surface Bruises on "Golden Delicious" Apples , 1994 .

[40]  Josef Kittler,et al.  Floating search methods for feature selection with nonmonotonic criterion functions , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[41]  Ning Wang,et al.  Detecting chilling injury in Red Delicious apple using hyperspectral imaging and neural networks , 2009 .

[42]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[43]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[44]  Yang Tao,et al.  NIR/MIR Dual-Sensor Machine Vision System for Online Apple Stem-End/Calyx Recognition , 2003 .