Automated Design of a Computer Vision System for Visual Food Quality Evaluation

Considerable research efforts in computer vision applied to food quality evaluation have been developed in the last years; however, they have been concentrated on using or developing tailored methods based on visual features that are able to solve a specific task. Nevertheless, today’s computer capabilities are giving us new ways to solve complex computer vision problems. In particular, a new paradigm on machine learning techniques has emerged posing the task of recognizing visual patterns as a search problem based on training data and a hypothesis space composed by visual features and suitable classifiers. Furthermore, now we are able to extract, process, and test in the same time more image features and classifiers than before. Thus, we propose a general framework that designs a computer vision system automatically, i.e., it finds—without human interaction—the features and the classifiers for a given application avoiding the classical trial and error framework commonly used by human designers. The key idea of the proposed framework is to select—automatically—from a large set of features and a bank of classifiers those features and classifiers that achieve the highest performance. We tested our framework on eight different food quality evaluation problems yielding a classification performance of 95 % or more in every case. The proposed framework was implemented as a Matlab Toolbox available for noncommercial purposes.

[1]  A. Cipriano,et al.  Computer Vision for Quality Control in Latin American Food Industry, A Case Study , 2007 .

[2]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[4]  D. Mery,et al.  Segmentation of colour food images using a robust algorithm , 2005 .

[5]  Hugo Jair Escalante,et al.  Particle Swarm Model Selection , 2009, J. Mach. Learn. Res..

[6]  Mandyam D. Srinath,et al.  Contour sequence moments for the classification of closed planar shapes , 1987, Pattern Recognit..

[7]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Domingo Mery,et al.  Features: the more the better , 2008 .

[9]  Da-Wen Sun,et al.  Computer vision technology for food quality evaluation , 2008 .

[10]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[11]  Jinglu Tan,et al.  Meat quality evaluation by computer vision , 2004 .

[12]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[13]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[14]  Dieter Filbert,et al.  CLASSIFICATION OF POTENTIAL DEFECTS IN THE AUTOMATIC INSPECTION OF ALUMINIUM CASTINGS USING STATISTICAL PATTERN RECOGNITION , 2002 .

[15]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[16]  Eugenios Katsanidis,et al.  Impact of physical and chemical pretreatments on texture of Octopus (Eledone moschata) , 2006 .

[17]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[20]  David C. Slaughter,et al.  REAL-TIME X-RAY INSPECTION OF WHEAT FOR INFESTATION BY THE GRANARY WEEVIL, SITOPHILUS GRANARIUS (L.) , 2004 .

[21]  F. Mendoza,et al.  Classification of Potato Chips Using Pattern Recognition , 2006 .

[22]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Mark S. Nixon,et al.  Feature Extraction and Image Processing , 2002 .

[24]  Jan Flusser,et al.  Pattern recognition by affine moment invariants , 1993, Pattern Recognit..

[25]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[27]  D. Mery,et al.  Color measurement in L ¿ a ¿ b ¿ units from RGB digital images , 2006 .

[28]  Natsuko Toyofuku,et al.  X-ray detection of defects and contaminants in the food industry , 2008 .

[29]  S. Billings,et al.  Feature Subset Selection and Ranking for Data Dimensionality Reduction , 2007 .

[30]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[31]  Y. Ogawa,et al.  Inside quality evaluation of fruit by X-ray image , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[32]  Stephen R. Marsland,et al.  Machine Learning - An Algorithmic Perspective , 2009, Chapman and Hall / CRC machine learning and pattern recognition series.

[33]  E. R. Davies,et al.  Image Processing for the Food Industry , 2000, Series in Machine Perception and Artificial Intelligence.

[34]  Clay M. Thompson,et al.  Image processing toolbox [for use with Matlab] , 1995 .

[35]  Per-Erik Danielsson Reply to “Comments on a new shape factor” , 1978 .

[36]  Domingo Mery,et al.  The automatic sorting using image processing improves postharvest blueberries storage quality , 2011 .

[37]  F. Mendoza,et al.  Determination of senescent spotting in banana (Musa cavendish) using fractal texture Fourier image , 2008 .

[38]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[39]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[40]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Whoi-Yul Kim,et al.  Real-time detection of foreign objects using X-ray imaging for dry food manufacturing line , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[42]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[43]  Ta-Te Lin,et al.  An adaptive image segmentation algorithm for X-ray quarantine inspection of selected fruits , 2008 .

[44]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[45]  Shuicheng Yan,et al.  Discriminative local binary patterns for human detection in personal album , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[47]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[48]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[49]  Joseph Maria Kumar Irudayaraj,et al.  Nondestructive Testing of Food Quality , 2007 .

[50]  Ajay Kumar,et al.  Defect detection in textured materials using Gabor filters , 2000, Conference Record of the 2000 IEEE Industry Applications Conference. Thirty-Fifth IAS Annual Meeting and World Conference on Industrial Applications of Electrical Energy (Cat. No.00CH37129).

[51]  Vincent Leemans,et al.  A real-time grading method of apples based on features extracted from defects , 2004 .

[52]  Rama Chellappa,et al.  Fourier Coding of Image Boundaries , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  David G. Stork,et al.  Pattern Classification , 1973 .

[54]  Aldo Cipriano,et al.  Quality classification of corn tortillas using computer vision , 2010 .

[55]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[56]  Aldo Cipriano,et al.  Automated fish bone detection using X-ray imaging , 2011 .

[57]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[58]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[59]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[60]  J. Blasco,et al.  Comparison of three algorithms in the classification of table olives by means of computer vision , 2004 .

[61]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[62]  Kezhi Mao,et al.  Identifying critical variables of principal components for unsupervised feature selection , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[63]  Da-Wen Sun,et al.  Inspecting pizza topping percentage and distribution by a computer vision method , 2000 .