Optimizing Feature Calculation in Adaptive Machine Vision Systems

A classifier’s accuracy substantially depends on the features that are utilized to characterize an input sample. The selection of a representative and—ideally—small set of features that yields high discriminative power is an important step in setting up a classification system. The features are a set of functions that transform the raw input data (an image in the case of machine vision systems) into a vector of real numbers. This transformation may be a quite complex algorithm, with lots of parameters to tune and consequently with much room for optimization. In order to efficiently use this additional room for optimizing the features, we propose an integrated optimization step that adapts the feature parameters in such a way that the separation of the classes in feature space is improved, thus reducing the number of misclassifications. Furthermore, these optimization techniques may be used to “shape” the decision boundary in such a way that it can be easily modeled by a classifier. After covering the relevant elements of the theory behind this automatic feature optimization process, we will demonstrate and assess the performance on two typical machine vision applications. The first one is a quality control task, where different types of defects need to be distinguished, and the second example is a texture classification problem as it appears in image segmentation tasks. We will show how the optimization process can be successfully applied in morphological and textural features that both offer a number of parameters to tune and select.

[1]  M.R. Azimi-Sadjadi,et al.  Adaptive feature mapping for underwater target classification , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[2]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[3]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[4]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[5]  Du-Ming Tsai,et al.  Optimal Gabor filter design for texture segmentation using stochastic optimization , 2001, Image Vis. Comput..

[6]  Yanxi Liu,et al.  Online selection of discriminative tracking features , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[8]  David G. Stork,et al.  Pattern Classification , 1973 .

[9]  Li Ma,et al.  Optimum Gabor filter design and local binary patterns for texture segmentation , 2008, Pattern Recognit. Lett..

[10]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[11]  William E. Higgins,et al.  Texture Segmentation using 2-D Gabor Elementary Functions , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Abdelmonem A. Afifi,et al.  Comparison of Stopping Rules in Forward Stepwise Discriminant Analysis , 1979 .

[13]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[14]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[15]  Lluís A. Belanche Muñoz,et al.  Feature selection algorithms: a survey and experimental evaluation , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[16]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Kyongmo Koo,et al.  Natural / Man-Made Object Classification Based on Gabor Characteristics , 2005, CIVR.

[18]  David J. Hand,et al.  Discrimination and Classification , 1982 .

[19]  Tyng-Luh Liu,et al.  Probabilistic tracking with adaptive feature selection , 2004, ICPR 2004.

[20]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[21]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[22]  Lawrence Carin,et al.  A Bayesian approach to joint feature selection and classifier design , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[24]  Wolfgang Heidl,et al.  A Quantitative Evaluation of Texture Feature Robustness and Interpolation Behaviour , 2009, CAIP.

[25]  Michael Lindenbaum,et al.  Optimizing Gabor Filter Design for Texture Edge Detection and Classification , 2009, International Journal of Computer Vision.

[26]  Ian Burns,et al.  Measuring texture classification algorithms , 1997, Pattern Recognit. Lett..

[27]  Hans Burkhardt,et al.  Feature Selection for Retrieval Purposes , 2006, ICIAR.

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  Claire Cardie,et al.  Using Decision Trees to Improve Case-Based Learning , 1993, ICML.