An Effective Feature Learning Approach Using Genetic Programming With Image Descriptors for Image Classification [Research Frontier]

Being able to extract effective features from different images is very important for image classification, but it is challenging due to high variations across images. By integrating existing well-developed feature descriptors into learning algorithms, it is possible to automatically extract informative high-level features for image classification. As a learning algorithm with a flexible representation and good global search ability, genetic programming can achieve this. In this paper, a new genetic programming-based feature learning approach is developed to automatically select and combine five existing well-developed descriptors to extract high-level features for image classification. The new approach can automatically learn various numbers of global and/or local features from different types of images. The results show that the new approach achieves significantly better classification performance in almost all the comparisons on eight data sets of varying difficulty. Further analysis reveals the effectiveness of the new approach to finding the most effective feature descriptors or combinations of them to extract discriminative features for different classification tasks.

[1]  Bing Xue,et al.  Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[2]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[3]  Ausama Al-Sahaf,et al.  Keypoints Detection and Feature Extraction: A Dynamic Genetic Programming Approach for Evolving Rotation-Invariant Texture Image Descriptors , 2017, IEEE Transactions on Evolutionary Computation.

[4]  Tae-Sun Choi,et al.  Genetic programming-based feature transform and classification for the automatic detection of pulmonary nodules on computed tomography images , 2012, Inf. Sci..

[5]  Mengjie Zhang,et al.  Genetic Programming for Automatic Global and Local Feature Extraction to Image Classification , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[6]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[7]  Qingquan Li,et al.  A 3-D Gabor Phase-Based Coding and Matching Framework for Hyperspectral Imagery Classification , 2018, IEEE Transactions on Cybernetics.

[8]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[9]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[12]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[13]  Anderson Rocha,et al.  From impressionism to expressionism: Automatically identifying van Gogh's paintings , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[14]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Bing Xue,et al.  Genetic Programming for Region Detection, Feature Extraction, Feature Construction and Classification in Image Data , 2016, EuroGP.

[16]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[18]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[19]  Ali Ismail Awad,et al.  Image Feature Detectors and Descriptors , 2016 .

[20]  Ling Shao,et al.  Feature Learning for Image Classification Via Multiobjective Genetic Programming , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Ling Shao,et al.  Learning Spatio-Temporal Representations for Action Recognition: A Genetic Programming Approach , 2016, IEEE Transactions on Cybernetics.

[22]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[23]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[24]  Jan-Olof Eklundh,et al.  Computational Vision and Active Perception Laboratory, CVAP , 1998 .

[25]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[26]  Mengjie Zhang,et al.  Genetic programming for skin cancer detection in dermoscopic images , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[27]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[28]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[29]  Mengjie Zhang,et al.  An Automatic Feature Extraction Approach to Image Classification Using Genetic Programming , 2018, EvoApplications.

[30]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[31]  Rangaraj M. Rangayyan,et al.  Classification of breast masses in mammograms using genetic programming and feature selection , 2006, Medical and Biological Engineering and Computing.

[32]  Mengjie Zhang,et al.  Two-Tier genetic programming: towards raw pixel-based image classification , 2012, Expert Syst. Appl..

[33]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[34]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[35]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[36]  Ausama Al-Sahaf,et al.  Automatically Evolving Rotation-Invariant Texture Image Descriptors by Genetic Programming , 2017, IEEE Transactions on Evolutionary Computation.

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Yaochu Jin,et al.  Evolutionary Multiobjective Image Feature Extraction in the Presence of Noise , 2015, IEEE Transactions on Cybernetics.

[39]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).