Genetic Programming for Automatic Global and Local Feature Extraction to Image Classification

Feature extraction is an essential process to image classification. Existing feature extraction methods can extract important and discriminative image features but often require domain expert and human intervention. Genetic Programming (GP) can automatically extract features which are more adaptive to different image classification tasks. However, the majority GP-based methods only extract relatively simple features of one type i.e. local or global, which are not effective and efficient for complex image classification. In this paper, a new GP method (GP-GLF) is proposed to achieve automatically and simultaneously global and local feature extraction to image classification. To extract discriminative image features, several effective and well-known feature extraction methods, such as HOG, SIFT and LBP, are employed as GP functions in global and local scenarios. A novel program structure is developed to allow GP-GLF to evolve descriptors that can synthesise feature vectors from the input image and the automatically detected regions using these functions. The performance of the proposed method is evaluated on four different image classification data sets of varying difficulty and compared with seven GP based methods and a set of non-GP methods. Experimental results show that the proposed method achieves significantly better or similar performance than almost all the peer methods. Further analysis on the evolved programs shows the good interpretability of the GP-GLF method.

[1]  Derek Anderson,et al.  Genetic prOgramming for image feature descriptor learning , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[2]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[3]  David J. Kriegman,et al.  The yale face database , 1997 .

[4]  Mengjie Zhang,et al.  Genetic programming for evolving figure-ground segmentors from multiple features , 2017, Appl. Soft Comput..

[5]  Bing Xue,et al.  Genetic Programming for Region Detection, Feature Extraction, Feature Construction and Classification in Image Data , 2016, EuroGP.

[6]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[7]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[8]  Ling Shao,et al.  Feature Learning for Image Classification Via Multiobjective Genetic Programming , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Dong ping Tian,et al.  A Review on Image Feature Extraction and Representation Techniques , 2013 .

[10]  Osmar R. Zaïane,et al.  Application of Data Mining Techniques for Medical Image Classification , 2001, MDM/KDD.

[11]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[12]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[13]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[14]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[15]  Mark Johnston,et al.  Low-Level Feature Extraction for Edge Detection Using Genetic Programming , 2014, IEEE Transactions on Cybernetics.

[16]  Mengjie Zhang,et al.  Two-Tier genetic programming: towards raw pixel-based image classification , 2012, Expert Syst. Appl..

[17]  Edward A. Fox,et al.  A genetic programming framework for content-based image retrieval , 2009, Pattern Recognit..

[18]  Mengjie Zhang,et al.  Extracting image features for classification by two-tier genetic programming , 2012, 2012 IEEE Congress on Evolutionary Computation.

[19]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[20]  Thomas Walz,et al.  Negative Staining and Image Classification – Powerful Tools in Modern Electron Microscopy , 2004, Biological Procedures Online.

[21]  Hammam A. Alshazly,et al.  Image Features Detection, Description and Matching , 2016 .

[22]  Mengjie Zhang,et al.  An Automatic Feature Extraction Approach to Image Classification Using Genetic Programming , 2018, EvoApplications.

[23]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[24]  Mengjie Zhang,et al.  An automatic region detection and processing approach in genetic programming for binary image classification , 2017, 2017 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[25]  Victor Ciesielski,et al.  Genetic Programming for Multiple Class Object Detection , 1999, Australian Joint Conference on Artificial Intelligence.

[26]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[27]  Alireza Tavakoli Targhi,et al.  THE KTH-TIPS 2 database , 2006 .

[28]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[29]  Harith Al-Sahaf,et al.  Genetic Programming for Automatically Synthesising Robust Image Descriptors with A Small Number of Instances , 2017 .

[30]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[31]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[32]  Mengjie Zhang,et al.  Evolutionary feature manipulation in data mining/big data , 2017, SEVO.

[33]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[34]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Ausama Al-Sahaf,et al.  Automatically Evolving Rotation-Invariant Texture Image Descriptors by Genetic Programming , 2017, IEEE Transactions on Evolutionary Computation.

[36]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Ausama Al-Sahaf,et al.  Keypoints Detection and Feature Extraction: A Dynamic Genetic Programming Approach for Evolving Rotation-Invariant Texture Image Descriptors , 2017, IEEE Transactions on Evolutionary Computation.

[38]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[39]  Tommy W. S. Chow,et al.  A new image classification technique using tree-structured regional features , 2007, Neurocomputing.