Evolutionary Image Descriptor: A Dynamic Genetic Programming Representation for Feature Extraction

Texture classification aims at categorising instances that have a similar repetitive pattern. In computer vision, texture classification represents a fundamental element in a wide variety of applications, which can be performed by detecting texture primitives of the different classes. Using image descriptors to detect prominent features has been widely adopted in computer vision. Building an effective descriptor becomes more challenging when there are only a few labelled instances. This paper proposes a new Genetic Programming (GP) representation for evolving an image descriptor that operates directly on the raw pixel values and uses only two instances per class. The new method synthesises a set of mathematical formulas that are used to generate the feature vector, and the classification is then performed using a simple instance-based classifier. Determining the length of the feature vector is automatically handled by the new method. Two GP and nine well-known non-GP methods are compared on two texture image data sets for texture classification in order to test the effectiveness of the proposed method. The proposed method is also compared to three hand-crafted descriptors namely domain-independent features, local binary patterns, and Haralick texture features. The results show that the proposed method has superior performance over the competitive methods.

[1]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[2]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[3]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[4]  Mengjie Zhang,et al.  Genetic programming for improving image descriptors generated using the scale-invariant feature transform , 2012, IVCNZ '12.

[5]  Geoff Holmes,et al.  Multiclass Alternating Decision Trees , 2002, ECML.

[6]  Mark Johnston,et al.  A Variant Program Structure in Tree-Based Genetic Programming for Multiclass Object Classification , 2009 .

[7]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[8]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[9]  Leonardo Trujillo,et al.  Evolutionary-computer-assisted design of image operators that detect interest points using genetic programming , 2011, Image Vis. Comput..

[10]  Mengjie Zhang,et al.  Using Genetic Programming for Multiclass Classification by Simultaneously Solving Component Binary Classification Problems , 2005, EuroGP.

[11]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[12]  Leonardo Trujillo,et al.  Automated Design of Image Operators that Detect Interest Points , 2008, Evolutionary Computation.

[13]  Stephan Trenn,et al.  Multilayer Perceptrons: Approximation Order and Necessary Number of Hidden Units , 2008, IEEE Transactions on Neural Networks.

[14]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[16]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[17]  Konstantinos N. Plataniotis,et al.  Distance measures for color image retrieval , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[18]  Ian Witten,et al.  Data Mining , 2000 .

[19]  Asoke K. Nandi,et al.  Extending genetic programming for multi-class classification by combining K-nearest neighbor , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[20]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[21]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[22]  Victor Ciesielski,et al.  Towards Genetic Programming for Texture Classification , 2001, Australian Joint Conference on Artificial Intelligence.

[23]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[24]  Grant Dick,et al.  Implicitly Controlling Bloat in Genetic Programming , 2010, IEEE Transactions on Evolutionary Computation.

[25]  Gustavo Olague,et al.  Evolutionary learning of local descriptor operators for object recognition , 2009, GECCO.

[26]  Victor Ciesielski,et al.  Genetic Programming for Multiple Class Object Detection , 1999, Australian Joint Conference on Artificial Intelligence.

[27]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[28]  Hamed Kiani Galoogahi,et al.  Shape Classification Using Local and Global Features , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[29]  Yaochu Jin,et al.  Evolutionary Multiobjective Image Feature Extraction in the Presence of Noise , 2015, IEEE Transactions on Cybernetics.

[30]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[31]  Vic Ciesielski,et al.  Representing classification problems in genetic programming , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).