Two-Tier genetic programming: towards raw pixel-based image classification

Classifying images is of great importance in machine vision and image analysis applications such as object recognition and face detection. Conventional methods build classifiers based on certain types of image features instead of raw pixels because the dimensionality of raw inputs is often too large. Determining an optimal set of features for a particular task is usually the focus of conventional image classification methods. In this study we propose a Genetic Programming (GP) method by which raw images can be directly fed as the classification inputs. It is named as Two-Tier GP as every classifier evolved by it has two tiers, the other for computing features based on raw pixel input, one for making decisions. Relevant features are expected to be self-constructed by GP along the evolutionary process. This method is compared with feature based image classification by GP and another GP method which also aims to automatically extract image features. Four different classification tasks are used in the comparison, and the results show that the highest accuracies are achieved by Two-Tier GP. Further analysis on the evolved solutions reveals that there are genuine features formulated by the evolved solutions which can classify target images accurately.

[1]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[2]  Victor Ciesielski,et al.  Discovery of Human-Competitive Image Texture Feature Extraction Programs Using Genetic Programming , 2004, GECCO.

[3]  Yamin Li,et al.  Two improvements in genetic programming for image classification , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[4]  Bir Bhanu,et al.  Object detection via feature synthesis using MDL-based genetic programming , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Asoke K. Nandi,et al.  Breast Cancer Diagnosis Using Genetic Programming Generated Feature , 2005, 2005 IEEE Workshop on Machine Learning for Signal Processing.

[6]  Asoke K. Nandi,et al.  Feature generation using genetic programming with application to fault classification , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Farid Melgani,et al.  Automatic Detection and Classification of Buried Objects in GPR Images Using Genetic Algorithms and Support Vector Machines , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[9]  Abderrahim Elmoataz,et al.  A color object recognition scheme: application to cellular sorting , 2003, Machine Vision and Applications.

[10]  Leonardo Trujillo,et al.  Evolutionary-computer-assisted design of image operators that detect interest points using genetic programming , 2011, Image Vis. Comput..

[11]  Mark Johnston,et al.  Genetic programming for edge detection: A global approach , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[12]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[13]  Victor Ciesielski,et al.  Towards Genetic Programming for Texture Classification , 2001, Australian Joint Conference on Artificial Intelligence.

[14]  Kah Kay Sung,et al.  Learning and example selection for object and pattern detection , 1995 .

[15]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[16]  Riccardo Poli,et al.  Genetic Programming for Feature Detection and Image Segmentation , 1996, Evolutionary Computing, AISB Workshop.

[17]  Nawwaf N. Kharma,et al.  Evolving novel image features using Genetic Programming-based image transforms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[18]  Vic Ciesielski,et al.  Texture classifiers generated by genetic programming , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[19]  Neal R. Harvey,et al.  Feature extraction from multiple data sources using genetic programming , 2002, SPIE Defense + Commercial Sensing.

[20]  Yang Zhang,et al.  Evolving optimal feature extraction using multi-objective genetic programming: a methodology and preliminary study on edge detection , 2005, GECCO '05.

[21]  Adrian F. Clark,et al.  Feature Extraction and Classification by Genetic Programming , 2008, ICVS.

[22]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[23]  Victor Ciesielski,et al.  Texture Segmentation by Genetic Programming , 2008, Evolutionary Computation.

[24]  Mengjie Zhang,et al.  Using Genetic Programming for Multiclass Classification by Simultaneously Solving Component Binary Classification Problems , 2005, EuroGP.

[25]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[26]  Andy Song,et al.  Detecting motion from noisy scenes using Genetic Programming , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[27]  Mark Johnston,et al.  Genetic Programming for Classification with Unbalanced Data , 2010, EuroGP.

[28]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Jefersson Alex dos Santos,et al.  A relevance feedback method based on genetic programming for classification of remote sensing images , 2011, Inf. Sci..