Automatic feature extraction and image classification using genetic programming

In this paper, we propose a multilayer domain-independent GP-based approach to feature extraction and image classification. We propose two different structures for the system and compare the results with a baseline approach in which domain-specific pre-extracted features are used for classification. In the baseline approach, human/domain expert intervention is required to perform the task of feature extraction. The proposed approach, however, extracts (evolves) features and generates classifiers all automatically in one loop. The experiments are conducted on four image data sets. The results show that the proposed approach can achieve better performance compared to the baseline while removing the human from the loop.

[1]  Yang Zhang,et al.  A generic optimising feature extraction method using multiobjective genetic programming , 2011, Appl. Soft Comput..

[2]  Mengjie Zhang,et al.  Using Genetic Programming for Multiclass Classification by Simultaneously Solving Component Binary Classification Problems , 2005, EuroGP.

[3]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[4]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Larry Bull,et al.  Genetic Programming with a Genetic Algorithm for Feature Construction and Selection , 2005, Genetic Programming and Evolvable Machines.

[6]  Wu Bingfang,et al.  Analysis to the relationship of classification accuracy, segmentation scale, image resolution , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[7]  Asoke K. Nandi,et al.  Feature generation using genetic programming with application to fault classification , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Tomoyuki Hiroyasu,et al.  Comparison of GP and SAP in the image-processing filter construction using pathology images , 2010, 2010 3rd International Congress on Image and Signal Processing.

[9]  Bir Bhanu,et al.  Object detection in multi-modal images using genetic programming , 2004, Appl. Soft Comput..

[10]  Abdesselam Bouzerdoum,et al.  Automatic selection of features for classification using genetic programming , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[11]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jason M. Daida,et al.  Genetic Programming for Automatic Target Classification and Recognition , 1998, Evolutionary Programming.

[13]  Adrian F. Clark,et al.  Feature Extraction and Classification by Genetic Programming , 2008, ICVS.

[14]  Bir Bhanu,et al.  Object detection via feature synthesis using MDL-based genetic programming , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[16]  Mengjie Zhang,et al.  Genetic Programming for Object Detection: Improving Fitness Functions and Optimising Training Data , 2006, IEEE Intell. Informatics Bull..

[17]  Raymond H. Chan,et al.  Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization , 2005, IEEE Transactions on Image Processing.

[18]  Kah Kay Sung,et al.  Learning and example selection for object and pattern detection , 1995 .

[19]  Bir Bhanu,et al.  Evolutionary feature synthesis for object recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Neal R. Harvey,et al.  Feature extraction from multiple data sources using genetic programming , 2002, SPIE Defense + Commercial Sensing.

[21]  Nawwaf N. Kharma,et al.  Evolving novel image features using Genetic Programming-based image transforms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[22]  Mark Johnston,et al.  Genetic Programming for Classification with Unbalanced Data , 2010, EuroGP.

[23]  Asoke K. Nandi,et al.  Breast Cancer Diagnosis Using Genetic Programming Generated Feature , 2005, 2005 IEEE Workshop on Machine Learning for Signal Processing.

[24]  Abderrahim Elmoataz,et al.  A color object recognition scheme: application to cellular sorting , 2003, Machine Vision and Applications.

[25]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[26]  Alistair G. Rust,et al.  Image redundancy reduction for neural network classification using discrete cosine transforms , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[27]  Heaton T. Jeff,et al.  Introduction to Neural Networks with Java , 2005 .

[28]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[29]  Victor Ciesielski,et al.  Discovery of Human-Competitive Image Texture Feature Extraction Programs Using Genetic Programming , 2004, GECCO.

[30]  Mengjie Zhang,et al.  Classification Strategies for Image Classification in Genetic Programming , 2003 .