Feature Learning for Image Classification Via Multiobjective Genetic Programming

Feature extraction is the first and most critical step in image classification. Most existing image classification methods use hand-crafted features, which are not adaptive for different image domains. In this paper, we develop an evolutionary learning methodology to automatically generate domain-adaptive global feature descriptors for image classification using multiobjective genetic programming (MOGP). In our architecture, a set of primitive 2-D operators are randomly combined to construct feature descriptors through the MOGP evolving and then evaluated by two objective fitness criteria, i.e., the classification error and the tree complexity. After the entire evolution procedure finishes, the best-so-far solution selected by the MOGP is regarded as the (near-)optimal feature descriptor obtained. To evaluate its performance, the proposed approach is systematically tested on the Caltech-101, the MIT urban and nature scene, the CMU PIE, and Jochen Triesch Static Hand Posture II data sets, respectively. Experimental results verify that our method significantly outperforms many state-of-the-art hand-designed features and two feature learning techniques in terms of classification accuracy.

[1]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[2]  John R. Koza,et al.  Evolution of Subsumption Using Genetic Programming , 1993 .

[3]  Abdesselam Bouzerdoum,et al.  Automatic selection of features for classification using genetic programming , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[4]  R. Poli Genetic programming for image analysis , 1996 .

[5]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[6]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[7]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[8]  Jitendra Malik,et al.  Shape Context: A New Descriptor for Shape Matching and Object Recognition , 2000, NIPS.

[9]  Martijn C. J. Bot Feature Extraction for the k-Nearest Neighbour Classifier with Genetic Programming , 2001, EuroGP.

[10]  Anil K. Jain,et al.  Image classification for content-based indexing , 2001, IEEE Trans. Image Process..

[11]  Jochen Triesch,et al.  A System for Person-Independent Hand Posture Recognition against Complex Backgrounds , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[14]  Sean Luke,et al.  Lexicographic Parsimony Pressure , 2002, GECCO.

[15]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Bernt Schiele,et al.  A Semantic Typicality Measure for Natural Scene Categorization , 2004, DAGM-Symposium.

[17]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[18]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[19]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[21]  Asoke K. Nandi,et al.  Feature generation using genetic programming with application to fault classification , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[24]  Yang Zhang,et al.  Feature Extraction Using Multi-Objective Genetic Programming , 2006, Multi-Objective Machine Learning.

[25]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[26]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[27]  Fei-Fei Li,et al.  What, where and who? Classifying events by scene and object recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[28]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[29]  Edward A. Fox,et al.  A genetic programming framework for content-based image retrieval , 2009, Pattern Recognit..

[30]  Lianwen Jin,et al.  A novel feature extraction method using Pyramid Histogram of Orientation Gradients for smile recognition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[31]  Noboru Ohnishi,et al.  Multi-Objective Genetic Programming with Redundancy-Regulations for Automatic Construction of Image Feature Extractors , 2010, IEICE Trans. Inf. Syst..

[32]  Dacheng Tao,et al.  Biologically Inspired Feature Manifold for Scene Classification , 2010, IEEE Transactions on Image Processing.

[33]  Alex A. Freitas,et al.  Evolutionary Computation , 2002 .

[34]  Krista A. Ehinger,et al.  SUN database: Large-scale scene recognition from abbey to zoo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[36]  Mark Johnston,et al.  Multi-Objective Genetic Programming for object detection , 2010, IEEE Congress on Evolutionary Computation.

[37]  Daniel L. Rubin,et al.  Managing Biomedical Image Metadata for Search and Retrieval of Similar Images , 2011, Journal of Digital Imaging.

[38]  James M. Rehg,et al.  CENTRIST: A Visual Descriptor for Scene Categorization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[40]  Hui Wei,et al.  Compact Image Representation Model Based on Both nCRF and Reverse Control Mechanisms , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[41]  João Ranhel,et al.  Neural Assembly Computing , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[42]  V. P. Pawar A Different Scenario of Neural Network Algorithms towards Face Expression in Human Computer Interaction , 2012 .

[43]  Nick Barnes,et al.  Fast and Robust Object Detection Using Asymmetric Totally Corrective Boosting , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Jian Yang,et al.  Sparse Tensor Discriminant Color Space for Face Verification , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Leonardo Trujillo,et al.  Interest point detection through multiobjective genetic programming , 2012, Appl. Soft Comput..

[46]  Ling Shao,et al.  Building holistic descriptors for scene recognition: a multi-objective genetic programming approach , 2013, MM '13.