Networks of transform-based evolvable features for object recognition

We propose an evolutionary feature creator (EFC) to explore a non-linear and offline method for generating features in image recognition tasks. Our model aims at extracting low-level features automatically when provided with an arbitrary image database. In this work, we are concerned with the addition of algorithmic depth to a genetic programming (GP) system, hypothesizing that it will improve the capacity for solving problems that require high-level, hierarchical reasoning. For this we introduce a network superstructure that co-evolves with our low-level GP representations. Two approaches are described: the first uses our previously used "shallow" GP system, the second presents a new "deep" GP system that involves this network superstructure. We evaluate these models against a benchmark object recognition database. Results show that the deep structure outperforms the shallow one in generating features that support classification, and does so without requiring significant additional computational time. Further, high accuracy is achieved on the standard ETH-80 classification task, also outperforming many existing specialized techniques. We conclude that our EFC is capable of data-driven extraction of useful features from an object recognition database.

[1]  Mengjie Zhang,et al.  Automatic feature extraction and image classification using genetic programming , 2011, The 5th International Conference on Automation, Robotics and Applications.

[2]  Asoke K. Nandi,et al.  Feature generation using genetic programming with application to fault classification , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Yang Zhao,et al.  Perceptually motivated morphological strategies for shape retrieval , 2012, Pattern Recognit..

[4]  Brian J. Ross,et al.  Hyperspectral image analysis using genetic programming , 2002, Appl. Soft Comput..

[5]  Tony Lindeberg,et al.  Composed complex-cue histograms: An investigation of the information content in receptive field based image descriptors for object recognition , 2012, Comput. Vis. Image Underst..

[6]  Yoshua Bengio,et al.  Scaling learning algorithms towards AI , 2007 .

[7]  Jon McCormack,et al.  Evolutionary automated recognition and characterization of an individual's artistic style , 2010, IEEE Congress on Evolutionary Computation.

[8]  Barbara Caputo,et al.  Cue integration through discriminative accumulation , 2004, CVPR 2004.

[9]  Mengjie Zhang,et al.  Overview of Object Detection and Image Analysis by Means of Genetic Programming Techniques , 2007, 2007 Frontiers in the Convergence of Bioscience and Information Technologies.

[10]  Bernt Schiele,et al.  Analyzing contour and appearance based methods for object categorization , 2003, CVPR 2003.

[11]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[13]  Nojun Kwak,et al.  Feature extraction for one-class classification problems: Enhancements to biased discriminant analysis , 2009, Pattern Recognit..

[14]  Bernt Schiele,et al.  Active Metric Learning for Object Recognition , 2012, DAGM/OAGM Symposium.

[15]  Ian Witten,et al.  Data Mining , 2000 .

[16]  Wolfgang Banzhaf,et al.  The unconstrained automated generation of cell image features for medical diagnosis , 2012, GECCO '12.

[17]  Jürgen Leitner,et al.  An Integrated, Modular Framework for Computer Vision and Cognitive Robotics Research (icVision) , 2012, BICA.

[18]  Victor Ciesielski,et al.  Texture Segmentation by Genetic Programming , 2008, Evolutionary Computation.

[19]  Haibin Ling,et al.  Shape Classification Using the Inner-Distance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Tomoharu Nagao,et al.  Genetic Image Network for Image Classification , 2009, EvoWorkshops.

[21]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[22]  Leonardo Trujillo,et al.  Automated Design of Image Operators that Detect Interest Points , 2008, Evolutionary Computation.

[23]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  John Yen,et al.  Evolutionary based feature extraction with dynamic mutation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[25]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  V. Shanthi,et al.  Wavelet Based Features for Ultrasound Placenta Images Classification , 2009, 2009 Second International Conference on Emerging Trends in Engineering & Technology.

[28]  Wolfgang Banzhaf,et al.  Image Processing and CGP , 2011, Cartesian Genetic Programming.

[29]  Conor Ryan,et al.  Pragmatic Genetic Programming strategy for the problem of vehicle detection in airborne reconnaissance , 2006, Pattern Recognit. Lett..

[30]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[31]  Mark Johnston,et al.  Genetic programming for edge detection: A global approach , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[32]  Joachim Denzler,et al.  A Comparison of Nearest Neighbor Search Algorithms for Generic Object Recognition , 2006, ACIVS.

[33]  Paul L. Rosin,et al.  IMAGE THRESHOLDING FOR LANDSLIDE DETECTION BY GENETIC PROGRAMMING , 2002 .

[34]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[35]  W. Banzhaf,et al.  1 Linear Genetic Programming , 2007 .

[36]  Domingo Mery,et al.  Learning discriminative local binary patterns for face recognition , 2011, Face and Gesture 2011.

[37]  Nawwaf N. Kharma,et al.  Evolving novel image features using Genetic Programming-based image transforms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[38]  Jie Yao,et al.  Project CellNet: Evolving An Autonomous Pattern Recognizer , 2004, Int. J. Pattern Recognit. Artif. Intell..