Genetic Programming for Object Detection : a Two-Phase Approach with an Improved Fitness Function

This paper describes two innovations that improve the efficiency and effectiveness of a genetic programming approach to object detection problems. The approach uses genetic programming to construct object detection programs that are applied, in a moving window fashion, to the large images to locate the objects of interest. The first innovation is to break the GP search into two phases with the first phase applied to a selected subset of the training data, and a simplified fitness function. The second phase is initialised with the programs from the first phase, and uses the full set of training data with a complete fitness function to construct the final detection programs. The second innovation is to add a program size component to the fitness function. This approach is examined and compared with a neural network approach on three object detection problems of increasing difficulty. The results suggest that the innovations increase both the effectiveness and the efficiency of the genetic programming search, and also that the genetic programming approach outperforms a neural network approach for the most difficult data set in terms of the object detection accuracy.

[1]  Bangalore S. Manjunath,et al.  Genetic Programming for Object Detection , 1996 .

[2]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[3]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[4]  Vic Ciesielski,et al.  Representing classification problems in genetic programming , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[5]  Andy Song,et al.  Fast texture segmentation using genetic programming , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[6]  Peter Nordin,et al.  Programmatic compression of images and sound , 1996 .

[7]  Daniel Howard,et al.  Target detection in SAR imagery by genetic programming , 1999 .

[8]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Walter Alden Tackett,et al.  Recombination, selection, and the genetic construction of computer programs , 1994 .

[10]  John R. Koza,et al.  Simultaneous Discovery of Reusable Detectors and Subroutines Using Genetic Programming , 1993, ICGA.

[11]  Victor Ciesielski,et al.  An evolutionary approach to training feedforward and recurrent neural networks , 1998, 1998 Second International Conference. Knowledge-Based Intelligent Electronic Systems. Proceedings KES'98 (Cat. No.98EX111).

[12]  I. Guyon,et al.  Handwritten digit recognition: applications of neural network chips and automatic learning , 1989, IEEE Communications Magazine.

[13]  Malur K. Sundareshan,et al.  Data fusion and tracking of complex target maneuvers with a simplex-trained neural network-based architecture , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[14]  Jeng-Sheng Huang,et al.  Object recognition using genetic algorithms with a Hopfield's neural model , 1997 .

[15]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[16]  Astro Teller,et al.  PADO: Learning Tree Structured Algorithms for Orchestration into an Object Recognition System , 1995 .

[17]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[18]  Robert J. Marks,et al.  Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks , 1999 .

[19]  David G. Lowe,et al.  Multiclass Object Recognition with Sparse, Localized Features , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Paul McIlroy,et al.  Exploring some Commercial Applications of Genetic Programming , 1995, Evolutionary Computing, AISB Workshop.

[21]  Christian W. Omlin,et al.  A hybrid system for signature verification , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[22]  Conor Ryan,et al.  The Boru Data Crawler for Object Detection Tasks in Machine Vision , 2002, EvoWorkshops.

[23]  Shahab Sokhansanj,et al.  Discrimination of Hard-to-pop Popcorn Kernels by Machine Vision and Neural Networks , 2005 .

[24]  Ayanna M. Howard,et al.  A multi-stage neural network for automatic target detection , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[25]  Peter G. Korning,et al.  Training neural networks by means of genetic algorithms working on very long chromosomes , 1995, Int. J. Neural Syst..

[26]  Victor Ciesielski,et al.  Towards Genetic Programming for Texture Classification , 2001, Australian Joint Conference on Artificial Intelligence.

[27]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[28]  Victor Ciesielski,et al.  Genetic Programming for Multiple Class Object Detection , 1999, Australian Joint Conference on Artificial Intelligence.

[29]  Günther Palm,et al.  Orientation Histograms for Face Recognition , 2006, ANNPR.

[30]  Wolfgang Banzhaf,et al.  Linear-Graph GP - A New GP Structure , 2002, EuroGP.

[31]  Vic Ciesielski,et al.  Texture classifiers generated by genetic programming , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[32]  Terence Soule,et al.  Effects of Code Growth and Parsimony Pressure on Populations in Genetic Programming , 1998, Evolutionary Computation.

[33]  Victor Ciesielski,et al.  Understanding Evolved Genetic Programs for a Real World Object Detection Problem , 2005, EuroGP.

[34]  Mengjie Zhang,et al.  Multiclass Object Classification Using Genetic Programming , 2004, EvoWorkshops.

[35]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[36]  Mengjie Zhang,et al.  Pixel Statistics and False Alarm Area in Genetic Programming for Object Detection , 2003, EvoWorkshops.

[37]  Victor Ciesielski,et al.  Texture analysis by genetic programming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[38]  Jerzy W. Bala,et al.  Using Learning to Facilitate the Evolution of Features for Recognizing Visual Concepts , 1996, Evolutionary Computation.

[39]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[40]  Margaret H. Dunham,et al.  Data Mining: Introductory and Advanced Topics , 2002 .

[41]  David Andre,et al.  Automatically defined features: the simultaneous evolution of 2-dimensional feature detectors and an algorithm for using them , 1994 .

[42]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[43]  Brijesh Verma.  A neural network based technique to locate and classify microcalcifications in digital mammograms , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[44]  R. Poli.  Genetic programming for image analysis , 1996 .

[45]  Walter F. Bischof,et al.  Machine Learning and Image Interpretation , 1997, Advances in Computer Vision and Machine Intelligence.

[46]  Victor Ciesielski,et al.  Using Back Propagation Algorithm and Genetic Algorithm to Train and Refine Neural Networks for Object Detection , 1999, DEXA.

[47]  Mats G. Nordahl,et al.  Stereoscopic Vision for a Humanoid Robot Using Genetic Programming , 2000, EvoWorkshops.

[48]  Krister Wolff,et al.  Evolving 3D model interpretation of images using graphics hardware , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[49]  Alice J. O'Toole,et al.  CATEGORIZATION AND IDENTIFICATION OF HUMAN FACE IMAGES BY NEURAL NETWORKS: A REVIEW OF THE LINEAR AUTOASSOCIATIVE AND PRINCIPAL COMPONENT APPROACHES , 1994 .

[50]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[51]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[52]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[53]  Qiang Huang,et al.  Underwater target classification using wavelet packets and neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[54]  Stefan Roth,et al.  Applications of multi-objective structure optimization , 2006, ESANN.

[55]  Pietro Perona,et al.  Combining generative models and Fisher kernels for object recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[56]  Jason M. Daida,et al.  Genetic Programming for Automatic Target Classification and Recognition , 1998, Evolutionary Programming.

[57]  Christoph Stahl,et al.  Advanced automatic target recognition for police helicopter missions , 2000, SPIE Defense + Commercial Sensing.

[58]  Mark E. Roberts,et al.  Cooperative Coevolution of Image Feature Construction and Object Detection , 2004, PPSN.

[59]  Riccardo Poli,et al.  Genetic Programming for Feature Detection and Image Segmentation , 1996, Evolutionary Computing, AISB Workshop.

[60]  Mohan M. Trivedi,et al.  A neural network filter to detect small targets in high clutter backgrounds , 1995, IEEE Trans. Neural Networks.

[61]  Jitendra Malik,et al.  SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[62]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[63]  Manuela M. Veloso,et al.  A Contolled Experiment: Evolution for Learning Difficult Image Classification , 1995, EPIA.