Distribution-based invariant feature construction using genetic programming for edge detection

In edge detection, constructing features with rich responses on different types of edges is a challenging problem. Genetic programming (GP) has been previously employed to construct features. Normally, the values of the features constructed by GP are calculated from raw observations. Some existing work has considered the distributions of the raw observations, but these features only poorly indicate class label probabilities. To construct features with rich responses on different types of edges, the distributions of the observations from GP programs are investigated in this study. The values of the constructed features are obtained from estimated distributions, rather than directly using the observations. These features themselves indicate probabilities for the target labels. Basic rotation-invariant features from gradients, image quality, and local histograms are used to construct new composite features. The results show that the invariant features constructed by GP combine advantages from the basic features, reduce drawbacks from basic features alone, and improve the detection performance. In terms of the quantitative and qualitative evaluations, features constructed by GP with distribution estimation are better than the combinations from a Bayesian model and a linear support vector machine approach.

[1]  Mark Johnston,et al.  Genetic programming for edge detection using blocks to extract features , 2012, GECCO '12.

[2]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Mark Johnston,et al.  A Hybrid Particle Swarm Optimisation with Differential Evolution Approach to Image Segmentation , 2011, EvoApplications.

[4]  Domenec Puig,et al.  A new methodology for evaluation of edge detectors , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Mengjie Zhang,et al.  A Filter Approach to Multiple Feature Construction for Symbolic Learning Classifiers Using Genetic Programming , 2012, IEEE Transactions on Evolutionary Computation.

[6]  W. Kruskal Historical Notes on the Wilcoxon Unpaired Two-Sample Test , 1957 .

[7]  Francisco López-Ferreras,et al.  Edge Detection in Noisy Images Using the Support Vector Machines , 2001, IWANN.

[8]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[9]  Mengjie Zhang,et al.  Using Gaussian distribution to construct fitness functions in genetic programming for multiclass object classification , 2006, Pattern Recognit. Lett..

[10]  Pritimoy Bhattacharyya,et al.  Edge detection in untextured and textured images-a common computational framework , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Joe-Air Jiang,et al.  Mathematical-morphology-based edge detectors for detection of thin edges in low-contrast regions , 2007 .

[12]  Humberto Bustince,et al.  Quantitative error measures for edge detection , 2013, Pattern Recognit..

[13]  Mitra Basu,et al.  Gaussian-based edge-detection methods - a survey , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[14]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  Lei Zhang,et al.  Canny edge detection enhancement by scale multiplication , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Mark Johnston,et al.  Developing New Fitness Functions in Genetic Programming for Classification With Unbalanced Data , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Mark Johnston,et al.  Genetic programming for edge detection via balancing individual training images , 2012, 2012 IEEE Congress on Evolutionary Computation.

[18]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Mark Johnston,et al.  Automatic Construction of Invariant Features Using Genetic Programming for Edge Detection , 2012, Australasian Conference on Artificial Intelligence.

[21]  Bir Bhanu,et al.  Fingerprint classification based on learned features , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[22]  G. Rezai-Rad,et al.  A New Investigation on Edge detection Filters Operation for Feature Extraction under Histogram Equalization Effect , 2007, Geometric Modeling and Imaging (GMAI '07).

[23]  Nicolai Petkov,et al.  Edge and line oriented contour detection: State of the art , 2011, Image Vis. Comput..

[24]  Moshe Sipper,et al.  Evolution of a local boundary detector for natural images via genetic programming and texture cues , 2009, GECCO.

[25]  King Ngi Ngan,et al.  Predictive classified vector quantization , 1992, IEEE Trans. Image Process..

[26]  Asoke K. Nandi,et al.  Breast Cancer Diagnosis Using Genetic Programming Generated Feature , 2005 .

[27]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[28]  Yang Zhang,et al.  Applying Cost-Sensitive Multiobjective Genetic Programming to Feature Extraction for Spam E-mail Filtering , 2008, EuroGP.

[29]  Mengjie Zhang,et al.  Using Genetic Programming for Multiclass Classification by Simultaneously Solving Component Binary Classification Problems , 2005, EuroGP.

[30]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[32]  John D. Spurrier,et al.  On the null distribution of the Kruskal–Wallis statistic , 2003 .

[33]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[34]  R. Poli Genetic programming for image analysis , 1996 .

[35]  Alan L. Yuille,et al.  Statistical Edge Detection: Learning and Evaluating Edge Cues , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[37]  Yang Zhang,et al.  Evolving optimal feature extraction using multi-objective genetic programming: a methodology and preliminary study on edge detection , 2005, GECCO '05.

[38]  Nicolai Petkov,et al.  Contour and boundary detection improved by surround suppression of texture edges , 2004, Image Vis. Comput..

[39]  Mark Johnston,et al.  Soft edge maps from edge detectors evolved by genetic programming , 2012, 2012 IEEE Congress on Evolutionary Computation.

[40]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[41]  S. J. Jang,et al.  Comparison of two‐sample tests for edge detection in noisy images , 2002 .

[42]  Alessandro Neri,et al.  A Biologically Motivated Multiresolution Approach to Contour Detection , 2007, EURASIP J. Adv. Signal Process..

[43]  David G. Stork,et al.  Pattern Classification , 1973 .

[44]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Bernard F. Buxton,et al.  Evolving edge detectors with genetic programming , 1996 .

[46]  Francisco José Madrid-Cuevas,et al.  Automatic generation of consensus ground truth for the comparison of edge detection techniques , 2008, Image Vis. Comput..