Automatically Evolving Rotation-Invariant Texture Image Descriptors by Genetic Programming

In computer vision, training a model that performs classification effectively is highly dependent on the extracted features, and the number of training instances. Conventionally, feature detection and extraction are performed by a domain expert who, in many cases, is expensive to employ and hard to find. Therefore, image descriptors have emerged to automate these tasks. However, designing an image descriptor still requires domain-expert intervention. Moreover, the majority of machine learning algorithms require a large number of training examples to perform well. However, labeled data is not always available or easy to acquire, and dealing with a large dataset can dramatically slow down the training process. In this paper, we propose a novel genetic programming-based method that automatically synthesises a descriptor using only two training instances per class. The proposed method combines arithmetic operators to evolve a model that takes an image and generates a feature vector. The performance of the proposed method is assessed using six datasets for texture classification with different degrees of rotation and is compared with seven domain-expert designed descriptors. The results show that the proposed method is robust to rotation and has significantly outperformed, or achieved a comparable performance to, the baseline methods.

[1]  Bo Yang,et al.  A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image , 2013, Neurocomputing.

[2]  Swati Goel,et al.  A Survey on Recent Image Indexing and Retrieval Techniques for Low-Level Feature Extraction in CBIR Systems , 2015, 2015 IEEE International Conference on Computational Intelligence & Communication Technology.

[3]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ling Shao,et al.  Feature Learning for Image Classification Via Multiobjective Genetic Programming , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[7]  Murray Shanahan,et al.  Flexible object recognition in cluttered scenes using relative point distribution models , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Daniela M. Witten,et al.  An Introduction to Statistical Learning: with Applications in R , 2013 .

[9]  Yaochu Jin,et al.  Evolutionary Multiobjective Image Feature Extraction in the Presence of Noise , 2015, IEEE Transactions on Cybernetics.

[10]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[11]  Ling Shao,et al.  Learning Spatio-Temporal Representations for Action Recognition: A Genetic Programming Approach , 2016, IEEE Transactions on Cybernetics.

[12]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[13]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[14]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[15]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.

[17]  Loris Nanni,et al.  A simple method for improving local binary patterns by considering non-uniform patterns , 2012, Pattern Recognit..

[18]  Alexander Kadyrov,et al.  The Trace Transform and Its Applications , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Gustavo Olague,et al.  Evolutionary learning of local descriptor operators for object recognition , 2009, GECCO.

[20]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[21]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[22]  Vic Ciesielski,et al.  Representing classification problems in genetic programming , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[23]  Xudong Jiang,et al.  LBP-Based Edge-Texture Features for Object Recognition , 2014, IEEE Transactions on Image Processing.

[24]  Leonardo Trujillo,et al.  A Genetic Programming Approach to the Design of Interest Point Operators , 2009, Bio-inspired Hybrid Intelligent Systems for Image Analysis and Pattern Recognition.

[25]  Taha H. Rassem,et al.  Completed Local Ternary Pattern for Rotation Invariant Texture Classification , 2014, TheScientificWorldJournal.

[26]  Bo Yang,et al.  Building Image Feature Kinetics for Cement Hydration Using Gene Expression Programming With Similarity Weight Tournament Selection , 2015, IEEE Transactions on Evolutionary Computation.

[27]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[28]  Mengjie Zhang,et al.  Extracting image features for classification by two-tier genetic programming , 2012, 2012 IEEE Congress on Evolutionary Computation.

[29]  Mark Johnston,et al.  Genetic Programming Evolved Filters from a Small Number of Instances for Multiclass Texture Classification , 2014, IVCNZ '14.

[30]  Mengjie Zhang,et al.  Two-Tier genetic programming: towards raw pixel-based image classification , 2012, Expert Syst. Appl..

[31]  Stephan Trenn,et al.  Multilayer Perceptrons: Approximation Order and Necessary Number of Hidden Units , 2008, IEEE Transactions on Neural Networks.

[32]  Victor Ciesielski,et al.  Texture analysis by genetic programming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[33]  Rajeev Kumar Singh,et al.  A Survey of Recent and Classical Image Registration Methods , 2014 .

[34]  Mengjie Zhang,et al.  Distribution-based invariant feature construction using genetic programming for edge detection , 2014, Soft Computing.

[35]  Nathan S. Netanyahu,et al.  Image Registration of Very Large Images via Genetic Programming , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[36]  Mengjie Zhang,et al.  Classification Strategies for Image Classification in Genetic Programming , 2003 .

[37]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[38]  Barbara Caputo,et al.  The More You Know, the Less You Learn: From Knowledge Transfer to One-shot Learning of Object Categories , 2009, BMVC.

[39]  Po-Whei Huang,et al.  Feature-Based Image Segmentation , 2013 .

[40]  Mark Hoogendoorn,et al.  Parameter Control in Evolutionary Algorithms: Trends and Challenges , 2015, IEEE Transactions on Evolutionary Computation.

[41]  Mark Johnston,et al.  A Variant Program Structure in Tree-Based Genetic Programming for Multiclass Object Classification , 2009 .

[42]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[43]  Suganya Ramamoorthy,et al.  Texture Feature Extraction Using MGRLBP Method for Medical Image Classification , 2015 .

[44]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[45]  Victor Ciesielski,et al.  Texture Segmentation by Genetic Programming , 2008, Evolutionary Computation.

[46]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[47]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[48]  Geoff Holmes,et al.  Multiclass Alternating Decision Trees , 2002, ECML.

[49]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[50]  Leonardo Trujillo,et al.  Automated Design of Image Operators that Detect Interest Points , 2008, Evolutionary Computation.

[51]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Victor Ciesielski,et al.  Genetic Programming for Multiple Class Object Detection , 1999, Australian Joint Conference on Artificial Intelligence.

[53]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[54]  Mengjie Zhang,et al.  Genetic Programming for Object Detection: a Two-phase Approach with an Improved Fitness Function , 2009, Progress in Computer Vision and Image Analysis.

[55]  Mengjie Zhang,et al.  Multiclass object classification for computer vision using Linear Genetic Programming , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[56]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[57]  Riccardo Poli,et al.  Genetic Programming with User-Driven Selection : Experiments on the Evolution of Algorithms for Image Enhancement , 1997 .

[58]  Victor Ciesielski,et al.  Towards Genetic Programming for Texture Classification , 2001, Australian Joint Conference on Artificial Intelligence.

[59]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[60]  Thomas L. Griffiths,et al.  Modeling Transfer Learning in Human Categorization with the Hierarchical Dirichlet Process , 2010, ICML.

[61]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[62]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[63]  Leonardo Trujillo,et al.  Synthesis of interest point detectors through genetic programming , 2006, GECCO.

[64]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[65]  Ian Witten,et al.  Data Mining , 2000 .

[66]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[67]  Mengjie Zhang,et al.  A Supervised Figure-Ground Segmentation Method Using Genetic Programming , 2015, EvoApplications.

[68]  Gustaf Kylberg,et al.  Kylberg Texture Dataset v. 1.0 , 2011 .

[69]  Mengjie Zhang,et al.  Image Segmentation: A Survey of Methods Based on Evolutionary Computation , 2014, SEAL.

[70]  Krzysztof Krawiec,et al.  Evolutionary Synthesis of Pattern Recognition Systems (Monographs in Computer Science) , 2005 .

[71]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[72]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[73]  Hector Perez-Meana,et al.  Object Detection Using SURF and Superpixels , 2013 .

[74]  Mark Johnston,et al.  Automatic Construction of Invariant Features Using Genetic Programming for Edge Detection , 2012, Australasian Conference on Artificial Intelligence.

[75]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[76]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[77]  Mark Johnston,et al.  Image descriptor: A genetic programming approach to multiclass texture classification , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[78]  Andreas Zell,et al.  Evolving Task Specific Image Operator , 1999, EvoWorkshops.

[79]  Gustavo Carneiro,et al.  The distinctiveness, detectability, and robustness of local image features , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[80]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[81]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..