Automatically Evolving Texture Image Descriptors Using the Multitree Representation in Genetic Programming Using Few Instances

The performance of image classification is highly dependent on the quality of the extracted features that are used to build a model. Designing such features usually requires prior knowledge of the domain and is often undertaken by a domain expert who, if available, is very costly to employ. Automating the process of designing such features can largely reduce the cost and efforts associated with this task. Image descriptors, such as local binary patterns, have emerged in computer vision, and aim at detecting keypoints, e.g., corners, line-segments and shapes, in an image and extracting features from those keypoints. In this paper, genetic programming (GP) is used to automatically evolve an image descriptor using only two instances per class by utilising a multi-tree program representation. The automatically evolved descriptor operates directly on the raw pixel values of an image and generates the corresponding feature vector. Seven well-known datasets were adapted to the few-shot setting and used to assess the performance of the proposed method and compared against six hand-crafted and one evolutionary computation-based image descriptor as well as three convolutional neural network (CNN) based methods. The experimental results show that the new method has significantly outperformed the competitor image descriptors and CNN-based methods. Furthermore, different patterns have been identified from analysing the evolved programs.

[1]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[2]  Domagoj Jakobovic,et al.  A survey of dispatching rules for the dynamic unrelated machines environment , 2018, Expert Syst. Appl..

[3]  Luigi P. Cordella,et al.  Genetic programming for generating prototypes in classification problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[4]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[5]  Mengjie Zhang,et al.  Evolving Deep Convolutional Neural Networks for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[6]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[7]  Mengjie Zhang,et al.  Distribution-based invariant feature construction using genetic programming for edge detection , 2014, Soft Computing.

[8]  Peter L. Bartlett,et al.  Vapnik-Chervonenkis dimension of neural nets , 2003 .

[9]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Derek Anderson,et al.  Genetic prOgramming for image feature descriptor learning , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[11]  Paolo Napoletano,et al.  Hand-Crafted vs Learned Descriptors for Color Texture Classification , 2017, CCIW.

[12]  Moshe Sipper,et al.  Evolving Lose-Checkers players using genetic programming , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[13]  Fabrizio Smeraldi,et al.  Comparative Evaluation of Hand-Crafted Image Descriptors vs. Off-the-Shelf CNN-Based Features for Colour Texture Classification under Ideal and Realistic Conditions , 2019, Applied Sciences.

[14]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[15]  Leonardo Trujillo,et al.  Evolutionary-computer-assisted design of image operators that detect interest points using genetic programming , 2011, Image Vis. Comput..

[16]  Ausama Al-Sahaf,et al.  Automatically Evolving Rotation-Invariant Texture Image Descriptors by Genetic Programming , 2017, IEEE Transactions on Evolutionary Computation.

[17]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  Andreas Zell,et al.  Evolving Task Specific Image Operator , 1999, EvoWorkshops.

[19]  Jinung An,et al.  An Approach to Self-Assembling Swarm Robots Using Multitree Genetic Programming , 2013, TheScientificWorldJournal.

[20]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[21]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[22]  Julian Francis Miller,et al.  Redundancy and computational efficiency in Cartesian genetic programming , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Pablo A. Estévez,et al.  Genetic programming-based clustering using an information theoretic fitness measure , 2007, 2007 IEEE Congress on Evolutionary Computation.

[24]  Malay S. Bhatt,et al.  Genetic programming evolved spatial descriptor for Indian monuments classification , 2015, 2015 IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS).

[25]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[26]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[27]  Gustaf Kylberg,et al.  Automatic Virus Identification using TEM : Image Segmentation and Texture Analysis ; Automatisk identifiering av virus med hjälp av transmissionselektronmikroskopi : bildsegmentering och texturanalys , 2014 .

[28]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[29]  Gustavo Olague,et al.  Evolutionary learning of local descriptor operators for object recognition , 2009, GECCO.

[30]  Karen O. Egiazarian,et al.  Dominant Rotated Local Binary Patterns (DRLBP) for texture classification , 2016, Pattern Recognit. Lett..

[31]  Jinung An,et al.  Efficient classification system based on Fuzzy-Rough Feature Selection and Multitree Genetic Programming for intension pattern recognition using brain signal , 2015, Expert Syst. Appl..

[32]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[33]  Gustavo Olague,et al.  Genetic programming as strategy for learning image descriptor operators , 2013, Intell. Data Anal..

[34]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[35]  Xudong Jiang,et al.  LBP-Based Edge-Texture Features for Object Recognition , 2014, IEEE Transactions on Image Processing.

[36]  Samy Bengio,et al.  Large Scale Online Learning of Image Similarity Through Ranking , 2009, J. Mach. Learn. Res..

[37]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[38]  Ling Shao,et al.  Feature Learning for Image Classification Via Multiobjective Genetic Programming , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Taha H. Rassem,et al.  Completed Local Ternary Pattern for Rotation Invariant Texture Classification , 2014, TheScientificWorldJournal.

[40]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[41]  Ida-Maria Sintorn,et al.  Evaluation of noise robustness for local binary pattern descriptors in texture classification , 2013, EURASIP J. Image Video Process..

[42]  Ling Shao,et al.  Learning Spatio-Temporal Representations for Action Recognition: A Genetic Programming Approach , 2016, IEEE Transactions on Cybernetics.

[43]  Robert Sabourin,et al.  Transfer learning between texture classification tasks using Convolutional Neural Networks , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[44]  Bing Xue,et al.  Evolving texture image descriptors using a multitree genetic programming representation , 2017, GECCO.

[45]  Mihai Oltean,et al.  Genetic Programming with Linear Representation: a Survey , 2009, Int. J. Artif. Intell. Tools.

[46]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[47]  Bing Xue,et al.  A Multitree Genetic Programming Representation for Automatically Evolving Texture Image Descriptors , 2017, SEAL.

[48]  Ling Shao,et al.  Genetic Programming-Evolved Spatio-Temporal Descriptor for Human Action Recognition , 2012, BMVC.

[49]  Dah-Jye Lee,et al.  Self-tuned Evolution-COnstructed features for general object recognition , 2012, Pattern Recognit..

[50]  Bo Yang,et al.  A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image , 2013, Neurocomputing.

[51]  Shawn McCann,et al.  Object Detection using Convolutional Neural Networks , 2013 .

[52]  Evolutionary Synthesis of Pattern Recognition Systems , 2005, Monographs in Computer Science.

[53]  Xin Wang,et al.  Texture classification based on SIFT features and bag-of-words in compressed domain , 2012, 2012 5th International Congress on Image and Signal Processing.

[54]  Lin He,et al.  NHCs Catalyzed Hydrophosphonylation of α-Ketoesters and α-Trifluoromethyl Ketones , 2013, TheScientificWorldJournal.

[55]  Ling Shao,et al.  Building holistic descriptors for scene recognition: a multi-objective genetic programming approach , 2013, MM '13.

[56]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[57]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[58]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[59]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.