Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification

Genetic programming (GP) is a well-known evolutionary computation technique, which has been successfully used to solve various problems, such as optimization, image analysis, and classification. Transfer learning is a type of machine learning approach that can be used to solve complex tasks. Transfer learning has been introduced to GP to solve complex Boolean and symbolic regression problems with some promise. However, the use of transfer learning with GP has not been investigated to address complex image classification tasks with noise and rotations, where GP cannot achieve satisfactory performance, but GP with transfer learning may improve the performance. In this paper, we propose a novel approach based on transfer learning and GP to solve complex image classification problems by extracting and reusing blocks of knowledge/information, which are automatically discovered from similar as well as different image classification tasks during the evolutionary process. The proposed approach is evaluated on three texture data sets and three office data sets of image classification benchmarks, and achieves better classification performance than the state-of-the-art image classification algorithm. Further analysis on the evolved solutions/trees shows that the proposed approach with transfer learning can successfully discover and reuse knowledge/information extracted from similar or different problems to improve its performance on complex image classification problems.

[1]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[2]  R. Poli Genetic programming for image analysis , 1996 .

[3]  Konstantinos N. Plataniotis,et al.  Distance measures for color image retrieval , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[4]  Manuela M. Veloso,et al.  Layered Learning , 2000, ECML.

[5]  Steven M. Gustafson,et al.  Layered Learning in Genetic Programming for a Cooperative Robot Soccer Problem , 2001, EuroGP.

[6]  Luca Lombardi,et al.  Image classification: an evolutionary approach , 2002, Pattern Recognit. Lett..

[7]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.

[8]  Mengjie Zhang,et al.  Classification Strategies for Image Classification in Genetic Programming , 2003 .

[9]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Hans-Peter Kriegel,et al.  Integrating structured biological data by Kernel Maximum Mean Discrepancy , 2006, ISMB.

[12]  Nguyen Xuan Hoai,et al.  Representation and structural difficulty in genetic programming , 2006, IEEE Transactions on Evolutionary Computation.

[13]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[14]  David Jackson,et al.  Layered Learning in Boolean GP Problems , 2007, EuroGP.

[15]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[16]  Krzysztof Krawiec,et al.  Visual Learning by Evolutionary and Coevolutionary Feature Synthesis , 2007, IEEE Transactions on Evolutionary Computation.

[17]  Wojciech Jaskowski,et al.  Multitask Visual Learning Using Genetic Programming , 2008, Evolutionary Computation.

[18]  Xin Yao,et al.  Population-Based Incremental Learning With Associative Memory for Dynamic Environments , 2008, IEEE Transactions on Evolutionary Computation.

[19]  Trevor Darrell,et al.  Transfer learning for image classification with sparse prototype representations , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Yamin Li,et al.  Two improvements in genetic programming for image classification , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[21]  Yew-Soon Ong,et al.  A proposition on memes and meta-memes in computing for higher-order learning , 2009, Memetic Comput..

[22]  Gustavo Olague,et al.  Evolutionary learning of local descriptor operators for object recognition , 2009, GECCO.

[23]  Martin Pelikan,et al.  Analyzing Probabilistic Models in Hierarchical BOA , 2009, IEEE Transactions on Evolutionary Computation.

[24]  Krzysztof Krawiec,et al.  Automatic generation and exploitation of related problems in genetic programming , 2010, IEEE Congress on Evolutionary Computation.

[25]  Trevor Darrell,et al.  Adapting Visual Category Models to New Domains , 2010, ECCV.

[26]  Ahmet Arslan,et al.  Genetic transfer learning , 2010, Expert Syst. Appl..

[27]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[29]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[30]  Nguyen Xuan Hoai,et al.  On Synergistic Interactions Between Evolution, Development and Layered Learning , 2011, IEEE Transactions on Evolutionary Computation.

[31]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[32]  Nguyen Xuan Hoai,et al.  A study on Genetic Programming with layered learning and incremental sampling , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[33]  Qiang Yang,et al.  Heterogeneous Transfer Learning for Image Classification , 2011, AAAI.

[34]  Gustaf Kylberg,et al.  Kylberg Texture Dataset v. 1.0 , 2011 .

[35]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[36]  Mengjie Zhang,et al.  Genetic programming for improving image descriptors generated using the scale-invariant feature transform , 2012, IVCNZ '12.

[37]  Mengjie Zhang,et al.  Two-Tier genetic programming: towards raw pixel-based image classification , 2012, Expert Syst. Appl..

[38]  Nguyen Xuan Hoai,et al.  Learning in Stages: A Layered Learning Approach for Genetic Programming , 2012, 2012 IEEE RIVF International Conference on Computing & Communication Technologies, Research, Innovation, and Vision for the Future.

[39]  Jürgen Schmidhuber,et al.  Transfer learning for Latin and Chinese characters with Deep Neural Networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[40]  Mengjie Zhang,et al.  A Filter Approach to Multiple Feature Construction for Symbolic Learning Classifiers Using Genetic Programming , 2012, IEEE Transactions on Evolutionary Computation.

[41]  Xuan Hoai Nguyen,et al.  Learning in Stages: A Layered Learning Approach for Genetic Programming , 2012 .

[42]  Concha Bielza,et al.  Network measures for information extraction in evolutionary algorithms , 2013, Int. J. Comput. Intell. Syst..

[43]  Mark Johnston,et al.  Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data , 2013, IEEE Transactions on Evolutionary Computation.

[44]  Mengjie Zhang,et al.  Hybridisation of Genetic Programming and Nearest Neighbour for classification , 2013, 2013 IEEE Congress on Evolutionary Computation.

[45]  Bo Yang,et al.  A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image , 2013, Neurocomputing.

[46]  Oscar Cordón,et al.  Self-Adaptive Evolution Toward New Parameter Free Image Registration Methods , 2013, IEEE Transactions on Evolutionary Computation.

[47]  Amiram Moshaiov,et al.  Family bootstrapping: A genetic transfer learning approach for onsetting the evolution for a set of related robotic tasks , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[48]  Mengjie Zhang,et al.  Domain Adaptive Neural Networks for Object Recognition , 2014, PRICAI.

[49]  Wojciech Jaskowski,et al.  Cross-task code reuse in genetic programming applied to visual learning , 2014, Int. J. Appl. Math. Comput. Sci..

[50]  Luís A. Alexandre,et al.  Improving Deep Neural Network Performance by Reusing Features Trained with Transductive Transference , 2014, ICANN.

[51]  Mengjie Zhang,et al.  Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems , 2014, IEEE Transactions on Evolutionary Computation.

[52]  Ling Shao,et al.  Feature Learning for Image Classification Via Multiobjective Genetic Programming , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[53]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[54]  G. Abo Samra,et al.  Localization of License Plate Number Using Dynamic Image Processing Techniques and Genetic Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[55]  Mengjie Zhang,et al.  Domain Generalization for Object Recognition with Multi-task Autoencoders , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[56]  Mark Johnston,et al.  Image descriptor: A genetic programming approach to multiclass texture classification , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[57]  Bing Xue,et al.  A hybrid Genetic Programming approach to feature detection and image classification , 2015, 2015 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[58]  Conor Ryan,et al.  Handbook of Genetic Programming Applications , 2015, Springer International Publishing.

[59]  Conor Ryan,et al.  Image Classification with Genetic Programming: Building a Stage 1 Computer Aided Detector for Breast Cancer , 2015, Handbook of Genetic Programming Applications.

[60]  Yaochu Jin,et al.  Evolutionary Multiobjective Image Feature Extraction in the Presence of Noise , 2015, IEEE Transactions on Cybernetics.

[61]  Ivor W. Tsang,et al.  Memes as building blocks: a case study on evolutionary optimization + transfer learning for routing problems , 2015, Memetic Comput..

[62]  Nguyen Quang Uy,et al.  Transfer learning in genetic programming , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[63]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[64]  Mengjie Zhang,et al.  Generalisation and domain adaptation in GP with gradient descent for symbolic regression , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[65]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[66]  Marleen de Bruijne,et al.  Transfer Learning Improves Supervised Image Segmentation Across Imaging Protocols , 2015, IEEE Trans. Medical Imaging.

[67]  Shengxiang Yang,et al.  Direct Memory Schemes for Population-Based Incremental Learning in Cyclically Changing Environments , 2016, EvoApplications.

[68]  Mengjie Zhang,et al.  Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation , 2016, ECCV.

[69]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[70]  Mengjie Zhang,et al.  Human-inspired Scaling in Learning Classifier Systems: Case Study on the n-bit Multiplexer Problem Set , 2016, GECCO.

[71]  Bing Xue,et al.  Genetic Programming for Region Detection, Feature Extraction, Feature Construction and Classification in Image Data , 2016, EuroGP.

[72]  Mengjie Zhang,et al.  Improving classification on images by extracting and transferring knowledge in genetic programming , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[73]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[74]  Mengjie Zhang,et al.  Reusing Extracted Knowledge in Genetic Programming to Solve Complex Texture Image Classification Problems , 2016, PAKDD.

[75]  Karen O. Egiazarian,et al.  Dominant Rotated Local Binary Patterns (DRLBP) for texture classification , 2016, Pattern Recognit. Lett..

[76]  Mark Johnston,et al.  Binary Image Classification: A Genetic Programming Approach to the Problem of Limited Training Instances , 2016, Evolutionary Computation.

[77]  Yew-Soon Ong,et al.  Towards a new Praxis in optinformatics targeting knowledge re-use in evolutionary computation: simultaneous problem learning and optimization , 2016, Evolutionary Intelligence.

[78]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[79]  Mengjie Zhang,et al.  Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Ausama Al-Sahaf,et al.  Automatically Evolving Rotation-Invariant Texture Image Descriptors by Genetic Programming , 2017, IEEE Transactions on Evolutionary Computation.

[81]  Y. Ong,et al.  Multifactorial Evolution : Towards Evolutionary Multitasking , 2022 .