TrAdaBoost Based on Improved Particle Swarm Optimization for Cross-Domain Scene Classification With Limited Samples

Scene classification is usually based on supervised learning, but collecting instances is expensive and time-consuming. TrAdaBoost has achieved great success in transferring source instances to target images, but it has problems, such as the excessive focus on instances harder to classify, the rapid convergence speed of the source instances, and the weight mismatch caused by the big gap between the number of source and target instances, leading to decreased classification accuracy. In this paper, in order to address these problems, classical particle swarm optimization (PSO) is modified to select the optimal feature subspace for classifying the “harder” and “easier” instances by reducing unimportant dimensions. A modified correction factor is proposed by considering the classification accuracy of the instances from both domains, to decrease the convergence speed. Iterative selective TrAdaBoost is also proposed to reduce the weight mismatch by removing the indiscriminate source instances. The experimental results obtained with three benchmark data sets confirm that the proposed method outperforms most of the previous methods of scene classification with limited target samples. It is also proved that modified PSO for optimal feature subspace selection, the modified correction factor, and iterative selective TrAdaBoost are all effective in improving the classification accuracy, giving improvements of 3.6%, 4.3%, and 2.7%, and these three contributions together increase the classification accuracy by about 8% in total.

[1]  Yi Yao,et al.  Boosting for transfer learning with multiple sources , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Zhao Zhi-gan.  Simplified particle swarm optimization algorithm based on stochastic inertia weight , 2014 .

[3]  Peter Stone,et al.  Boosting for Regression Transfer , 2010, ICML.

[4]  Liangpei Zhang,et al.  Scene Classification Based on the Multifeature Fusion Probabilistic Topic Model for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Manfred K. Warmuth,et al.  The Weighted Majority Algorithm , 1994, Inf. Comput..

[6]  Rong Yan,et al.  Cross-domain video concept detection using adaptive svms , 2007, ACM Multimedia.

[7]  E. Oja,et al.  Independent Component Analysis , 2013 .

[8]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[9]  Melba M. Crawford,et al.  Adaptive Classification for Hyperspectral Image Data Using Manifold Regularization Kernel Machines , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Gui-Song Xia,et al.  A benchmark for scene classification of high spatial resolution remote sensing imagery , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[11]  Melba M. Crawford,et al.  Domain Adaptation With Preservation of Manifold Geometry for Hyperspectral Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Mikhail F. Kanevski,et al.  SVM-Based Boosting of Active Learning Strategies for Efficient Domain Adaptation , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Li Yan,et al.  Scene Capture and Selected Codebook-Based Refined Fuzzy Classification of Large High-Resolution Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Lei Guo,et al.  Remote Sensing Image Scene Classification Using Bag of Convolutional Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[15]  Wang Xuesong,et al.  Weighted Multi-source TrAdaBoost ∗ , 2013 .

[16]  Lorenzo Bruzzone,et al.  Active and Semisupervised Learning for the Classification of Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Melba M. Crawford,et al.  Spectral and Spatial Proximity-Based Manifold Alignment for Multitemporal Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  ChengXiang Zhai,et al.  Instance Weighting for Domain Adaptation in NLP , 2007, ACL.

[20]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[21]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[22]  Xue Li,et al.  Iterative Reweighting Heterogeneous Transfer Learning Framework for Supervised Remote Sensing Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Hongxun Yao,et al.  Deep Feature Fusion for VHR Remote Sensing Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Lorenzo Bruzzone,et al.  A Novel Approach to the Selection of Spatially Invariant Features for the Classification of Hyperspectral Images With Improved Generalization Capability , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[26]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[27]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[28]  Jie Wang,et al.  Comparison of Classification Algorithms and Training Sample Sizes in Urban Land Classification with Landsat Thematic Mapper Imagery , 2014, Remote. Sens..

[29]  Gustau Camps-Valls,et al.  Kernel Manifold Alignment for Domain Adaptation , 2015, PloS one.

[30]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[32]  Bo Du,et al.  Scene Classification via a Gradient Boosting Random Convolutional Network Framework , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Qihao Weng,et al.  Remote sensing of impervious surfaces in the urban areas: Requirements, methods, and trends , 2012 .

[35]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[36]  Melba M. Crawford,et al.  Active Learning: Any Value for Classification of Remotely Sensed Data? , 2013, Proceedings of the IEEE.

[37]  Hanyun Wang,et al.  Learn Multiple-Kernel SVMs for Domain Adaptation in Hyperspectral Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[38]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[40]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[41]  Yuan Yan Tang,et al.  Dictionary Learning-Based Feature-Level Domain Adaptation for Cross-Scene Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[43]  Chandan K. Reddy,et al.  Adaptive Boosting for Transfer Learning Using Dynamic Updates , 2011, ECML/PKDD.

[44]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Lorenzo Bruzzone,et al.  Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances , 2016, IEEE Geoscience and Remote Sensing Magazine.

[46]  Huanxin Zou,et al.  Transfer Sparse Subspace Analysis for Unsupervised Cross-View Scene Model Adaptation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Lorenzo Bruzzone,et al.  Active Learning for Domain Adaptation in the Supervised Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Shawki Areibi,et al.  Domain Adaptation Using Representation Learning for the Classification of Remote Sensing Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  Claudio Persello,et al.  Interactive Domain Adaptation for the Classification of Remote Sensing Images Using Active Learning , 2013, IEEE Geoscience and Remote Sensing Letters.

[50]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[51]  Emma Izquierdo-Verdiguier,et al.  Encoding Invariances in Remote Sensing Image Classification With SVM , 2013, IEEE Geoscience and Remote Sensing Letters.

[52]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[53]  Huanxin Zou,et al.  Unsupervised Cross-View Semantic Transfer for Remote Sensing Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[54]  Jason Weston,et al.  Large Scale Transductive SVMs , 2006, J. Mach. Learn. Res..

[55]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[56]  Francesca Bovolo,et al.  A Novel Domain Adaptation Bayesian Classifier for Updating Land-Cover Maps With Class Differences in Source and Target Domains , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[58]  Lorenzo Bruzzone,et al.  Semisupervised Classification of Hyperspectral Images by SVMs Optimized in the Primal , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Lorenzo Bruzzone,et al.  Kernel-Based Domain-Invariant Feature Selection in Hyperspectral Images for Transfer Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Jianya Gong,et al.  Land-Use Scene Classification in High-Resolution Remote Sensing Images Using Improved Correlatons , 2015, IEEE Geoscience and Remote Sensing Letters.

[61]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..