Transfer learning for image information mining applications

The recent explosion of data from various Earth observation (EO) systems requires new ways to rapidly harness the information and synthesise it for decision-making. Currently, several image information mining (IIM) systems have some form of supervised statistical learning models that relate the image content to the various semantic classes. However, this kind of approach is constrained by the paucity of training information in several EO domains due to limited ground truth. Although semi-supervised learning methods alleviate this problem to a certain extent by using unlabelled data from various spatial databases, these methods require that the training data and future unseen data should conform to the same statistical distribution and feature space. To overcome this problem, a more recent approach, known as transfer learning, is focused on using small amounts of labelled information from closely related or similar learning task and somehow adapts that information in developing new semantic models. Transfer learning can be applied in several processes of supervised and unsupervised learning. In this article, we propose transfer learning methods for IIM and discuss various techniques and their implications for content-based retrieval in the EO domain. Specifically, we explore three domains; the first two illustrate the heterogeneity in land cover and coastal zone thematic representations, and the third is on rapid disaster response during coastal events. This study demonstrates the usefulness of knowledge transfer between closely related tasks in the EO data synthesis. The adopted methodology for knowledge transfer is based on harnessing prior knowledge from similar concepts to learn new ones and uses a modified weighted least squares support vector machine.

[1]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[2]  Yikun Li,et al.  Semantic-Sensitive Satellite Image Retrieval , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Surya S. Durbha,et al.  A Systematic Approach to Wavelet-Decomposition-Level Selection for Image Information Mining From Geospatial Data Archives , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[5]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[6]  Chi-Ren Shyu,et al.  GeoIRIS: Geospatial Information Retrieval and Indexing System—Content Mining, Semantics Modeling, and Complex Queries , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Eric Eaton,et al.  Modeling Transfer Relationships Between Learning Tasks for Improved Inductive Transfer , 2008, ECML/PKDD.

[8]  Wei Fan,et al.  Actively Transfer Domain Knowledge , 2008, ECML/PKDD.

[9]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993 .

[10]  Eric Eaton,et al.  Set-Based Boosting for Instance-Level Transfer , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[11]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[12]  Limin Yang,et al.  An analysis of the IGBP global land-cover characterization process , 1999 .

[13]  Gavin C. Cawley,et al.  Leave-One-Out Cross-Validation Based Model Selection Criteria for Weighted LS-SVMs , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[14]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[15]  Limin Yang,et al.  Development of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data , 2000 .

[16]  Johan A. K. Suykens,et al.  Least squares support vector machines for classification and nonlinear modelling , 2000 .

[17]  Tong Zhang,et al.  A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , 2005, J. Mach. Learn. Res..

[18]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[19]  Surya S. Durbha,et al.  Semantics-enabled framework for knowledge discovery from Earth observation data archives , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Giulio Sandini,et al.  Model adaptation with least-squares SVM for adaptive hand prosthetics , 2009, 2009 IEEE International Conference on Robotics and Automation.

[21]  Goo Jun,et al.  An Efficient Active Learning Algorithm with Knowledge Transfer for Hyperspectral Data Analysis , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..

[23]  Barbara Caputo,et al.  Safety in numbers: Learning categories from few examples with multi model knowledge transfer , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Surya S. Durbha,et al.  Standards-Based Middleware and Tools for Coastal Sensor Web Applications , 2010, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.