Recognition of the Remote Sensing Scenes From Unseen Classes

Existing scene classification models tend to be only capable of recognizing scene images from classes which have been learned by the models. This implies that testing images from classes which are not used for training the models cannot be recognized. There are tens of thousands of scene classes in the real world and it is quite infeasible for us to label all these classes for model training. Therefore, how to develop a classification model that recognizes scene images from unseen classes has been an open problem. To address this issue, we investigate the underlying relations between scene attributes and scene classes. We observe that one scene class can be characterized by a few scene attributes, and furthermore, one unseen scene class can be depicted by seen attributes. In the light of this observation, we train support vector machines to classify scene attributes rather than scene classes. We determine the attributes of a scene image from an unseen class by the support vector machines. This enables us to infer the unseen class of the scene image with respect to the attribute-class relations. Experimental results validate our framework.

[1]  Xiang Li,et al.  Multi-Branch Regression Network For Building Classification Using Remote Sensing Images , 2018, 2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS).

[2]  Yuliya Tarabalka,et al.  End-to-End Learning of Polygons for Remote Sensing Image Classification , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[3]  Antonio J. Plaza,et al.  Multiple Morphological Component Analysis Based Decomposition for Remote Sensing Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Yibo Li,et al.  Recognizing human actions based on gist descriptor and word phrase , 2013, Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC).

[5]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[6]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[7]  Zhongshan Zhang,et al.  Multispectral remote sensing image classification based on PSO-BP considering texture , 2008, 2008 7th World Congress on Intelligent Control and Automation.