Block-based semantic classification of high-resolution multispectral aerial images

In this paper, we compare different approaches for classification of aerial images based on descriptors computed using visible spectral bands as well as additional information obtained from the near infrared band. We also propose different methods for incorporating dimensionality reduction into descriptor extraction process for both global and local texture descriptors aiming at obtaining low-dimensional descriptors from multispectral images. Furthermore, we examine classification accuracy in cases when small training sets are used. For evaluation purposes, we use an in-house high-resolution aerial image dataset, with images containing visual and near-infrared spectral bands, as well as UC Merced land-use dataset. We achieve the classification rates of over 90 % on in-house dataset. For UC Merced, we obtain classification accuracy of 91 % which is an improvement of about 3 % compared to the state-of-the-art color SIFT descriptors.

[1]  J. Campbell Introduction to remote sensing , 1987 .

[2]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[3]  Chandrika Kamath,et al.  Retrieval using texture features in high-resolution multispectral satellite imagery , 2004, SPIE Defense + Commercial Sensing.

[4]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Sylvie Philipp-Foliguet,et al.  Improving texture description in remote sensing image multi-scale classification tasks by using visual words , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[6]  Selim Aksoy,et al.  Image Classification Using Subgraph Histogram Representation , 2010, 2010 20th International Conference on Pattern Recognition.

[7]  Anil M. Cheriyadat,et al.  Semantic information extraction from multispectral geospatial imagery via a flexible framework , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Gulcan Can,et al.  Evaluation of textural features for multispectral images , 2011, Remote Sensing.

[9]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[10]  S. S. Kumar,et al.  Performance analysis of wave atom transform in texture classification , 2014, Signal Image Video Process..

[11]  Aun Irtaza,et al.  Categorical image retrieval through genetically optimized support vector machines (GOSVM) and hybrid texture features , 2014, Signal, Image and Video Processing.

[12]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Anil M. Cheriyadat,et al.  Unsupervised Feature Learning for Aerial Scene Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[15]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[16]  Shawn D. Newsam,et al.  Spatial pyramid co-occurrence for image classification , 2011, 2011 International Conference on Computer Vision.

[17]  Vladimir Risojevic,et al.  Descriptor dimensionality reduction for aerial image classification , 2011, 2011 18th International Conference on Systems, Signals and Image Processing.

[18]  B. S. Manjunath,et al.  A Texture Thesaurus for Browsing Large Aerial Photographs , 1998, J. Am. Soc. Inf. Sci..

[19]  Filiberto Pla,et al.  Multi-spectral Texture Characterisation for Remote Sensing Image Segmentation , 2009, IbPRIA.

[20]  Sabine Süsstrunk,et al.  Multi-spectral SIFT for scene category recognition , 2011, CVPR 2011.

[21]  Vladimir Risojevic,et al.  Fusion of Global and Local Descriptors for Remote Sensing Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[22]  Gabriela Csurka,et al.  Combining Visible and Near-Infrared Cues for image Categorisation , 2011, BMVC.