Star: A Contextual Description of Superpixels for Remote Sensing Image Classification

Remote Sensing Images are one of the main sources of information about the earth surface. They are widely used to automatically generate thematic maps that show the land cover of an area. This process is traditionally done by using supervised classifiers which learn patterns extracted from the image pixels annotated by the user and then assign a label to the remaining pixels. However, due to the increasing spatial resolution of the images resulting from advances in the acquisition technology, pixelwise classification is not suitable anymore, even when combined with context. Therefore, we propose a new descriptor for superpixels called Star descriptor that creates a representation based on both its own visual cues and context. Unlike the most methods in the literature, the new approach does not require any prior classification to aggregate context. Experiments carried out on urban images showed the effectiveness of the Star descriptor to generate land cover thematic maps.

[1]  Sanja Fidler,et al.  The Role of Context for Object Detection and Semantic Segmentation in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Antonio Torralba,et al.  Contextual Priming for Object Detection , 2003, International Journal of Computer Vision.

[3]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[4]  Jitendra Malik,et al.  Context by region ancestry , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Andrea Vedaldi,et al.  Objects in Context , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Jefersson Alex dos Santos,et al.  Contextual superpixel description for remote sensing image classification , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[7]  Graeme G. Wilkinson,et al.  Results and implications of a study of fifteen years of satellite image classification experiments , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Serge J. Belongie,et al.  Context based object categorization: A critical survey , 2010, Comput. Vis. Image Underst..

[9]  Siome Goldenstein,et al.  Image classification based on bag of visual graphs , 2013, 2013 IEEE International Conference on Image Processing.

[10]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[11]  Thomas M. Strat,et al.  Context-Based Vision: Recognizing Objects Using Information from Both 2D and 3D Imagery , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[13]  Jefersson Alex dos Santos,et al.  Evaluating the Potential of Texture and Color Descriptors for Remote Sensing Image Retrieval and Classification , 2010, VISAPP.

[14]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.