Efficient and Effective Hierarchical Feature Propagation

Many methods have been recently proposed to deal with the large amount of data provided by the new remote sensing technologies. Several of those methods rely on the use of segmented regions. However, a common issue in region-based applications is the definition of the appropriate representation scale of the data, a problem usually addressed by exploiting multiple scales of segmentation. The use of multiple scales, however, raises new challenges related to the definition of effective and efficient mechanisms for extracting features. In this paper, we address the problem of extracting features from a hierarchy by proposing two approaches that exploit the existing relationships among regions at different scales. The H-Propagation propagates any histogram-based low-level descriptors. The bag-of-visual-word (BoW)-Propagation approach uses the BoWs model to propagate features along multiple scales. The proposed methods are very efficient, as features need to be extracted only at the base of the hierarchy and yield comparable results to low-level extraction approaches.

[1]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Tao Xu,et al.  Evaluation of local features for scene classification using VHR satellite images , 2011, 2011 Joint Urban Remote Sensing Event.

[3]  Zhenkui Ma,et al.  Tau coefficients for accuracy assessment of classification of remote sensing data , 1995 .

[4]  Jefersson Alex dos Santos,et al.  A Genetic Programming approach for coffee crop recognition , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[5]  Sylvie Philipp-Foliguet,et al.  Remote sensing image representation based on hierarchical histogram propagation , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[6]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[7]  Qian Du,et al.  Using High-Resolution Airborne and Satellite Imagery to Assess Crop Growth and Yield Variability for Precision Agriculture , 2013, Proceedings of the IEEE.

[8]  Gert R. G. Lanckriet,et al.  From region similarity to category discovery , 2011, CVPR 2011.

[9]  Ricardo da Silva Torres,et al.  Content-Based Image Retrieval: Theory and Applications , 2006, RITA.

[10]  Christian Berger,et al.  Robust Extraction of Urban Land Cover Information From HSR Multi-Spectral and LiDAR Data , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Gustavo Camps-Valls,et al.  Semisupervised Classification of Remote Sensing Images With Active Queries , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Jianyu Chen,et al.  Image‐object detectable in multiscale analysis on high‐resolution remotely sensed imagery , 2009 .

[13]  Frédéric Jurie,et al.  Creating efficient codebooks for visual recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[15]  Ying Liu,et al.  Study on texture feature extraction in region-based image retrieval system , 2006, 2006 12th International Multi-Media Modelling Conference.

[16]  Sylvie Philipp-Foliguet,et al.  Multiscale Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Jorma Laaksonen,et al.  Experiments on Selection of Codebooks for Local Image Feature Histograms , 2008, VISUAL.

[18]  Jacob Goldberger,et al.  Urban-Area Segmentation Using Visual Words , 2009, IEEE Geoscience and Remote Sensing Letters.

[19]  Gustavo Camps-Valls,et al.  Remote sensing image segmentation by active queries , 2012, Pattern Recognit..

[20]  Xiao Bai,et al.  A novel approach for satellite image classification using local self-similarity , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Sylvie Philipp-Foliguet,et al.  Descriptor correlation analysis for remote sensing image multi-scale classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[22]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Eli Saber,et al.  ENCODING OF TOPOLOGICAL INFORMATION IN MULTI-SCALE REMOTELY SENSED DATA: APPLICATIONS TO SEGMENTATION AND OBJECT-BASED IMAGE ANALYSIS , 2012 .

[24]  Deren Li,et al.  Object Classification of Aerial Images With Bag-of-Visual Words , 2010, IEEE Geoscience and Remote Sensing Letters.

[25]  Cor J. Veenman,et al.  Visual Word Ambiguity , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Sylvie Philipp-Foliguet,et al.  Improving texture description in remote sensing image multi-scale classification tasks by using visual words , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[28]  Jean Ponce,et al.  Learning mid-level features for recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Jon Atli Benediktsson,et al.  A Marker-Based Approach for the Automated Selection of a Single Segmentation From a Hierarchical Set of Image Segmentations , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Ricardo da Silva Torres,et al.  Rotation-Invariant and Scale-Invariant Steerable Pyramid Decomposition for Texture Image Retrieval , 2007, XX Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2007).

[31]  Yu Li,et al.  Automatic Target Detection in High-Resolution Remote Sensing Images Using a Contour-Based Spatial Model , 2012, IEEE Geoscience and Remote Sensing Letters.

[32]  Konrad Schindler,et al.  An Overview and Comparison of Smooth Labeling Methods for Land-Cover Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Ross F. Hayward,et al.  Evaluation of spectral and texture features for object-based vegetation species classification using Support Vector Machines , 2010 .

[34]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.

[35]  Ying Wu,et al.  Action recognition with multiscale spatio-temporal contexts , 2011, CVPR 2011.

[36]  Jefersson Alex dos Santos,et al.  Evaluating the Potential of Texture and Color Descriptors for Remote Sensing Image Retrieval and Classification , 2010, VISAPP.

[37]  Ricardo da Silva Torres,et al.  Comparative study of global color and texture descriptors for web image retrieval , 2012, J. Vis. Commun. Image Represent..

[38]  Jocelyn Chanussot,et al.  Processing Multidimensional SAR and Hyperspectral Images With Binary Partition Tree , 2013, Proceedings of the IEEE.

[39]  Michael Unser,et al.  Sum and Difference Histograms for Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Jitendra Malik,et al.  Context by region ancestry , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[42]  Sylvie Philipp-Foliguet,et al.  Interactive Multiscale Classification of High-Resolution Remote Sensing Images , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  Licheng Jiao,et al.  Bag-of-Visual-Words Based on Clonal Selection Algorithm for SAR Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[44]  Quan Liu,et al.  An Orientation Independent Texture Descriptor for Image Retrieval , 2007, 2007 International Conference on Communications, Circuits and Systems.

[45]  Mario A. Nascimento,et al.  A compact and efficient image retrieval approach based on border/interior pixel classification , 2002, CIKM '02.

[46]  Ricardo da Silva Torres,et al.  Using relevance feedback for classifying remote sensing images , 2009 .

[47]  Gui-Song Xia,et al.  SAR-Based Terrain Classification Using Weakly Supervised Hierarchical Markov Aspect Models , 2012, IEEE Transactions on Image Processing.

[48]  Stephen Gould,et al.  Multi-Class Segmentation with Relative Location Prior , 2008, International Journal of Computer Vision.