High-Resolution Remote Sensing Image Classification Using Associative Hierarchical CRF Considering Segmentation Quality

This letter proposes an associative hierarchical conditional random field (AHCRF) model to improve the classification accuracy of high-resolution remote sensing images. It considers segmentation quality of superpixels, avoids a time-consuming selection of optimal scale parameters, and alleviates the problem of classification accuracy sensitive to undersegmentation errors that is present in traditional object-oriented classification methods. The model is built on a graph hierarchy, including the pixel layer as a base layer and multiple superpixel layers derived from a mean shift presegmentation. It extracts clustered features of pixels for superpixels at each layer and then defines the potentials of the AHCRF model. We suggest a weighted version of the interlayer potential using the size of a superpixel as a measure to reflect segmentation quality. In this way, erroneously labeled pixels of a superpixel are penalized. Experiments are presented using a part of the downsampled Vaihingen data from the ISPRS benchmark data set. Results confirm that our model shows more than 80% overall classification accuracy and is superior to the original AHCRF model and comparable to other models. It also alleviates the choosing of suitable segmentation parameters.

[1]  Jon Atli Benediktsson,et al.  A novel hierarchical clustering technique based on splitting and merging , 2016 .

[2]  Ping Zhong,et al.  Modeling and Classifying Hyperspectral Imagery by CRFs With Sparse Higher Order Potentials , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Pushmeet Kohli,et al.  Associative hierarchical CRFs for object class image segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Pushmeet Kohli,et al.  Associative Hierarchical Random Fields , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Liangpei Zhang,et al.  Scene Classification Based on the Multifeature Fusion Probabilistic Topic Model for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Lorenzo Bruzzone,et al.  A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Mei Zhou,et al.  MULTI-SOURCE MULTI-SCALE HIERARCHICAL CONDITIONAL RANDOM FIELD MODEL FOR REMOTE SENSING IMAGE CLASSIFICATION , 2015 .

[9]  Bodo Rosenhahn,et al.  Segment-based building detection with conditional random fields , 2011, 2011 Joint Urban Remote Sensing Event.

[10]  Pushmeet Kohli,et al.  Graph Cut Based Inference with Co-occurrence Statistics , 2010, ECCV.

[11]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Christian Heipke,et al.  Conditional Random Fields for Multitemporal and Multiscale Classification of Optical Satellite Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hong Sun,et al.  A Supervised Classification Method Based on Conditional Random Fields With Multiscale Region Connection Calculus Model for SAR Image , 2011, IEEE Geoscience and Remote Sensing Letters.

[15]  Joost van de Weijer,et al.  Harmony potentials for joint classification and segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Liangpei Zhang,et al.  High-Resolution Image Classification Integrating Spectral-Spatial-Location Cues by Conditional Random Fields , 2016, IEEE Transactions on Image Processing.

[17]  Yan Wang,et al.  Spectral-spatial hyperspectral image classification via SVM and superpixel segmentation , 2014, 2014 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[18]  Li-Li Wang,et al.  Improved hierarchical conditional random field model for object segmentation , 2015, Machine Vision and Applications.

[19]  Xiaopeng Zhang,et al.  Robust Rooftop Extraction From Visible Band Images Using Higher Order CRF , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Amy Loutfi,et al.  Classification and Segmentation of Satellite Orthoimagery Using Convolutional Neural Networks , 2016, Remote. Sens..

[21]  Christian Heipke,et al.  Information from imagery: ISPRS scientific vision and research agenda , 2016 .

[22]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[23]  Cordelia Schmid,et al.  Object Recognition by Integrating Multiple Image Segmentations , 2008, ECCV.

[24]  Konrad Schindler,et al.  SEMANTIC SEGMENTATION OF AERIAL IMAGES IN URBAN AREAS WITH CLASS-SPECIFIC HIGHER-ORDER CLIQUES , 2015 .

[25]  Stephen Gould,et al.  Multiclass pixel labeling with non-local matching constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Wolfgang Förstner,et al.  A hierarchical conditional random field model for labeling and classifying images of man-made scenes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[27]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  Jon Atli Benediktsson,et al.  A Generalized Image Scene Decomposition-Based System for Supervised Classification of Very High Resolution Remote Sensing Imagery , 2016, Remote. Sens..

[30]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .