Semantic Segmentation of Remote Sensing Imagery Using Object-Based Markov Random Field Model With Regional Penalties

This paper proposes a novel object-based Markov random field model (OMRF) for semantic segmentation of remote sensing images. First, the method employs the region size and edge information to build a weighted region adjacency graph (WRAG) for capturing the complicated interactions among objects. Thereafter, aimed at modeling object interactions in the OMRF, the size and edge information are further introduced into the Gibbs joint distribution of the random field as regional penalties. Finally, the semantic segmentation is achieved through a principled probabilistic inference of the OMRF with regional penalties. The proposed method is compared with other MRF-based methods and some state-of-the-art methods. Experiments are conducted on a series of synthetic and real-world images. Segmentation results demonstrate that our method provides better performance (an accuracy improvement about 3%). Moreover, we further discuss the application of the proposed method for classification.

[1]  Hideki Noda,et al.  MRF-based texture segmentation using wavelet decomposed images , 2002, Pattern Recognit..

[2]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[3]  Martial Hebert,et al.  Measures of Similarity , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[4]  Chen Zheng,et al.  Image Segmentation Using Multiregion-Resolution MRF Model , 2013, IEEE Geoscience and Remote Sensing Letters.

[5]  Yun Yang,et al.  Two Specific Multiple-Level-Set Models for High-Resolution Remote-Sensing Image Classification , 2009, IEEE Geoscience and Remote Sensing Letters.

[6]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Feiping Nie,et al.  TurboPixel Segmentation Using Eigen-Images , 2010, IEEE Transactions on Image Processing.

[9]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  John E. Ball,et al.  Level Set Hyperspectral Image Classification Using Best Band Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[11]  David A. Clausi,et al.  Unsupervised Polarimetric SAR Image Segmentation and Classification Using Region Growing With Edge Penalty , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[13]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Hong Sun,et al.  An Unsupervised Segmentation Method Using Markov Random Field on Region Adjacency Graph for SAR Images , 2006, 2006 CIE International Conference on Radar.

[16]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Xiaofeng Wang,et al.  A new localized superpixel Markov random field for image segmentation , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[18]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[20]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[21]  Zhi-Qiang Liu,et al.  Self-Validated Labeling of Markov Random Fields for Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[24]  Wen-Feng Kuo,et al.  Watershed Segmentation with Automatic Altitude Selection and Region Merging Based on the Markov Random Field Model , 2010, Int. J. Pattern Recognit. Artif. Intell..

[25]  Qianqing Qin,et al.  Image segmentation based on multiresolution Markov random field with fuzzy constraint in wavelet domain , 2012 .

[26]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[28]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[29]  Liangpei Zhang,et al.  An Adaptive Multiscale Information Fusion Approach for Feature Extraction and Classification of IKONOS Multispectral Imagery Over Urban Areas , 2007, IEEE Geoscience and Remote Sensing Letters.

[30]  G. Hay,et al.  Object-Based Image Analysis , 2008 .

[31]  Bin Zhang,et al.  Region-based classification by combining MS segmentation and MRF for POLSAR images , 2013 .

[32]  Qiang Ji,et al.  Image Segmentation with a Unified Graphical Model , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[34]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[35]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[36]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Leiguang Wang,et al.  Optimization of Segmentation Algorithms Through Mean-Shift Filtering Preprocessing , 2014, IEEE Geoscience and Remote Sensing Letters.

[38]  Ryuei Nishii A Markov random field-based approach to decision-level fusion for remote sensing image classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[39]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  David A. Clausi,et al.  IRGS: Image Segmentation Using Edge Penalties and Region Growing , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  David A. Clausi,et al.  SAR Sea-Ice Image Analysis Based on Iterative Region Growing Using Semantics , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jitendra Malik,et al.  Recovering human body configurations: combining segmentation and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..