An unsupervised framework to extract the diverse building from the satellite images using Grab-cut method

Building detection from the satellite image is a computer vision, Photogrammetry, and remote sensing task that has significant importance in geographical information system (GIS) based applications. In this study, a novel framework is developed for the automatic detection of different types of buildings in the complex environment of the satellite images. The framework consists of fuzzy-based pre-segmentation, information extraction, and Grab-cut partitioning. The pre-segmentation and information extraction are employed to generate the initialization data for the Grab-cut method in an unsupervised manner. Further, the Grab-cut method partition the input image in building and non-building classes depending on the initialization data is provided. The performance of the proposed algorithm is evaluated over pan-sharpened satellite images having diverse built-up characteristics. The qualitative and quantitative assessments are conducted using standard statistical parameters. The proposed algorithm has achieved the average performance in terms of the F - score is 65%, and in terms of recall is 84%. Also, the proposed algorithm is compared with the existing state-of-the-art methods to illustrate the superiority and potential of the proposed algorithm over the existing ones.

[1]  Qiming Qin,et al.  An Efficient Approach for Automatic Rectangular Building Extraction From Very High Resolution Optical Satellite Imagery , 2015, IEEE Geoscience and Remote Sensing Letters.

[2]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[4]  Ali Ozgun Ok,et al.  Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts , 2013 .

[5]  Emre Baseski,et al.  Multi-spectral False Color Shadow Detection , 2011, PIA.

[6]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[7]  Fatos T. Yarman-Vural,et al.  Building Detection With Decision Fusion , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Xiaopeng Zhang,et al.  Robust Rooftop Extraction From Visible Band Images Using Higher Order CRF , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Deepa Sharma,et al.  Fuzzy Clustering Algorithm with Histogram Based Initialization for Remotely Sensed Imagery , 2020 .

[10]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[11]  Liangpei Zhang,et al.  A New Building Extraction Postprocessing Framework for High-Spatial-Resolution Remote-Sensing Imagery , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Xin Huang,et al.  A Multidirectional and Multiscale Morphological Index for Automatic Building Extraction from Multispectral GeoEye-1 Imagery , 2011 .

[13]  Payman Moallem,et al.  Building extraction from high-resolution satellite images in urban areas: recent methods and strategies against significant challenges , 2016 .

[14]  Cem Ünsalan,et al.  A Probabilistic Framework to Detect Buildings in Aerial and Satellite Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Nikolaos Grammalidis,et al.  Building Detection Using Enhanced HOG–LBP Features and Region Refinement Processes , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Mustafa Turker,et al.  An adaptive fuzzy-genetic algorithm approach for building detection using high-resolution satellite images , 2013, Comput. Environ. Urban Syst..

[18]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[19]  O. Aytekin,et al.  Automatic and unsupervised building extraction in complex urban environments from multi spectral satellite imagery , 2009, 2009 4th International Conference on Recent Advances in Space Technologies.

[20]  Jyoti Singhai,et al.  An Object-Based Shadow Detection Method for Building Delineation in High-Resolution Satellite Images , 2019, PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science.

[21]  Andrea Manno-Kovacs,et al.  Building Detection From Monocular VHR Images by Integrated Urban Area Knowledge , 2015, IEEE Geoscience and Remote Sensing Letters.

[22]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Xiaopeng Zhang,et al.  Building Extraction from Remotely Sensed Images by Integrating Saliency Cue , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[26]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[27]  Qian Zhang,et al.  A Morphological Building Detection Framework for High-Resolution Optical Imagery Over Urban Areas , 2016, IEEE Geoscience and Remote Sensing Letters.

[28]  Liangpei Zhang,et al.  Morphological Building/Shadow Index for Building Extraction From High-Resolution Imagery Over Urban Areas , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Ashok Samal,et al.  Automatic Building Detection From High-Resolution Satellite Images Based on Morphology and Internal Gray Variance , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Saman Ghaffarian,et al.  Automatic building detection based on Purposive FastICA (PFICA) algorithm using monocular high resolution Google Earth images , 2014 .

[31]  Ilkay Ulusoy,et al.  Building detection in high resolution remotely sensed images based on morphological operators , 2009, 2009 4th International Conference on Recent Advances in Space Technologies.

[32]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Monocular Building Extraction From Aerial Imagery , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Fatos T. Yarman-Vural,et al.  A New Fuzzy Stacked Generalization Technique for Deep learning and Analysis of its Performance , 2012, ArXiv.

[34]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[35]  J. Tasic,et al.  Colour spaces: perceptual, historical and applicational background , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[36]  Arzu Erener,et al.  Unsupervised building detection in complex urban environments from multispectral satellite imagery , 2012 .

[37]  A. S Bhadauria Building Extraction from Satellite Images , 2013 .

[38]  Zhengyuan Mao,et al.  Building extraction from panchromatic high-resolution remotely sensed imagery based on potential histogram and neighborhood Total variation , 2016, Earth Science Informatics.

[39]  Vincent Mazet,et al.  Shape-Based Building Detection in Visible Band Images Using Shadow Information , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  J. Ghosh,et al.  Biosynthesis of solasodine in developing berries of , 2022 .

[41]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[42]  Stavros Stavrou,et al.  Building extraction in satellite images using active contours and colour features , 2016 .

[43]  Fatos T. Yarman-Vural,et al.  A Self-Supervised Decision Fusion Framework for Building Detection , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.