Multiscale Geoscene Segmentation for Extracting Urban Functional Zones from VHR Satellite Images

Urban functional zones, such as commercial, residential, and industrial zones, are basic units of urban planning, and play an important role in monitoring urbanization. However, historical functional-zone maps are rarely available for cities in developing countries, as traditional urban investigations focus on geographic objects rather than functional zones. Recent studies have sought to extract functional zones automatically from very-high-resolution (VHR) satellite images, and they mainly concentrate on classification techniques, but ignore zone segmentation which delineates functional-zone boundaries and is fundamental to functional-zone analysis. To resolve the issue, this study presents a novel segmentation method, geoscene segmentation, which can identify functional zones at multiple scales by aggregating diverse urban objects considering their features and spatial patterns. In experiments, we applied this method to three Chinese cities—Beijing, Putian, and Zhuhai—and generated detailed functional-zone maps with diverse functional categories. These experimental results indicate our method effectively delineates urban functional zones with VHR imagery; different categories of functional zones extracted by using different scale parameters; and spatial patterns that are more important than the features of individual objects in extracting functional zones. Accordingly, the presented multiscale geoscene segmentation method is important for urban-functional-zone analysis, and can provide valuable data for city planners.

[1]  Hui Xiong,et al.  Discovering Urban Functional Zones Using Latent Activity Trajectories , 2015, IEEE Transactions on Knowledge and Data Engineering.

[2]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[3]  Andrew Zisserman,et al.  Scene Classification Via pLSA , 2006, ECCV.

[4]  J. Six,et al.  Object-based crop identification using multiple vegetation indices, textural features and crop phenology , 2011 .

[5]  Tonglin Zhang,et al.  A measure of spatial stratified heterogeneity , 2016 .

[6]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[7]  S. Bhaskaran,et al.  Per-pixel and object-oriented classification methods for mapping urban features using Ikonos satellite data , 2010 .

[8]  Ola Ahlqvist,et al.  Classification of different urban categories corresponding to the strategic spatial level of urban planning and management using a SPOT4 scene , 2015 .

[9]  James Ze Wang,et al.  Unsupervised Multiresolution Segmentation for Images with Low Depth of Field , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  David A. Clausi,et al.  A Multiscale Latent Dirichlet Allocation Model for Object-Oriented Clustering of VHR Panchromatic Satellite Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Junji Maeda,et al.  Comparison of Segmentation Methods for Melanoma Diagnosis in Dermoscopy Images , 2009, IEEE Journal of Selected Topics in Signal Processing.

[12]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[13]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[14]  Xiaoping Liu,et al.  Sensing spatial distribution of urban land use by integrating points-of-interest and Google Word2Vec model , 2017, Int. J. Geogr. Inf. Sci..

[15]  Mustapha Hakdaoui,et al.  Detecting Slums from SPOT Data in Casablanca Morocco Using an Object Based Approach , 2011, J. Geogr. Inf. Syst..

[16]  Christiane Schmullius,et al.  Object-based land cover mapping and comprehensive feature calculation for an automated derivation of urban structure types at block level , 2014 .

[17]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[18]  Lei Guo,et al.  Effective and Efficient Midlevel Visual Elements-Oriented Land-Use Classification Using VHR Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jianguo Wu,et al.  A gradient analysis of urban landscape pattern: a case study from the Phoenix metropolitan region, Arizona, USA , 2004, Landscape Ecology.

[20]  Thomas Blaschke,et al.  A comparison of three image-object methods for the multiscale analysis of landscape structure , 2003 .

[21]  S. Pickett,et al.  Shifting concepts of urban spatial heterogeneity and their implications for sustainability , 2016, Landscape Ecology.

[22]  P. Gong,et al.  Accuracy Assessment Measures for Object-based Image Segmentation Goodness , 2010 .

[23]  Dapeng Tao,et al.  Local structure preserving discriminative projections for RGB-D sensor-based scene classification , 2015, Inf. Sci..

[24]  Junwei Han,et al.  Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVW and pLSA , 2013 .

[25]  Piermaria Corona,et al.  Exploring forest structural complexity by multi-scale segmentation of VHR imagery , 2008 .

[26]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[27]  Xiaoping Liu,et al.  Classifying urban land use by integrating remote sensing and social media data , 2017, Int. J. Geogr. Inf. Sci..

[28]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[29]  Jianguo Wu,et al.  Key concepts and research topics in landscape ecology revisited: 30 years after the Allerton Park workshop , 2012, Landscape Ecology.

[30]  Peter Hall,et al.  Learning similarity metrics for dynamic scene segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  M. Neubert,et al.  A COMPARISON OF SEGMENTATION PROGRAMS FOR HIGH RESOLUTION REMOTE SENSING DATA , 2004 .

[32]  Liangpei Zhang,et al.  A New Building Extraction Postprocessing Framework for High-Spatial-Resolution Remote-Sensing Imagery , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Geoffrey J. Hay,et al.  Multiscale Object-Specific Analysis (MOSA): An Integrative Approach for Multiscale Landscape Analysis , 2004 .

[34]  Petteri VihervaaraLaura How to integrate remotely sensed data and biodiversity for ecosystem assessments at landscape scale , 2015 .

[35]  T. Esch,et al.  Urban structure type characterization using hyperspectral remote sensing and height information , 2012 .

[36]  Henri Maître,et al.  On the relevance of linear discriminative features , 2010, Inf. Sci..

[37]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[38]  Gabriele Moser,et al.  Classification of urban structural types with multisource data and structured models , 2015, 2015 Joint Urban Remote Sensing Event (JURSE).

[39]  Brian D. Inouye,et al.  SPATIAL HETEROGENEITY EXPLAINS THE SCALE DEPENDENCE OF THE NATIVE-EXOTIC DIVERSITY RELATIONSHIP , 2005 .

[40]  D. Stow,et al.  Monitoring shrubland habitat changes through object-based change identification with airborne multispectral imagery , 2008 .

[41]  F. Baret,et al.  Quantifying spatial heterogeneity at the landscape scale using variogram models , 2006 .

[42]  Edyta Regulska,et al.  Landscape Patch Pattern Effect on Relationships between Soil Properties and Earthworm Assemblages: A Comparison of two Farmlands of Different Spatial Structure , 2015, Polish Journal of Ecology.

[43]  Shihong Du,et al.  Learning selfhood scales for urban land cover mapping with very-high-resolution satellite images , 2016 .

[44]  Shihong Du,et al.  A Linear Dirichlet Mixture Model for decomposing scenes: Application to analyzing urban functional zonings , 2015 .

[45]  Robert Weibel,et al.  A review and conceptual framework of automated map generalization , 1988, Int. J. Geogr. Inf. Sci..

[46]  P. Gong,et al.  Object-based Detailed Vegetation Classification with Airborne High Spatial Resolution Remote Sensing Imagery , 2006 .

[47]  Bojie Fu,et al.  Landscape ecology: Coupling of pattern, process, and scale , 2011 .

[48]  Fangju Wang,et al.  Fuzzy Representation of Geographical Boundaries in GIS , 1996, Int. J. Geogr. Inf. Sci..

[49]  Rupert Seidl,et al.  Evaluating the accuracy and generality of a hybrid patch model. , 2005, Tree physiology.

[50]  Shihong Du,et al.  Hierarchical semantic cognition for urban functional zones with VHR satellite images and POI data , 2017 .

[51]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[52]  Peng Gong,et al.  Mapping Urban Land Use by Using Landsat Images and Open Social Data , 2016, Remote. Sens..

[53]  Vasiliki Kosmidou,et al.  Using landscape structure to develop quantitative baselines for protected area monitoring , 2013 .

[54]  Domenec Puig,et al.  Focus-aided scene segmentation , 2015, Comput. Vis. Image Underst..

[55]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[56]  Landscape fragmentation, land-use legacy and propagule pressure promote plant invasion on coastal dunes: a patch-based approach , 2014, Landscape Ecology.

[57]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Jon Atli Benediktsson,et al.  A Novel Automatic Change Detection Method for Urban High-Resolution Remotely Sensed Imagery Based on Multiindex Scene Representation , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[59]  D. Civco,et al.  Optimizing multi-resolution segmentation scale using empirical methods: Exploring the sensitivity of the supervised discrepancy measure Euclidean distance 2 (ED2) , 2014 .

[60]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[61]  Georgios Tziritas,et al.  MRF-based segmentation and unsupervised classification for building and road detection in peri-urban areas of high-resolution satellite images , 2016 .

[62]  O. Csillik,et al.  Automated parameterisation for multi-scale image segmentation on multiple layers , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[63]  Richard J. Hobbs,et al.  Key Topics in Landscape Ecology: Frontmatter , 2007 .

[64]  Weiqi Zhou,et al.  Quantifying Spatial Heterogeneity in Urban Landscapes: Integrating Visual Interpretation and Object-Based Classification , 2014, Remote. Sens..

[65]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[66]  Geoffrey J. Hay,et al.  How wetland type and area differ through scale: A GEOBIA case study in Alberta's Boreal Plains , 2012 .

[67]  Mariana Belgiu,et al.  Comparing supervised and unsupervised multiresolution segmentation approaches for extracting buildings from very high resolution imagery , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[68]  Zev Naveh,et al.  LANDSCAPE ECOLOGY: THEORY AND APPLICATION , 1983, Landscape Journal.

[69]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[70]  Thomas Elmqvist,et al.  Scale Mismatches in Management of Urban Landscapes , 2006 .

[71]  Shihong Du,et al.  Scene classification using multi-scale deeply described visual words , 2016 .

[72]  Athanassios I. Sfougaris,et al.  electing landscape metrics as indicators of spatial heterogeneity — A omparison among Greek landscapes , 2013 .

[73]  A. Rango,et al.  Object-oriented image analysis for mapping shrub encroachment from 1937 to 2003 in southern New Mexico , 2004 .

[74]  Martin A. Nowak,et al.  A spatial model predicts that dispersal and cell turnover limit intratumour heterogeneity , 2015, Nature.

[75]  J. Roering,et al.  Experimental evidence for hillslope control of landscape scale , 2015, Science.

[76]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[77]  C. Burnett,et al.  A multi-scale segmentation/object relationship modelling methodology for landscape analysis , 2003 .

[78]  R. Kaplan,et al.  People needs in the urban landscape : Analysis of Landscape And Urban Planning contributions , 2008 .

[79]  Josiane Zerubia,et al.  Building Development Monitoring in Multitemporal Remotely Sensed Image Pairs with Stochastic Birth-Death Dynamics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Thomas Blaschke,et al.  Object-oriented image analysis and scale-space: Theory and methods for modeling and evaluating multi-scale landscape structure , 2001 .

[81]  Shihong Du,et al.  Semantic Classification of Heterogeneous Urban Scenes Using Intrascene Feature Similarity and Interscene Semantic Dependency , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[82]  Geoffrey J. Hay,et al.  Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline , 2008 .

[83]  Petri Pellikka,et al.  Landscape analysis using multi-scale segmentation and object-oriented classification , 2009 .

[84]  Cristian Sminchisescu,et al.  Semantic Segmentation with Second-Order Pooling , 2012, ECCV.

[85]  Thomas Kirchhoff,et al.  What is Landscape Ecology? An Analysis and Evaluation of Six Different Conceptions , 2013 .