Integrating bottom-up classification and top-down feedback for improving urban land-cover and functional-zone mapping

Abstract As two kinds of basic units of cities, land-cover objects and functional zones play different but totally important roles in urban mapping and studies. Recent several years have witnessed significant improvement in their classification methods, e.g. geographic object based image analysis (GEOBIA). However, these methods focus mainly on bottom-up classifications from visual features to semantic categories but they ignore top-down feedbacks which are capable of optimizing classification results. To resolve the issue, this study presents an iterative method which integrates bottom-up and top-down processes for land-cover and functional-zone classifications. First, hierarchical semantic cognition (HSC) is employed to make bottom-up classification for land covers and functional zones. The HSC is essentially a hierarchical Bayesian model which links visual features, land covers, spatial object patterns, and functional zones together with a hierarchical structure. Then, a top-down feedback method, inverse hierarchical semantic cognition (IHSC), is proposed to optimize the initial classification results. Finally, the two processes are carried out iteratively to generate more and more accurate results. To verify the effectiveness of this method, we conducted it in Beijing, China. Experimental results indicate that the method produces accurate classification results of land covers and functional zones, and improves their accuracies by 9.9% and 6.5% respectively. Accordingly, our method combines bottom-up classification and top-down feedback and can significantly improve land-cover and functional-zone mapping results, thus can be regarded as a novel paradigm of urban mapping.

[1]  Weiqi Zhou,et al.  Global urbanization as a shifting context for applying ecological science toward the sustainable city , 2015 .

[2]  Yihua Tan,et al.  Unsupervised Multilayer Feature Learning for Satellite Image Scene Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[4]  Hugh G. Lewis,et al.  A generalized confusion matrix for assessing area estimates from remotely sensed data , 2001 .

[5]  Shihong Du,et al.  Scene classification using multi-scale deeply described visual words , 2016 .

[6]  Sigeru Omatu,et al.  Neural network approach to land cover mapping , 1994, IEEE Trans. Geosci. Remote. Sens..

[7]  Barry Haack,et al.  An assessment of Landsat MSS and TM data for urban and near-urban land-cover digital classification , 1987 .

[8]  Andrew Zisserman,et al.  Scene Classification Via pLSA , 2006, ECCV.

[9]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[10]  J. Six,et al.  Object-based crop identification using multiple vegetation indices, textural features and crop phenology , 2011 .

[11]  M. Bauer,et al.  Estimation and mapping of forest stand density, volume, and cover type using the k-nearest neighbors method , 2001 .

[12]  Peter Kontschieder,et al.  Structured Labels in Random Forests for Semantic Labelling and Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ke Wang,et al.  Satellite image scene classification using spatial information , 2015, International Conference on Graphic and Image Processing.

[14]  Giorgos Mountrakis,et al.  Effect of classifier selection, reference sample size, reference class distribution and scene heterogeneity in per-pixel classification accuracy using 26 Landsat sites , 2018 .

[15]  Jean Ponce,et al.  A graph-matching kernel for object categorization , 2011, 2011 International Conference on Computer Vision.

[16]  Wanqing Li,et al.  Semantic and Spatial Content Fusion for Scene Recognition , 2015 .

[17]  Jean-Christophe Castella,et al.  Combining top-down and bottom-up modelling approaches of land use/cover change to support public policies: Application to sustainable management of natural resources in northern Vietnam , 2007 .

[18]  P. Diggle,et al.  Spatial point pattern analysis and its application in geographical epidemiology , 1996 .

[19]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[20]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[21]  O. Csillik,et al.  Automated parameterisation for multi-scale image segmentation on multiple layers , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[22]  Z. Pengjun,et al.  Transportation implications of the metropolitan spatial planning in megacity Beijing , 2009 .

[23]  Junji Maeda,et al.  Comparison of Segmentation Methods for Melanoma Diagnosis in Dermoscopy Images , 2009, IEEE Journal of Selected Topics in Signal Processing.

[24]  Jiebo Luo,et al.  Improved scene classification using efficient low-level features and semantic cues , 2004, Pattern Recognit..

[25]  Reimund P. Rötter,et al.  Integration of Systems Network (SysNet) tools for regional land use scenario analysis in Asia , 2005, Environ. Model. Softw..

[26]  K. Overmars,et al.  Combining top-down and bottom-up dynamics in land use modeling: exploring the future of abandoned farmlands in Europe with the Dyna-CLUE model , 2009, Landscape Ecology.

[27]  C. Brodley,et al.  Decision tree classification of land cover from remotely sensed data , 1997 .

[28]  Jiebo Luo,et al.  A computationally efficient approach to indoor/outdoor scene classification , 2002, Object recognition supported by user interaction for service robots.

[29]  Shihong Du,et al.  Learning selfhood scales for urban land cover mapping with very-high-resolution satellite images , 2016 .

[30]  Paul M. Mather,et al.  Support vector machines for classification in remote sensing , 2005 .

[31]  Faith R. Kearns,et al.  Classification of the wildland-urban interface: A comparison of pixel- and object-based classifications using high-resolution aerial photography , 2008, Comput. Environ. Urban Syst..

[32]  T. Esch,et al.  Urban structure type characterization using hyperspectral remote sensing and height information , 2012 .

[33]  Fei-Fei Li,et al.  Spatially Coherent Latent Topic Model for Concurrent Segmentation and Classification of Objects and Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[34]  Peter H. Verburg,et al.  Simulating feedbacks in land use and land cover change models , 2006, Landscape Ecology.

[35]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[36]  Xiaoping Liu,et al.  Sensing spatial distribution of urban land use by integrating points-of-interest and Google Word2Vec model , 2017, Int. J. Geogr. Inf. Sci..

[37]  Giles M. Foody,et al.  Fully-fuzzy supervised classification of sub-urban land cover from remotely sensed imagery: Statistical and artificial neural network approaches , 2001 .

[38]  Dongmei Chen,et al.  Strategies for Integrating Information from Multiple Spatial Resolutions into Land-Use/Land-Cover Classification Routines , 2003 .

[39]  Rong Zhang,et al.  Integrating bottom-up/top-down for object recognition by data driven Markov chain Monte Carlo , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[40]  Shihong Du,et al.  A Linear Dirichlet Mixture Model for decomposing scenes: Application to analyzing urban functional zonings , 2015 .

[41]  Shihong Du,et al.  Semantic classification of urban buildings combining VHR image and GIS data: An improved random forest approach , 2015 .

[42]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[43]  Hyun Bang Shin,et al.  Residential Redevelopment and the Entrepreneurial Local State: The Implications of Beijing’s Shifting Emphasis on Urban Redevelopment Policies , 2009 .

[44]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[45]  Víctor Urrea,et al.  Letter to the Editor: Stability of Random Forest importance measures , 2011, Briefings Bioinform..

[46]  P. Haase.  Spatial pattern analysis in ecology based on Ripley's K-function: Introduction and methods of edge correction , 1995 .

[47]  Thomas Blaschke,et al.  A comparison of three image-object methods for the multiscale analysis of landscape structure , 2003 .

[48]  Shihong Du,et al.  Hierarchical semantic cognition for urban functional zones with VHR satellite images and POI data , 2017 .

[49]  Gillian Cohen,et al.  Hierarchical models in cognition: Do they have psychological reality? , 2000 .

[50]  M. Alberti,et al.  Urban Land-Cover Change Analysis in Central Puget Sound , 2004 .

[51]  Rong Yan,et al.  On predicting rare classes with SVM ensembles in scene classification , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[52]  Clayton C. Kingdon,et al.  Spatial pattern analysis for monitoring protected areas , 2009 .

[53]  Brian Johnson,et al.  Classifying a high resolution image of an urban area using super-object information , 2013 .

[54]  Gabriele Moser,et al.  Combining Support Vector Machines and Markov Random Fields in an Integrated Framework for Contextual Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Shihong Du,et al.  Multiscale Geoscene Segmentation for Extracting Urban Functional Zones from VHR Satellite Images , 2018, Remote. Sens..

[56]  Min Yao,et al.  Bayesian network based semantic image classification with attributed relational graph , 2014, Multimedia Tools and Applications.

[57]  Marvin E. Bauer,et al.  Integrating Contextual Information with per-Pixel Classification for Improved Land Cover Classification , 2000 .

[58]  Shihong Du,et al.  Semantic Classification of Heterogeneous Urban Scenes Using Intrascene Feature Similarity and Interscene Semantic Dependency , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[60]  Muhammad Aslam Noor,et al.  Decomposition method for solving system of linear equations , 2013 .

[61]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Jon Atli Benediktsson,et al.  A Novel Automatic Change Detection Method for Urban High-Resolution Remotely Sensed Imagery Based on Multiindex Scene Representation , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Sameer Singh,et al.  Indoor vs. outdoor scene classification in digital photographs , 2005, Pattern Recognit..

[64]  Mihai Datcu,et al.  Semantic Annotation of Satellite Images Using Latent Dirichlet Allocation , 2010, IEEE Geoscience and Remote Sensing Letters.

[65]  C. Burnett,et al.  A multi-scale segmentation/object relationship modelling methodology for landscape analysis , 2003 .

[66]  R. Kaplan,et al.  People needs in the urban landscape : Analysis of Landscape And Urban Planning contributions , 2008 .