Combining multi-scale textural features from the panchromatic bands of high spatial resolution images with ANN and MLC classification algorithms to extract urban land uses

ABSTRACT High spatial resolution images have been increasingly used for urban land-use classification, but high spectral variations within same land use, the spectral confusion among different land uses, and the shadow problem often lead to poor classification performance of the traditional per-pixel classification methods. Main objectives of this paper were to extract phenomena with different altitudes with the absence of elevation features and shadowed areas without defining a shadow class, identifying the most effective textural features in classification by Regression analysis and also class differentiation with similar spectral properties. To achieve these aims, the panchromatic image of WorldView2, GeoEye1, and QuickBird satellites were applied in order to extract the statistical features of the first and the second order of multi-scale texture analysis, due to high potential for providing more detailed and high spatial resolution in five different window sizes, four different cell shifts, and three different angles or directions. Overall, 137 features were used as input in two classification algorithms including Maximum Likelihood Classifier (MLC) and Artificial Neural Network (ANN). The results showed that the multi-scale textural features and ANN made possible to differentiate three major classes of asphalt, vegetation and building surfaces even with the presence of shadowed area and the absence of elevation features. The experiments also presented that the more the elevation of vertical objects, the more the effect of textural parameters on extraction of these classes. Furthermore, the investigations denoted the validity of the Regression analysis in the detection of most effective textural features in classification.

[1]  Faith R. Kearns,et al.  Classification of the wildland-urban interface: A comparison of pixel- and object-based classifications using high-resolution aerial photography , 2008, Comput. Environ. Urban Syst..

[2]  Teresa Mendonça,et al.  The use of texture for image classification of black & white air photographs , 2008 .

[3]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Fernando Bação,et al.  Self-organizing Maps as Substitutes for K-Means Clustering , 2005, International Conference on Computational Science.

[5]  Anne Puissant,et al.  The utility of texture analysis to improve per‐pixel classification for high to very high spatial resolution imagery , 2005 .

[6]  Ute Beyer,et al.  Remote Sensing And Image Interpretation , 2016 .

[7]  Farid Melgani,et al.  Assessing the Reconstructability of Shadow Areas in VHR Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Michal Kedzierski,et al.  A Method of Panchromatic Image Modification for Satellite Imagery Data Fusion , 2017, Remote. Sens..

[9]  Craig A. Coburn,et al.  A multiscale texture analysis procedure for improved forest stand classification , 2004 .

[10]  Johannes R. Sveinsson,et al.  Classification of Pansharpened Urban Satellite Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  P. Treitz,et al.  Agricultural Crop Classification Using SAR Tone and Texture Statistics , 2000 .

[12]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[13]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Brian Johnson,et al.  High-resolution urban land-cover classification using a competitive multi-scale object-based approach , 2013 .

[15]  D. S. Candra ANALYSIS OF SPOT-6 DATA FUSION USING GRAM-SCHMIDT SPECTRAL SHARPENING ON RURAL AREAS , 2014 .

[16]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[17]  Jing Li,et al.  Hierarchical object oriented classification using very high resolution imagery and LIDAR data over urban areas , 2009 .

[18]  J. Engels,et al.  Pansharpening of Hyperspectral Images in Urban Areas , 2012 .

[19]  D. He,et al.  Texture analysis of IKONOS satellite imagery for urban land use and land cover classification , 2010 .

[20]  Yun Zhang,et al.  A review and comparison of commercially available pan-sharpening techniques for high resolution satellite image fusion , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[21]  E. Moran Land Cover Classification in a Complex Urban-Rural Landscape with Quickbird Imagery. , 2010, Photogrammetric engineering and remote sensing.

[22]  Weisheng Wang,et al.  A Study for Texture Feature Extraction of High-Resolution Satellite Images Based on a Direction Measure and Gray Level Co-Occurrence Matrix Fusion Algorithm , 2017, Sensors.

[23]  Qingming Zhan,et al.  Urban land use extraction from Very High Resolution remote sensing imagery using a Bayesian network , 2016 .

[24]  M. A. Aguilar,et al.  Classification of urban areas from GeoEye-1 imagery through texture features based on Histograms of Equivalent Patterns , 2016 .

[25]  P. Atkinson,et al.  Introduction Neural networks in remote sensing , 1997 .

[26]  D. Toll,et al.  Detecting residential land use development at the urban fringe , 1982 .

[27]  John R. Jensen,et al.  Introductory Digital Image Processing: A Remote Sensing Perspective , 1986 .

[28]  William J. Emery,et al.  Spatial classification of WorldView-2 multi-angle sequence , 2011, 2011 Joint Urban Remote Sensing Event.

[29]  William J. Emery,et al.  Very High Resolution Multiangle Urban Classification Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jonathan Cheung-Wai Chan,et al.  An Assessment of Geometric Activity Features for Per-pixel Classification of Urban Man-made Objects using Very High Resolution Satellite Imagery , 2009 .

[31]  Alessia Allegrini,et al.  Texture analysis for urban areas classification in high resolution satellite imagery , 2013 .

[32]  S. Bhaskaran,et al.  Per-pixel and object-oriented classification methods for mapping urban features using Ikonos satellite data , 2010 .

[33]  Victor S. Frost,et al.  Textural Features for Radar Image Analysis , 1981, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Xi Chen,et al.  Measuring the Effectiveness of Various Features for Thematic Information Extraction From Very High Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Wei Su,et al.  Textural and local spatial statistics for the object‐oriented classification of urban areas using high resolution imagery , 2008 .

[36]  Andrea Baraldi,et al.  An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters , 1995, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Dong-Chen He,et al.  Urban Classification Of High Resolution Ikonos Imagery Using Texture , 2006 .

[38]  P. Maillard Comparing Texture Analysis Methods through Classification , 2003 .

[39]  Susanne Lehner,et al.  A Neural Network-Based Classification for Sea Ice Types on X-Band SAR Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Steven E. Franklin,et al.  Multi-scale object-based image analysis and feature selection of multi-sensor earth observation imagery using random forests , 2012 .

[41]  Land use/land cover mapping using multi-scale texture processing of high resolution data , 2014 .

[42]  Austin Troy,et al.  Object-based Land Cover Classification and Change Analysis in the Baltimore Metropolitan Area Using Multitemporal High Resolution Remote Sensing Data , 2008, Sensors.

[43]  Aniruddha Ghosh,et al.  A comparison of selected classification algorithms for mapping bamboo patches in lower Gangetic plains using very high resolution WorldView 2 imagery , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[44]  Timothy A. Warner,et al.  Kernel-Based Texture in Remote Sensing Image Classification , 2011 .

[45]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[46]  Christian Bignami,et al.  The SIGRIS Project: A Remote Sensing System for Seismic Risk Management , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[47]  A. Mookambiga,et al.  Automated road network extraction using artificial neural network , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[48]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[49]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[50]  Xin Huang,et al.  Information fusion of aerial images and LIDAR data in urban areas: vector-stacking, re-classification and post-processing approaches , 2011 .

[51]  Manuel A. Aguilar,et al.  GeoEye-1 and WorldView-2 pan-sharpened imagery for object-based classification in urban environments , 2013 .

[52]  William J. Emery,et al.  A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification , 2009 .

[53]  Qian Song,et al.  Exploring the Use of Google Earth Imagery and Object-Based Methods in Land Use/Cover Mapping , 2013, Remote. Sens..

[54]  Jianhua Gong,et al.  UAV Remote Sensing for Urban Vegetation Mapping Using Random Forest and Texture Analysis , 2015, Remote. Sens..

[55]  C. Small High spatial resolution spectral mixture analysis of urban reflectance , 2003 .

[56]  Gu Haiyan,et al.  Fusion of High-resolution Aerial Imagery and Lidar Data for Object-oriented Urban Landcover Classification Based on Svm , 2007 .

[57]  O. Dikshit,et al.  Improvement of classification in urban areas by the use of textural features: The case study of Lucknow city, Uttar Pradesh , 2001 .

[58]  I. Lizarazo URBAN LAND COVER AND LAND USE CLASSIFICATION USING HIGH SPATIAL RESOLUTION IMAGES AND SPATIAL METRICS , 2007 .

[59]  Albert Rango,et al.  International Journal of Applied Earth Observation and Geoinformation a Comparison of Three Feature Selection Methods for Object-based Classification of Sub-decimeter Resolution Ultracam-l Imagery , 2022 .

[60]  David A. Clausi,et al.  Comparing cooccurrence probabilities and Markov random fields for texture analysis of SAR sea ice imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[61]  D. Lu,et al.  Extraction of urban impervious surfaces from an IKONOS image , 2009 .

[62]  W. A. Hallada,et al.  Image sharpening for mixed spatial and spectral resolution satellite systems , 1983 .

[63]  James E. McMurtrey,et al.  Demonstration of the accuracy of improved-resolution hyperspectral imagery , 2002, SPIE Defense + Commercial Sensing.

[64]  Martino Pesaresi,et al.  Systematic Study of the Urban Postconflict Change Classification Performance Using Spectral and Structural Features in a Support Vector Machine , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[65]  Peng Gong,et al.  A comparison of spatial feature extraction algorithms for land-use classification with SPOT HRV data , 1992 .

[66]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Felix Hueber,et al.  Hyperspectral Imaging Techniques For Spectral Detection And Classification , 2016 .

[68]  Mohsen Nasseri,et al.  Evaluation of Stiffened End-Plate Moment Connection through Optimized Artificial Neural Network , 2012 .

[69]  Caiyun Zhang,et al.  Combining object-based texture measures with a neural network for vegetation mapping in the Everglades from hyperspectral imagery , 2012 .

[70]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[71]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[72]  Norman Kerle,et al.  Object-based gully feature extraction using high spatial resolution imagery , 2011 .

[73]  S. Sanjeevi,et al.  Jeffries Matusita based mixed-measure for improved spectral matching in hyperspectral image analysis , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[74]  William J. Emery,et al.  Exploiting SAR and VHR Optical Images to Quantify Damage Caused by the 2003 Bam Earthquake , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[75]  Jie Wang,et al.  Comparison of Classification Algorithms and Training Sample Sizes in Urban Land Classification with Landsat Thematic Mapper Imagery , 2014, Remote. Sens..

[76]  Hamid Ebadi,et al.  Using Artificial Neural Network for Classification of High Resolution Remotely Sensed Images and Assessment of Its Performance Compared with Statistical Methods , 2015 .

[77]  Xin Pan,et al.  A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[78]  Helmi Zulhaidi Mohd Shafri,et al.  yperspectral discrimination of tree species with different classifications using ingle-and multiple-endmember , 2013 .

[79]  T. M. Lillesand,et al.  Remote Sensing and Image Interpretation , 1980 .

[80]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[81]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .

[82]  W. Pratt Digital Image Processing: Piks Scientific Inside , 1978 .

[83]  Hongsheng Zhang,et al.  Exploring the optimal integration levels between SAR and optical data for better urban land cover mapping in the Pearl River Delta , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[84]  Monika Kuffer,et al.  Slums from Space - 15 Years of Slum Mapping Using Remote Sensing , 2016, Remote. Sens..

[85]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[86]  Jihua Wang,et al.  Damage Mapping of Powdery Mildew in Winter Wheat with High-Resolution Satellite Image , 2014, Remote. Sens..

[87]  Hiroaki Kuze,et al.  Performance Analyzing of High Resolution Pan-sharpening Techniques: Increasing Image Quality for Classification using Supervised Kernel Support Vector Machine , 2011 .

[88]  A. Jacquin,et al.  A hybrid object-based classification approach for mapping urban sprawl in periurban environment , 2008 .

[89]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[90]  Timothy A. Warner,et al.  Implementation of machine-learning classification in remote sensing: an applied review , 2018 .

[91]  Hao Wang,et al.  Static Memory Deduplication for Performance Optimization in Cloud Computing , 2017, Sensors.

[92]  E. S. Malinverni,et al.  TEXTURE ANALYSIS TO IMPROVE SUPERVISED CLASSIFICATION IN IKONOS IMAGERY , 2010 .