Pixel- and feature-level fusion of hyperspectral and lidar data for urban land-use classification

The complexity of urban areas makes it difficult for single-source remotely sensed data to meet all urban application requirements. Airborne light detection and ranging (lidar) can provide precise horizontal and vertical point cloud data, while hyperspectral images can provide hundreds of narrow spectral bands which are sensitive to subtle differences in surface materials. The main objectives of this study are to explore: (1) the performance of fused lidar and hyperspectral data for urban land-use classification, especially the contribution of lidar intensity and height information for land-use classification in shadow areas; and (2) the efficiency of combined pixel- and object-based classifiers for urban land-use classification. Support vector machine (SVM), maximum likelihood classification (MLC), and object-based classifiers were used to classify lidar, hyperspectral data and their derived features, such as the normalized digital surface model (nDSM), normalized difference vegetation index (NDVI), and texture measures, into 15 urban land-use classes. Spatial attributes and rules were used to minimize misclassification of the objects showing similar spectral properties, and accuracy assessments were carried out for the classification results. Compared with hyperspectral data alone, hyperspectral–lidar data fusion improved overall accuracy by 6.8% (from 81.7 to 88.5%) when the SVM classifier was used. Meanwhile, compared with SVM alone, the combined SVM and object-based method improved OA by 7.1% (from 87.6 to 94.7%). The results suggest that hyperspectral–lidar data fusion is effective for urban land-use classification, and the proposed combined pixel- and object-based classifiers are very efficient and flexible for the fusion of hyperspectral and lidar data.

[1]  Yongil Kim,et al.  Improved Classification Accuracy Based on the Output-Level Fusion of High-Resolution Satellite Images and Airborne LiDAR Data in Urban Area , 2014, IEEE Geoscience and Remote Sensing Letters.

[2]  Eyal Ben-Dor,et al.  A spectral based recognition of the urban environment using the visible and near-infrared spectral region (0.4-1.1 µm). A case study over Tel-Aviv, Israel , 2001 .

[3]  Qi Chen Airborne Lidar Data Processing and Information Extraction , 2007 .

[4]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[5]  Jing Xiao,et al.  Fusion of airborne laserscanning point clouds and images for supervised and unsupervised scene classification , 2014 .

[6]  Roberto Manduchi,et al.  Supervised Parametric Classification of Aerial LiDAR Data , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  S. Prasher,et al.  Application of support vector machine technology for weed and nitrogen stress detection in corn , 2006 .

[8]  M. Herold,et al.  Spectral characteristics of asphalt road aging and deterioration: implications for remote-sensing applications. , 2005, Applied optics.

[9]  J. R. Jensen,et al.  Remote Sensing Change Detection in Urban Environments , 2007 .

[10]  Benjamin Koetz,et al.  Multi-source land cover classification for forest fire management based on imaging spectrometry and LiDAR data , 2008 .

[11]  Bo Wu,et al.  Classification of quickbird image with maximal mutual information feature selection and support vector machine , 2009 .

[12]  Xiuwan Chen,et al.  Object-oriented classification and application in land use classification using SPOT-5 PAN imagery , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[13]  Wenzhong Shi,et al.  A fuzzy topology-based maximum likelihood classification , 2011 .

[14]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[15]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[16]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[17]  George P. Petropoulos,et al.  Support vector machines and object-based classification for obtaining land-use/cover cartography from Hyperion hyperspectral imagery , 2012, Comput. Geosci..

[18]  Samia Boukir,et al.  Relevance of airborne lidar and multispectral image data for urban scene classification using Random Forests , 2011 .

[19]  E. González-Ferreiro,et al.  Land Use Classification from Lidar Data and Ortho‐Images in a Rural Area , 2012 .

[20]  Ross A. Hill,et al.  Mapping woodland species composition and structure using airborne spectral and LiDAR data , 2005 .

[21]  Frieke Van Coillie,et al.  Feature selection by genetic algorithms in object-based classification of IKONOS imagery for forest mapping in Flanders, Belgium , 2007 .

[22]  D. Roberts,et al.  Sub-pixel mapping of urban land cover using multiple endmember spectral mixture analysis: Manaus, Brazil , 2007 .

[23]  Alessia Allegrini,et al.  Texture analysis for urban areas classification in high resolution satellite imagery , 2013 .

[24]  A. Scott,et al.  Clustering methods based on likelihood ratio criteria. , 1971 .

[25]  Stephen V. Stehman,et al.  Selecting and interpreting measures of thematic classification accuracy , 1997 .

[26]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[27]  J. Shan,et al.  Combining Lidar Elevation Data and IKONOS Multispectral Imagery for Coastal Classification Mapping , 2003 .

[28]  Margaret E. Gardner,et al.  Spectrometry for urban area remote sensing—Development and analysis of a spectral library from 350 to 2400 nm , 2004 .

[29]  Jing Li,et al.  Hierarchical object oriented classification using very high resolution imagery and LIDAR data over urban areas , 2009 .

[30]  Francisco Javier Gallego,et al.  Efficiency assessment of using satellite data for crop area estimation in Ukraine , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[31]  Sean W. MacFaden,et al.  High-resolution tree canopy mapping for New York City using LIDAR and object-based image analysis , 2012 .

[32]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[33]  Stefano Pignatti,et al.  Evaluating Hyperion capability for land cover mapping in a fragmented ecosystem : Pollino National Park, Italy , 2009 .

[34]  Andrew K. Skidmore,et al.  Estimation of green grass/herb biomass from airborne hyperspectral imagery using spectral indices and partial least squares regression , 2007, Int. J. Appl. Earth Obs. Geoinformation.

[35]  Hao Wu,et al.  An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine , 2011, Knowl. Based Syst..

[36]  Jocelyn Chanussot,et al.  Decision Fusion for the Classification of Hyperspectral Data: Outcome of the 2008 GRS-S Data Fusion Contest , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[37]  C. Small Estimation of urban vegetation abundance by spectral mixture analysis , 2001 .

[38]  S. Bhaskaran,et al.  Per-pixel and object-oriented classification methods for mapping urban features using Ikonos satellite data , 2010 .

[39]  T. Webster,et al.  Object-oriented land cover classification of lidar-derived surfaces , 2006 .

[40]  Curt H. Davis,et al.  A combined fuzzy pixel-based and object-based approach for classification of high-resolution multispectral data over urban areas , 2003, IEEE Trans. Geosci. Remote. Sens..

[41]  C. Fraser,et al.  Automatic Detection of Residential Buildings Using LIDAR Data and Multispectral Imagery , 2010 .

[42]  Guoqiang Ni,et al.  Exploring for natural gas using reflectance spectra of surface soils , 2008 .

[43]  Siamak Khorram,et al.  Comparson of Landsat MSS and TM Data for Urban Land-Use Classification , 1987, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Jianyu Yang,et al.  Automatic remotely sensed image classification in a grid environment based on the maximum likelihood method , 2013, Math. Comput. Model..

[45]  David A. Landgrebe,et al.  Supplementing hyperspectral data with digital elevation , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[46]  D. Stow,et al.  Object‐based classification of residential land use within Accra, Ghana based on QuickBird satellite data , 2007, International journal of remote sensing.

[47]  Lorenzo Bruzzone,et al.  Fusion of Hyperspectral and LIDAR Remote Sensing Data for Classification of Complex Forest Areas , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[48]  J. B. Lee,et al.  Enhancement of high spectral resolution remote-sensing data by a noise-adjusted principal components transform , 1990 .

[49]  S. Pascucci,et al.  Hyperspectral Sensor Data Capability for Retrieving Complex Urban Land Cover in Comparison with Multispectral Data: Venice City Case Study (Italy) , 2008, Sensors.

[50]  James R. Anderson,et al.  A land use and land cover classification system for use with remote sensor data , 1976 .

[51]  Marc Mangolini,et al.  Apport de la fusion d'images satellitaires multicapteurs au niveau pixel en télédétection et photo-interprétation , 1994 .

[52]  Bruce W. Pengra,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[53]  George P. Petropoulos,et al.  Hyperion hyperspectral imagery analysis combined with machine learning classifiers for land use/cover mapping , 2012, Expert Syst. Appl..

[54]  Douglas J. King,et al.  Automated tree crown detection and delineation in high-resolution digital camera imagery of coniferous forest regeneration , 2002 .

[55]  John L. van Genderen,et al.  Multisensor fusion: optimization and operationalization for mapping applications , 1994, Defense, Security, and Sensing.

[56]  A. Formaggio,et al.  Discrimination of sugarcane varieties in Southeastern Brazil with EO-1 Hyperion data , 2005 .

[57]  Hina Pande,et al.  Use of laser range and height texture cues for building identification , 2008 .

[58]  Qian Du,et al.  Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Jungho Im,et al.  Synergistic use of QuickBird multispectral imagery and LIDAR data for object-based forest species classification , 2010 .

[60]  George Miliaresis,et al.  Segmentation and object-based classification for the extraction of the building class from LIDAR DEMs , 2007, Comput. Geosci..

[61]  L. Monika Moskal,et al.  Fusion of LiDAR and imagery for estimating forest canopy fuels , 2010 .

[62]  John B. Vogler,et al.  LiDAR-Landsat data fusion for large-area assessment of urban land cover: Balancing spatial resolution, data volume and mapping accuracy , 2012 .

[63]  Marina Mueller,et al.  Edge- and region-based segmentation technique for the extraction of large, man-made objects in high-resolution satellite imagery , 2004, Pattern Recognit..

[64]  John Trinder,et al.  Using the Dempster-Shafer method for the fusion of LIDAR data and multi-spectral images for building detection , 2005, Inf. Fusion.

[65]  J. R. Jensen,et al.  Effectiveness of Subpixel Analysis in Detecting and Quantifying Urban Imperviousness from Landsat Thematic Mapper Imagery , 1999 .

[66]  C. Small,et al.  A global analysis of urban reflectance , 2005 .

[67]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[68]  Jianwen Ma,et al.  Feature selection for hyperspectral data based on recursive support vector machines , 2009 .

[69]  C. Small High spatial resolution spectral mixture analysis of urban reflectance , 2003 .

[70]  J. R. Jensen,et al.  Remote Sensing of Urban/Suburban Infrastructure and Socio‐Economic Attributes , 2011 .

[71]  Weiqi Zhou,et al.  An Object-Based Approach for Urban Land Cover Classification: Integrating LiDAR Height and Intensity Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[72]  B. Xu,et al.  Oakwood crown closure estimation by unmixing Landsat TM data , 2003 .

[73]  W. B. Clapham Continuum-based classification of remotely sensed imagery to describe urban sprawl on a watershed scale , 2003 .

[74]  J. Gallego,et al.  Accuracy, Objectivity and Efficiency of Remote Sensing for Agricultural Statistics , 2010 .

[75]  Åsa Persson,et al.  Species identification of individual trees by combining high resolution LiDAR data with multi‐spectral images , 2008 .

[76]  Hugo Carrão,et al.  Contribution of multispectral and multitemporal information from MODIS images to land cover classification , 2008 .

[77]  D. Roberts,et al.  Hierarchical Multiple Endmember Spectral Mixture Analysis (MESMA) of hyperspectral imagery for urban environments , 2009 .

[78]  J. Clevers,et al.  Classification of floodplain vegetation by data fusion of spectral (CASI) and LiDAR data , 2007 .

[79]  Kiyun Yu,et al.  Assessing the Possibility of Landcover Classification Using Lidar Intensity Data , 2002 .

[80]  Junichi Imanishi,et al.  Object-based classification of land cover and tree species by integrating airborne LiDAR and high spatial resolution imagery data , 2011, Landscape and Ecological Engineering.

[81]  Le Wang,et al.  Isprs Journal of Photogrammetry and Remote Sensing a Multi-directional Ground Filtering Algorithm for Airborne Lidar , 2022 .

[82]  N. S. R. Krishnayya,et al.  Classification of tropical trees growing in a sanctuary using Hyperion (EO-1) and SAM algorithm. , 2009 .

[83]  J. Brasington,et al.  Object-based land cover classification using airborne LiDAR , 2008 .

[84]  A. C. Seijmonsbergen,et al.  Optimizing land cover classification accuracy for change detection, a combined pixel-based and object-based approach in a mountainous area in Mexico , 2012 .

[85]  P. Gamba,et al.  Joint analysis of SAR, LIDAR and aerial imagery for simultaneous extraction of land cover, DTM and 3D shape of buildings , 2002 .

[86]  Martin Flood,et al.  LIDAR ACTIVITIES AND RESEARCH PRIORITIES IN THE COMMERCIAL SECTOR , 2004 .