Multisource data fusion for image classification using fisher criterion based nearest feature space approach

In this paper, a novel technique, known as nearest feature space (NFS) approach, is proposed for supervised classification of multisource images for the purpose of landslide hazard assessment. It is developed for land cover classification based on the fusion of remotely sensed images of the same scene collected from multiple sources. This approach presents a framework for data fusion of multisource remotely sensed images, which consists of two approaches, referred to as band generation process (BGP) and Fisher criterion based NFS classifier. Compared to the original NFS, we propose an improve NFS classifier which uses the Fisher criterion of between-class and within-class discrimination to enhance the original one. In the training phase, the labeled samples are discriminated by the Fisher criterion, which can be treated as a pre-processing of NFS. Finally, the classification results can be obtained by NFS algorithm. In order for the proposed NFS to be effective for multispectral images, a multiple adaptation BGP is introduced to create a new set of additional bands especially accommodated to landslide classes. Experimental results demonstrate the proposed BGP/NFS approach is suitable for land cover classification in earth remote sensing and improves the precision of image classification.

[1]  Masashi Sugiyama,et al.  Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis , 2007, J. Mach. Learn. Res..

[2]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[3]  Stan Z. Li,et al.  Face recognition based on nearest linear combinations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[4]  Anil K. Jain,et al.  Multisource classification of remotely sensed data: fusion of Landsat TM and SAR images , 1994, IEEE Trans. Geosci. Remote. Sens..

[5]  Stan Z. Li,et al.  Performance Evaluation of the Nearest Feature Line Method in Image Classification and Retrieval , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Sebastiano B. Serpico,et al.  Classification of multisensor remote-sensing images by structured neural networks , 1995, IEEE Trans. Geosci. Remote. Sens..

[7]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[9]  Ying-Nong Chen,et al.  Face Recognition Using Nearest Feature Space Embedding , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[12]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[14]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.