Dimension Reduction of Optical Remote Sensing Images via Minimum Change Rate Deviation Method

This paper introduces a new dimension reduction (DR) method, called minimum change rate deviation (MCRD), which is applicable to the DR of remote sensing images. As the main shortcoming of the well-known principal component analysis (PCA) method is that it does not consider the spatial relation among image points, our proposed approach takes into account the spatial relation among neighboring image pixels while preserving all useful properties of PCA. These include uncorrelatedness property in resulted components and the decrease of error with the increasing of the number of selected components. Our proposed method can be considered as a generalization of PCA and, under certain conditions, reduces to it. The proposed MCRD method employs linear spatial operators to consider the spatiality of images. The superiority of MCRD over conventional PCA is demonstrated both mathematically and experimentally. It is shown that MCRD, with an acceptable speed, outperforms PCA in retaining the required information for classification purposes. Moreover, as the locally linear embedding (LLE) method also employs the spatial relations in its DR process, the performances of MCRD and LLE are compared, and the superiority of the proposed method in both classification accuracy and computational cost is shown.

[1]  Salah Bourennane,et al.  Dimensionality Reduction Based on Tensor Modeling for Classification Methods , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Miguel Á. Carreira-Perpiñán,et al.  A Review of Dimension Reduction Techniques , 2009 .

[3]  David A. Landgrebe,et al.  Hyperspectral data analysis and supervised feature reduction via projection pursuit , 1999, IEEE Trans. Geosci. Remote. Sens..

[4]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[5]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[6]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[7]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[8]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[9]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[10]  David A. Landgrebe,et al.  HYPERSPECTRAL DATA ANALYSIS AND FEATURE REDUCTION VIA PROJECTION PURSUIT , 1999 .

[11]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[12]  Li Yang,et al.  Alignment of Overlapping Locally Scaled Patches for Multidimensional Scaling and Dimensionality Reduction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tarek El-Ghazawi,et al.  Feature reduction of hyperspectral imagery using hybrid wavelet-principal component analysis , 2004 .

[14]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[15]  J. B. Lee,et al.  Enhancement of high spectral resolution remote-sensing data by a noise-adjusted principal components transform , 1990 .

[16]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[17]  Jonathan Goldstein,et al.  When Is ''Nearest Neighbor'' Meaningful? , 1999, ICDT.

[18]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[19]  Sanjoy Dasgupta,et al.  Adaptive Control Processes , 2010, Encyclopedia of Machine Learning and Data Mining.

[20]  Lorenzo Bruzzone,et al.  A new search algorithm for feature selection in hyperspectral remote sensing images , 2001, IEEE Trans. Geosci. Remote. Sens..

[21]  Guillermo Sapiro,et al.  Spatially Coherent Nonlinear Dimensionality Reduction and Segmentation of Hyperspectral Images , 2007, IEEE Geoscience and Remote Sensing Letters.

[22]  Hongbin Zha,et al.  Riemannian Manifold Learning , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Kilian Q. Weinberger,et al.  Nonlinear Dimensionality Reduction by Semidefinite Programming and Kernel Matrix Factorization , 2005, AISTATS.

[24]  Kilian Q. Weinberger,et al.  Spectral Methods for Dimensionality Reduction , 2006, Semi-Supervised Learning.

[25]  Ya-Xiang Yuan,et al.  Optimization theory and methods , 2006 .

[26]  O. Chapelle,et al.  Spectral Methods for Dimensionality Reduction , 2006 .

[27]  Sinthop Kaewpijit,et al.  Automatic reduction of hyperspectral imagery using wavelet spectral analysis , 2003, IEEE Trans. Geosci. Remote. Sens..

[28]  Gabriele Moser,et al.  Extraction of Spectral Channels From Hyperspectral Images for Classification Purposes , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Trevor F. Cox,et al.  Metric multidimensional scaling , 2000 .

[31]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[32]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.