Spherical Stochastic Neighbor Embedding of Hyperspectral Data

In hyperspectral imagery, low-dimensional representations are sought in order to explain well the nonlinear characteristics that are hidden in high-dimensional spectral channels. While many algorithms have been proposed for dimension reduction and manifold learning in Euclidean spaces, very few attempts have focused on non-Euclidean spaces. Here, we propose a novel approach that embeds hyperspectral data, transformed into bilateral probability similarities, onto a nonlinear unit norm coordinate system. By seeking a unit l2-norm nonlinear manifold, we encode similarity representations onto a space in which important regularities in data are easily captured. In its general application, the technique addresses problems related to dimension reduction and visualization of hyperspectral images. Unlike methods such as multidimensional scaling and spherical embeddings, which are based on the notion of pairwise distance computations, our approach is based on a stochastic objective function of spherical coordinates. This allows the use of an Exit probability distribution to discover the nonlinear characteristics that are inherent in hyperspectral data. In addition, the method directly learns the probability distribution over neighboring pixel maps while computing for the optimal embedding coordinates. As part of evaluation, classification experiments were conducted on the manifold spaces for hyperspectral data acquired by multiple sensors at various spatial resolutions over different types of land cover. Various visualization and classification comparisons to five existing techniques demonstrated the strength of the proposed approach while its algorithmic nature is guaranteed to converge to meaningful factors underlying the data.

[1]  A. Neuenschwander Remote sensing of vegetation dynamics in response to flooding and fire in the Okavango Delta, Botswana , 2007 .

[2]  Melba M. Crawford,et al.  Active Learning via Multi-View and Local Proximity Co-Regularization for Hyperspectral Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[3]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[5]  Li Ma,et al.  Exploring Nonlinear Manifold Learning for Classification of Hyperspectral Data , 2011 .

[6]  Santiago Velasco-Forero,et al.  Improving Hyperspectral Image Classification Using Spatial Preprocessing , 2009, IEEE Geoscience and Remote Sensing Letters.

[7]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[8]  R. Walde,et al.  Introduction to Lie groups and Lie algebras , 1973 .

[9]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[10]  Edwin R. Hancock,et al.  Spherical embeddings for non-Euclidean dissimilarities , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  D. Sattinger,et al.  Lie Groups and Algebras with Applications to Physics, Geometry and Mechanics , 1986 .

[12]  Subhasis Chaudhuri,et al.  Visualization of Hyperspectral Images Using Bilateral Filtering , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Charles A. Bouman,et al.  Sparse Matrix Transform for Hyperspectral Image Processing , 2011, IEEE Journal of Selected Topics in Signal Processing.

[15]  A. Wood Simulation of the von mises fisher distribution , 1994 .

[16]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[17]  D. Bertsekas On the Goldstein-Levitin-Polyak gradient projection method , 1974, CDC 1974.

[18]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[19]  Shogo Kato,et al.  A distribution for a pair of unit vectors generated by Brownian motion , 2009, 0909.1221.

[20]  Alexander M. Bronstein,et al.  Numerical Geometry of Non-Rigid Shapes , 2009, Monographs in Computer Science.

[21]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  R. Durrett Brownian motion and martingales in analysis , 1984 .

[23]  Jon Atli Benediktsson,et al.  Spectral Unmixing for the Classification of Hyperspectral Images at a Finer Spatial Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[24]  Horst Bunke,et al.  Non-Euclidean or Non-metric Measures Can Be Informative , 2006, SSPR/SPR.

[25]  Inderjit S. Dhillon,et al.  Clustering on the Unit Hypersphere using von Mises-Fisher Distributions , 2005, J. Mach. Learn. Res..

[26]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[27]  Masashi Sugiyama,et al.  Local Fisher discriminant analysis for supervised dimensionality reduction , 2006, ICML.

[28]  D. Landgrebe On Information Extraction Principles for Hyperspectral Data , 1997 .

[29]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[30]  Geoffrey E. Hinton,et al.  Stochastic Neighbor Embedding , 2002, NIPS.

[31]  W. Torgerson Multidimensional scaling: I. Theory and method , 1952 .

[32]  Xi Chen,et al.  Graph-Based Feature Selection for Object-Oriented Classification in VHR Airborne Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[33]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[34]  Aurora Cuartero,et al.  Methodological Proposal for Multispectral Stereo Matching , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Joshua B. Tenenbaum,et al.  Global Versus Local Methods in Nonlinear Dimensionality Reduction , 2002, NIPS.

[36]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[37]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[38]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[39]  Dan Geiger,et al.  Asymptotic Model Selection for Naive Bayesian Networks , 2002, J. Mach. Learn. Res..

[40]  Raghuveer M. Rao,et al.  Hyperspectral image enhancement with vector bilateral filtering , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).