Reducing the dimensionality of hyperspectral data using diffusion maps

We examine the analysis of hyperspectral data produced by the Hy-perspectral Core Imager of AngloGold Ashanti. The dimension of the data is reduced using diffusion maps and the data is then clustered using three divisive clustering strategies. Divisive k-means, PDDP and the NCut algorithm are used. It is shown that the clusterings produced are reasonably accurate compared to a reference clustering, but superior with respect to an internal quality evaluation. Moreover, using a divisive algorithm makes it possible to keep track of inter-cluster similarities. It is also shown that by embedding sample spectra in a dataset it is possible to identify particular minerals within the cluster.

[1]  Michael Sears,et al.  Analysis of hyperspectral data with diffusion maps and Fuzzy ART , 2009, 2009 International Joint Conference on Neural Networks.

[2]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Steven B. Damelin,et al.  An investigation of data compression techniques for hyperspectral core imager data , 2008 .

[4]  J. Kerekes,et al.  Hyperspectral Imaging Systems , 2006 .

[5]  Martin Nilsson,et al.  Hierarchical Clustering Using Non-Greedy Principal Direction Divisive Partitioning , 2002, Information Retrieval.

[6]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[8]  Ronald R. Coifman,et al.  Data Fusion and Multicue Data Matching by Diffusion Maps , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Ann B. Lee,et al.  Diffusion maps and coarse-graining: a unified framework for dimensionality reduction, graph partitioning, and data set parameterization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jianbo Shi,et al.  A Random Walks View of Spectral Segmentation , 2001, AISTATS.

[11]  Daniel Boley,et al.  Principal Direction Divisive Partitioning , 1998, Data Mining and Knowledge Discovery.

[12]  Sergio M. Savaresi,et al.  Choosing the cluster to split in bisecting divisive clustering algorithms , 2006 .

[13]  D. K. Tasoulis,et al.  Improving Principal Direction Divisive Clustering , 2008 .