Pattern Recognition in High-Dimensional Data

Vast amounts of data are produced all the time. Yet this data does not easily equate to useful information: extracting information from large amounts of high dimensional data is nontrivial. People are simply drowning in data. A recent and growing source of high-dimensional data is hyperspectral imaging. Hyperspectral images allow for massive amounts of spectral information to be contained in a single image. In this thesis, a robust supervised machine learning algorithm is developed to efficiently perform binary object classification on hyperspectral image data by making use of the geometry of Grassmann manifolds. This algorithm can consistently distinguish between a large range of even very similar materials, returning very accurate classification results with very little training data. When distinguishing between dissimilar locations like crop fields and forests, this algorithm consistently classifies more than 95 percent of points correctly. On more similar materials, more than 80 percent of points are classified correctly. This algorithm will allow for very accurate information to be extracted from these large and complicated hyperspectral images.

[1]  R. Mahony,et al.  A Newton algorithm for invariant subspace computation with large basins of attraction , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[2]  Jun He,et al.  Adaptive Stochastic Gradient Descent on the Grassmannian for Robust Low-Rank Subspace Recovery , 2016, IET Signal Process..

[3]  Andrea L. Bertozzi,et al.  Detection and tracking of gas plumes in LWIR hyperspectral video sequence data , 2013, Defense, Security, and Sensing.

[4]  P. Absil,et al.  Riemannian Geometry of Grassmann Manifolds with a View on Algorithmic Computation , 2004 .

[5]  Robert D. Nowak,et al.  High-dimensional Matched Subspace Detection when data are missing , 2010, 2010 IEEE International Symposium on Information Theory.

[6]  John P. Kerekes,et al.  Hyperspectral Imaging System Modeling , 2003 .

[7]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[8]  Peter A. Mitchell,et al.  Hyperspectral digital imagery collection experiment (HYDICE) , 1995, Remote Sensing.

[9]  Jinbo Bi,et al.  Dimensionality Reduction via Sparse Support Vector Machines , 2003, J. Mach. Learn. Res..

[10]  Laura Balzano,et al.  Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Gary A. Shaw,et al.  Spectral Imaging for Remote Sensing , 2003 .

[12]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[13]  L. Saul,et al.  An Introduction to Locally Linear Embedding , 2001 .

[14]  Michael Kirby,et al.  Classification of hyperspectral imagery on embedded Grassmannians , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[15]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Brian C. Lovell,et al.  Clustering on Grassmann manifolds via kernel embedding with application to action analysis , 2012, 2012 19th IEEE International Conference on Image Processing.

[17]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[18]  Bamdev Mishra,et al.  Manopt, a matlab toolbox for optimization on manifolds , 2013, J. Mach. Learn. Res..

[19]  Mehrtash Tafazzoli Harandi,et al.  From Manifold to Manifold: Geometry-Aware Dimensionality Reduction for SPD Matrices , 2014, ECCV.

[20]  Tao Tao,et al.  Iterative Grassmannian optimization for robust image alignment , 2013, Image Vis. Comput..

[21]  Marina V. A. Murzina,et al.  Dynamic hyperspectral imaging , 2005, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[22]  Daniel D. Lee,et al.  Extended Grassmann Kernels for Subspace-Based Learning , 2008, NIPS.

[23]  Sofya Chepushtanova.  Algorithms for feature selection and pattern recognition on grassmann manifolds , 2015 .

[24]  Pierre R. Bushel,et al.  Improved Sparse Multi-Class SVM and Its Application for Gene Selection in Cancer Classification , 2013, Cancer informatics.

[25]  M. Griffin,et al.  Compensation of Hyperspectral Data for Atmospheric Effects , 2003 .

[26]  Guangming Shi,et al.  High-speed hyperspectral video acquisition with a dual-camera architecture , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Mauricio Villegas Santamaría.  Contributions to high-dimensional pattern recognition , 2011 .

[28]  Brian C. Lovell,et al.  Object tracking via non-Euclidean geometry: A Grassmann approach , 2014, IEEE Winter Conference on Applications of Computer Vision.

[29]  Michael Wimmer,et al.  Practical Spectral Photography , 2012, Comput. Graph. Forum.

[30]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Stephen J. Wright,et al.  On GROUSE and incremental SVD , 2013, 2013 5th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[32]  John C. S. Lui,et al.  Online Robust Subspace Tracking from Partial Information , 2011, ArXiv.

[33]  Torbjørn Skauli,et al.  A collection of hyperspectral images for imaging systems research , 2013, Electronic Imaging.

[34]  M. F. Baumgardner,et al.  220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3 , 2015 .