Graph based hyperspectral image segmentation with improved affinity matrix

Image segmentation and clustering is a method to extract a set of components whose members are similar in some way. Instead of focusing on the consistencies of local image characteristics such as borders and regions in a perceptual way, the spectral graph theoretic approach is based on the eigenvectors of an affinity matrix; therefore it captures perceptually important non-local properties of an image. A typical spectral graph segmentation algorithm, normalized cuts, incorporates both the dissimilarity between groups and similarity within groups by capturing global consistency making the segmentation process more balanced and stable. For spectral graph partitioning, we create a graph-image representation wherein each pixel is taken as a graph node, and two pixels are connected by an edge based on certain similarity criteria. In most cases, nearby pixels are likely to be in the same region, therefore each pixel is connected to its spatial neighbors in the normalized cut algorithm. However, this ignores the difference between distinct groups or the similarity within a group. A hyperspectral image contains high spatial correlation among pixels, but each pixel is better described by its high dimensional spectral feature vector which provides more information when characterizing the similarities among every pair of pixels. Also, to facilitate the fact that boundary usually resides in low density regions in spectral domain, a local density adaptive affinity matrix is presented in this paper. Results will be shown for airborne hyperspectral imagery collected with the HyMAP, AVIRIS, HYDICE sensors.

[1]  Shaveta Rani,et al.  Optimal Keyless Algorithm for Security , 2015 .

[2]  Hanan Samet,et al.  Region representation: quadtrees from boundary codes , 1980, CACM.

[3]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[4]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  David W. Messinger,et al.  Techniques for the graph representation of spectral imagery , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[6]  Qingsheng Zhu,et al.  Adaptive Neighborhood Graph for LTSA Learning Algorithm without FreeParameter , 2011 .

[7]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[8]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[9]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[10]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[11]  Jeffrey H. Bowles,et al.  Hyperspectral image segmentation using spatial-spectral graphs , 2012, Defense + Commercial Sensing.

[12]  David W. Messinger,et al.  A semi-supervised classification algorithm using the TAD-derived background as training data , 2013, Defense, Security, and Sensing.

[13]  Jianbo Shi,et al.  A Random Walks View of Spectral Segmentation , 2001, AISTATS.

[14]  B. Mohar THE LAPLACIAN SPECTRUM OF GRAPHS y , 1991 .

[15]  Claude L. Fennema,et al.  Scene Analysis Using Regions , 1970, Artif. Intell..

[16]  George Karypis,et al.  A Comparison of Document Clustering Techniques , 2000 .

[17]  N. H. C. Yung,et al.  A Novel Merging Criterion Incorporating Boundary Smoothness and Region Homogeneity for Image Segmentation , 2006, PSIVT.