A Diffusion Approach to Unsupervised Segmentation of Hyper-Spectral Images

Hyper-spectral cameras capture images at hundreds and even thousands of wavelengths. These hyper-spectral images offer orders of magnitude more intensity information than RGB images. This information can be utilized to obtain segmentation results which are superior to those that are obtained using RGB images. However, many of the wavelengths are correlated and many others are noisy. Consequently, the hyper-spectral data must be preprocessed prior to the application of any segmentation algorithm. Such preprocessing must remove the noise and inter-wavelength correlations and due to complexity constraints represent each pixel by a small number of features which capture the structure of the image. The contribution of this paper is three-fold. First, we utilize the diffusion bases dimensionality reduction algorithm (Schclar and Averbuch in Diffusion bases dimensionality reduction, pp. 151–156, [1]) to derive the features which are needed for the segmentation. Second, we describe a faster version of the diffusion bases algorithm which uses symmetric matrices. Third, we propose a simple algorithm for the segmentation of the dimensionality reduced image. Successful application of the algorithms to hyper-spectral microscopic images and remote-sensed hyper-spectral images demonstrate the effectiveness of the proposed algorithms.

[1]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[3]  Qiang Zhang,et al.  Hyperspectral image segmentation, deblurring, and spectral analysis for material identification , 2010, Defense + Commercial Sensing.

[4]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[5]  Antonio J. Plaza,et al.  Supervised hyperspectral image segmentation using active learning , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[6]  W. B. Johnson,et al.  Extensions of Lipschitz mappings into Hilbert space , 1984 .

[7]  Amir Averbuch,et al.  Unsupervised Segmentation of Hyper-spectral Images via Diffusion Bases , 2017, IJCCI.

[8]  Xavier Bresson,et al.  Segmentation for Hyperspectral Images with Priors , 2010, ISVC.

[9]  Amir Averbuch,et al.  A diffusion framework for detection of moving vehicles , 2010, Digit. Signal Process..

[10]  Amir Averbuch,et al.  Diffusion bases dimensionality reduction , 2015, 2015 7th International Joint Conference on Computational Intelligence (IJCCI).

[11]  Alon Schclar,et al.  A Diffusion Framework for Dimensionality Reduction , 2008, Soft Computing for Knowledge Discovery and Data Mining.

[12]  Kyogu Lee,et al.  Analysis of hyperspectral colon tissue images using vocal synthesis models , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[13]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[14]  Amir Averbuch,et al.  Delineation of malignant skin tumors by hyperspectral imaging using diffusion maps dimensionality reduction , 2015, Biomed. Signal Process. Control..