Independent Component Analysis for Classifying Multispectral Images with Dimensionality Limitation

Airborne and spaceborne remote sensors can acquire invaluable information about earth surface, which have many important applications. The acquired information usually is represented as two-dimensional grids, i.e. images. One of techniques to processing such images is Independent Component Analysis (ICA), which is particularly useful for classifying objects with unknown spectral signatures in an unknown image scene, i.e. unsupervised classification. Since the weight matrix in ICA is a square matrix for the purpose of mathematical tractability, the number of objects that can be classified is equal to the data dimensionality, i.e. the number of spectral bands. When the number of sensors (or spectral channels) is very small (e.g. a 3-band CIR photograph and 6-band Landsat image with the thermal band being removed), it is impossible to classify all the different objects present in an image scene using the original data. In order to solve this problem, we present a data dimensionality expansion technique to generate artificial bands. Its basic idea is to use nonlinear functions to capture and highlight the similarity/dissimilarity between original spectral measurements, which can provide more data with additional information for detecting and classifying more objects. The results from such a nonlinear band generation approach are compared with a linear band generation method using cubic spline interpolation of pixel spectral signatures. The experiments demonstrate that nonlinear band generation approach can significantly improve unsupervised classification accuracy, while linear band generation method cannot since no new information can be provided. It is also demonstrated that ICA is more powerful than other frequently used unsupervised classification algorithms such as ISODATA.

[1]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[2]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[3]  Chein-I Chang,et al.  Linear spectral random mixture analysis for hyperspectral imagery , 2002, IEEE Trans. Geosci. Remote. Sens..

[4]  Erkki Oja,et al.  The nonlinear PCA learning rule in independent component analysis , 1997, Neurocomputing.

[5]  S. Omatu,et al.  Pattern recognition with neural networks , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[6]  Chein-I Chang,et al.  A generalized orthogonal subspace projection approach to unsupervised multispectral image classification , 2000, IEEE Trans. Geosci. Remote. Sens..

[7]  J. Auzins,et al.  Automotive electronics/spl minus/getting in gear for the 90s and beyond , 1994 .

[8]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[9]  R. Singer,et al.  Mars - Large scale mixing of bright and dark surface materials and implications for analysis of spectral reflectance , 1979 .

[10]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[11]  J. Settle,et al.  Linear mixing and the estimation of ground cover proportions , 1993 .

[12]  Qian Du,et al.  Implementation of real-time constrained linear discriminant analysis to remote sensing image classification , 2005, Pattern Recognit..

[13]  Steven Noel,et al.  Multimedia authenticity protection with ICA watermarking and digital bacteria vaccination , 2003, Neural Networks.

[14]  Simone G. O. Fiori,et al.  Overview of independent component analysis technique with an application to synthetic aperture radar (SAR) imagery processing , 2003, Neural Networks.

[15]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[16]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[17]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[18]  Xiaohui Zhang,et al.  Independent component analysis for remote sensing study , 1999, Remote Sensing.

[19]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[20]  Andrzej Cichocki,et al.  New learning algorithm for blind separation of sources , 1992 .

[21]  Harold H. Szu,et al.  ICA neural net to refine remote sensing with multiple labels , 2000, SPIE Defense + Commercial Sensing.

[22]  T. Tu Unsupervised signature extraction and separation in hyperspectral images: a noise-adjusted fast independent component analysis approach , 2000 .

[23]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[24]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[25]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[26]  P. McCullagh Tensor Methods in Statistics , 1987 .

[27]  Paul E. Johnson,et al.  Spectral mixture modeling: A new analysis of rock and soil types at the Viking Lander 1 Site , 1986 .

[28]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[29]  Mark A. Friedl,et al.  Spatio-temporal deconvolution of NDVI image sequences using independent component analysis , 2003, IEEE Trans. Geosci. Remote. Sens..

[30]  Harold Szu Geometric Topology for Information Acquisition by Means of Smart Sensor Web , 2004, Int. J. Inf. Acquis..

[31]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[32]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[33]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[34]  C. Pieters,et al.  Remote geochemical analysis : elemental and mineralogical composition , 1993 .