Cost and Scalability Improvements to the Karhunen–Loêve Transform for Remote-Sensing Image Coding

The Karhunen-Loêve transform (KLT) is widely used in hyperspectral image compression because of its high spectral decorrelation properties. However, its use entails a very high computational cost. To overcome this computational cost and to increase its scalability, in this paper, we introduce a multilevel clustering approach for the KLT. As the set of different multilevel clustering structures is very large, a two-stage process is used to carefully pick the best members for each specific situation. First, several candidate structures are generated through local search and eigenthresholding methods, and then, candidates are further screened to select the best clustering configuration. Two multilevel clustering combinations are proposed for hyperspectral image compression: one with the coding performance of the KLT but with much lower computational requirements and increased scalability and another one that outperforms a lossy wavelet transform, as spectral decorrelator, in quality, cost, and scalability. Extensive experimental validation is performed, with images from both the AVIRIS and Hyperion sets, and with JPEG2000, 3D-TCE, and CCSDS-Image Data Compression recommendation as image coders. Experiments also include classification-based results produced by k-means clustering and Reed-Xiaoli anomaly detection.

[1]  W. Yodchanan,et al.  Lossless compression for 3-D MRI data using reversible KLT , 2008, 2008 International Conference on Audio, Language and Image Processing.

[2]  J. Horn A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[3]  Fons A. M. L. Bruekers,et al.  New Networks for Perfect Inversion and Perfect Reconstruction , 1992, IEEE J. Sel. Areas Commun..

[4]  Irving S. Reed,et al.  Fast approximate Karhunen-Loève transform with applications to digital image coding , 1993, Other Conferences.

[5]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[6]  Joan Serra-Sagristà,et al.  Extending the CCSDS Recommendation for Image Data Compression for Remote Sensing Scenarios , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[7]  H. Akaike A new look at the statistical model identification , 1974 .

[8]  Enrico Magli,et al.  Error-Resilient and Low-Complexity Onboard Lossless Compression of Hyperspectral Images by Means of Distributed Source Coding , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Matthew Klimesh,et al.  Low-complexity adaptive lossless compression of hyperspectral imagery , 2006, SPIE Optics + Photonics.

[10]  Luisa Verdoliva,et al.  Classified , 1990 .

[11]  Saverio Salzo,et al.  Lossless hyperspectral compression using KLT , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[12]  W. H. Farrand,et al.  Determining the number and identity of spectral endmembers; an integrated approach using Neyman-Person eigen-thresholding and iterative constrained RMS error minimization , 1993 .

[13]  Ian Blanes,et al.  Clustered Reversible-KLT for Progressive Lossy-to-Lossless 3d Image Coding , 2009, 2009 Data Compression Conference.

[14]  Soontorn Oraintara,et al.  Integer sub-optimal Karhunen-Loeve transform for multi-channel lossless EEG compression , 2006, 2006 14th European Signal Processing Conference.

[15]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[16]  Edmund R. Malinowski,et al.  Determination of the number of factors and the experimental error in a data matrix , 1977 .

[17]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[18]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[19]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[20]  Gene H. Golub,et al.  Matrix computations , 1983 .

[21]  James E. Fowler QccPack: an open-source software library for quantization, compression, and coding , 2000, Proceedings DCC 2000. Data Compression Conference.

[22]  A. Lucero,et al.  Evaluating residual coding with JPEG2000 for L-infinity driven hyperspectral image compression , 2005, SPIE Optics + Photonics.

[23]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[24]  Enrico Magli,et al.  Unified Lossy and Near-Lossless Hyperspectral Image Compression Based on JPEG 2000 , 2008, IEEE Geoscience and Remote Sensing Letters.

[25]  I.S. Reed,et al.  A new approximate Karhunen-Loeve transform for data compression , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[26]  Enrico Magli,et al.  Transform Coding Techniques for Lossy Hyperspectral Data Compression , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[28]  Matthew Klimesh,et al.  Exploiting Calibration-Induced Artifacts in Lossless Compression of Hyperspectral Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jing Zhang,et al.  Lossy-to-Lossless Compression of Hyperspectral Imagery Using Three-Dimensional TCE and an Integer KLT , 2008, IEEE Geoscience and Remote Sensing Letters.

[30]  Pengwei Hao,et al.  Matrix factorizations for reversible integer mapping , 2001, IEEE Trans. Signal Process..

[31]  Jarno Mielikäinen,et al.  Lossless Compression of Hyperspectral Images Using a Quantized Index to Lookup Tables , 2008, IEEE Geoscience and Remote Sensing Letters.

[32]  Enrico Magli,et al.  Hyperspectral Image Compression Employing a Model of Anomalous Pixels , 2007, IEEE Geoscience and Remote Sensing Letters.