Novel multivariate vector quantization for effective compression of hyperspectral imagery

Although hyperspectral imagery (HSI) has been successfully deployed in a wide range of applications, it suffers from extremely large data volumes for storage and transmission. Consequently, coding and compression is needed for effective data reduction whilst maintaining the image integrity. In this paper, a multivariate vector quantization (MVQ) approach is proposed for the compression of HSI, where the pixel spectra is considered as a linear combination of two codewords from the codebook, and the indexed maps and their corresponding coefficients are separately coded and compressed. A strategy is proposed for effective codebook design, using the fuzzy C-mean (FCM) to determine the optimal number of clusters of data and selected codewords for the codebook. Comprehensive experiments on several real datasets are used for performance assessment, including quantitative evaluations to measure the degree of data reduction and the distortion of reconstructed images. Our results have indicated that the proposed MVQ approach outperforms conventional VQ and several typical algorithms for effective compression of HSI, where the image quality measured using mean squared error (MSE) has been significantly improved even under the same level of compressed bitrate.

[1]  Ye Zhang,et al.  A BOI-Preserving-Based Compression Method for Hyperspectral Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Enrico Magli,et al.  Low-complexity predictive lossy compression of hyperspectral and ultraspectral images , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Shen-En Qian Fast vector quantization algorithms based on nearest partition set search , 2006, IEEE Transactions on Image Processing.

[4]  Stephen Marshall,et al.  Effective Feature Extraction and Data Reduction in Remote Sensing Using Hyperspectral Imaging [Applications Corner] , 2014, IEEE Signal Processing Magazine.

[5]  William A. Pearlman,et al.  Compression of Hyperspectral Images with LVQ-SPECK , 2008, Data Compression Conference (dcc 2008).

[6]  Junwei Han,et al.  Novel Folded-PCA for improved feature extraction and data reduction with hyperspectral imaging and SAR in remote sensing , 2014 .

[7]  Shen-En Qian,et al.  Hyperspectral data compression using a fast vector quantization algorithm , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Chunhui Zhao,et al.  Improved sparse representation using adaptive spatial support for effective target detection in hyperspectral imagery , 2013 .

[9]  Min Huang,et al.  [Interference hyperspectral data compression based on spectral classification and local DPCM]. , 2013, Guang pu xue yu guang pu fen xi = Guang pu.

[10]  Sebastián López,et al.  Performance Evaluation of the H.264/AVC Video Coding Standard for Lossy Hyperspectral Image Compression , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  H. B. Kekre,et al.  Fast Codevector Search Algorithm for 3-D Vector Quantized Codebook , 2009 .

[12]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[13]  Mehran Yazdi,et al.  Compression of Hyperspectral Images Using Discerete Wavelet Transform and Tucker Decomposition , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Yuan Liang,et al.  Lossless compression of hyperspectral images using hybrid context prediction. , 2012, Optics express.

[15]  Nasser M. Nasrabadi,et al.  Automated Hyperspectral Cueing for Civilian Search and Rescue , 2009, Proceedings of the IEEE.

[16]  Yin-Tsung Hwang,et al.  Lossless Compression of Hyperspectral Images Using Adaptive Prediction and Backward Search Schemes , 2011, J. Inf. Sci. Eng..

[17]  Enrico Magli,et al.  Transform Coding Techniques for Lossy Hyperspectral Data Compression , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jun Wang,et al.  Fast Implementation of Singular Spectrum Analysis for Effective Feature Extraction in Hyperspectral Imaging , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Ian Blanes,et al.  Pairwise Orthogonal Transform for Spectral Image Coding , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[20]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[21]  Corinne Mailhes,et al.  Quality criteria benchmark for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Zhe Liu,et al.  Structured covariance principal component analysis for real-time onsite feature extraction and dimensionality reduction in hyperspectral imaging. , 2014, Applied optics.

[23]  Qian Du,et al.  Hyperspectral Image Compression Using JPEG2000 and Principal Component Analysis , 2007, IEEE Geoscience and Remote Sensing Letters.

[24]  Sildomar T. Monteiro,et al.  Evaluating Classification Techniques for Mapping Vertical Geology Using Field-Based Hyperspectral Sensors , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Shen-En Qian,et al.  Near lossless data compression onboard a hyperspectral satellite , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[26]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[27]  Alaitz Zabala,et al.  Impact of lossy compression on mapping crop areas from remote sensing , 2013 .

[28]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2013, The Kluwer international series in engineering and computer science.

[29]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[30]  Bormin Huang,et al.  Lossless Compression of Hyperspectral Images Using Clustered Linear Prediction With Adaptive Prediction Length , 2012, IEEE Geoscience and Remote Sensing Letters.

[31]  William A. Pearlman,et al.  Three-Dimensional Wavelet-Based Compression of Hyperspectral Images , 2006, Hyperspectral Data Compression.

[32]  Laurent Tits,et al.  The Potential and Limitations of a Clustering Approach for the Improved Efficiency of Multiple Endmember Spectral Mixture Analysis in Plant Production System Monitoring , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jia Wen,et al.  An adaptive VQ method used on interferential multi-spectral image lossless compression , 2011 .

[34]  Vivek K. Goyal,et al.  Distributed Functional Scalar Quantization Simplified , 2012, IEEE Transactions on Signal Processing.

[35]  N.B. Karayiannis,et al.  Fuzzy vector quantization algorithms and their application in image compression , 1995, IEEE Trans. Image Process..

[36]  K. Moffett,et al.  Remote Sens , 2015 .