A Novel Rate Control Algorithm for Onboard Predictive Coding of Multispectral and Hyperspectral Images

Predictive coding is attractive for compression on board of spacecraft due to its low computational complexity, modest memory requirements, and the ability to accurately control quality on a pixel-by-pixel basis. Traditionally, predictive compression focused on the lossless and near-lossless modes of operation, where the maximum error can be bounded but the rate of the compressed image is variable. Rate control is considered a challenging problem for predictive encoders due to the dependencies between quantization and prediction in the feedback loop and the lack of a signal representation that packs the signal's energy into few coefficients. In this paper, we show that it is possible to design a rate control scheme intended for onboard implementation. In particular, we propose a general framework to select quantizers in each spatial and spectral region of an image to achieve the desired target rate while minimizing distortion. The rate control algorithm allows achieving lossy near-lossless compression and any in-between type of compression, e.g., lossy compression with a near-lossless constraint. While this framework is independent of the specific predictor used, in order to show its performance, in this paper, we tailor it to the predictor adopted by the CCSDS-123 lossless compression standard, obtaining an extension that allows performing lossless, near-lossless, and lossy compression in a single package. We show that the rate controller has excellent performance in terms of accuracy in the output rate, rate-distortion characteristics, and is extremely competitive with respect to state-of-the-art transform coding.

[1]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[2]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2013, The Kluwer international series in engineering and computer science.

[3]  Luciano Alparone,et al.  Lossless compression of multi/hyper-spectral imagery based on a 3-D fuzzy prediction , 1999, IEEE Trans. Geosci. Remote. Sens..

[4]  Shen-En Qian Satellite Data Compression , 2013 .

[5]  Luciano Alparone,et al.  Near-lossless compression of 3-D optical data , 2001, IEEE Trans. Geosci. Remote. Sens..

[6]  Enrico Magli,et al.  Unified Lossy and Near-Lossless Hyperspectral Image Compression Based on JPEG 2000 , 2008, IEEE Geoscience and Remote Sensing Letters.

[7]  I.S. Reed,et al.  A new approximate Karhunen-Loeve transform for data compression , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[8]  Enrico Magli,et al.  Error-Resilient and Low-Complexity Onboard Lossless Compression of Hyperspectral Images by Means of Distributed Source Coding , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Luciano Alparone,et al.  Crisp and Fuzzy Adaptive Spectral Predictions for Lossless and Near-Lossless Compression of Hyperspectral Imagery , 2007, IEEE Geoscience and Remote Sensing Letters.

[10]  Matthew Klimesh,et al.  Exploiting Calibration-Induced Artifacts in Lossless Compression of Hyperspectral Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.

[12]  John F. Arnold,et al.  The lossless compression of AVIRIS images by vector quantization , 1997, IEEE Trans. Geosci. Remote. Sens..

[13]  J M Bramble,et al.  Image data compression. , 1988, Investigative radiology.

[14]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[15]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[16]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[17]  Luciano Alparone,et al.  Lossless image compression by quantization feedback in a content-driven enhanced Laplacian pyramid , 1997, IEEE Trans. Image Process..

[18]  Jukka Teuhola,et al.  A Compression Method for Clustered Bit-Vectors , 1978, Inf. Process. Lett..

[19]  Sung Ho Cho,et al.  Tracking analysis of the sign algorithm in nonstationary environments , 1990, IEEE Trans. Acoust. Speech Signal Process..

[20]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[21]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[22]  Irving S. Reed,et al.  Fast approximate Karhunen-Loève transform with applications to digital image coding , 1993, Other Conferences.

[23]  J. Mielikainen,et al.  Lossless compression of hyperspectral images using lookup tables , 2006, IEEE Signal Processing Letters.

[24]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[25]  Giovanni Motta,et al.  Low-complexity lossless compression of hyperspectral imagery via linear prediction , 2005, IEEE Signal Processing Letters.

[26]  Jerome M. Shapiro,et al.  Optimal bit allocation in the presence of quantizer feedback , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[27]  Corinne Mailhes,et al.  Quality criteria benchmark for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[29]  G. Nigel Martin,et al.  * Range encoding: an algorithm for removing redundancy from a digitised message , 1979 .

[30]  Sanjit K. Mitra,et al.  . Optimum bit allocation and accurate rate control for video coding via ρ-domain source modeling , 2002, IEEE Trans. Circuits Syst. Video Technol..

[31]  Manuel Laguna,et al.  Tabu Search , 1997 .

[32]  Antonio Ortega,et al.  Optimal trellis-based buffered compression and fast approximations , 1994, IEEE Trans. Image Process..

[33]  Harvey J. Everett Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[34]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[35]  Ian Blanes,et al.  Pairwise Orthogonal Transform for Spectral Image Coding , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Ian Blanes,et al.  Performance impact of parameter tuning on the CCSDS-123 lossless multi- and hyperspectral image compression standard , 2013 .

[37]  Michael P. Friedlander,et al.  Probing the Pareto Frontier for Basis Pursuit Solutions , 2008, SIAM J. Sci. Comput..

[38]  Christian Steinruecken,et al.  Lossless Data Compression , 2009, Encyclopedia of Database Systems.

[39]  Matthew A. Klimesh,et al.  Low-complexity lossless compression of hyperspectral imagery via adaptive filtering , 2005 .

[40]  Xiaolin Wu,et al.  Linfinity constrained high-fidelity image compression via adaptive context modeling , 2000, IEEE Trans. Image Process..

[41]  Donald A. Adjeroh,et al.  Edge-Based Prediction for Lossless Compression of Hyperspectral Images , 2007, 2007 Data Compression Conference (DCC'07).