Universal Golomb–Rice Coding Parameter Estimation Using Deep Belief Networks for Hyperspectral Image Compression

For efficient compression of hyperspectral images, we propose a universal Golomb–Rice coding parameter estimation method using deep belief network, which does not rely on any assumption on the distribution of the input data. We formulate the problem of selecting the best coding parameter for a given input sequence as a supervised pattern classification problem. Simulations on the synthesized data and five hyperspectral image datasets show that we can achieve significantly more accurate estimation of the coding parameters, which can translate to slightly higher compression than three state-of-the-art methods. More extensive simulations on additional images from the 2006 AVIRIS datasets show that the proposed method achieved overall compression bitrates comparable with other estimation methods, as well as the sample-adaptive entropy coder employed by the Consultative Committee for Space Data Systems standard for multispectral and hyperspectral data compression. Regarding computational feasibility, we show how to use transferable deep belief networks to speed up training by about five times. We also show that inferring the best coding parameters using a trained deep belief network offers computational advantages over the brute-force search method. As an extension, we propose a novel side-information free codec, where the intersequence correlations can be learned by a differently trained network based on the current sequence to predict reasonably good parameters for coding the next sequence. As another extension, we introduce a variable feature combination architecture, where problem specific heuristics such as the sample means can be incorporated to further improve the estimation accuracy.

[1]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[2]  Yuhang Dong,et al.  Lossless compression of curated erythrocyte images using deep autoencoders for malaria infection diagnosis , 2016, 2016 Picture Coding Symposium (PCS).

[3]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[4]  Tilman Liebchen,et al.  MPEG-4 ALS: an emerging standard for lossless audio coding , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[5]  Yuhang Dong,et al.  Efficient Lossless Compression of 4 D Hyperspectral Image Data , 2016 .

[6]  Robert F. Rice,et al.  Some practical universal noiseless coding techniques , 1979 .

[7]  Quoc V. Le,et al.  Adding Gradient Noise Improves Learning for Very Deep Networks , 2015, ArXiv.

[8]  Solomon W. Golomb,et al.  Run-length encodings (Corresp.) , 1966, IEEE Trans. Inf. Theory.

[9]  Yi Wang,et al.  A novel method for lossless compression of arbitrarily shaped regions of interest in hyperspectral imagery , 2015, SoutheastCon 2015.

[10]  Henrique S. Malvar Adaptive run-length/Golomb-Rice encoding of quantized generalized Gaussian sources with unknown statistics , 2006, Data Compression Conference (DCC'06).

[11]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[12]  W. David Pan,et al.  Fast Golomb coding parameter estimation using partial data and its application in hyperspectral image compression , 2016, SoutheastCon 2016.

[13]  R. Rice,et al.  Adaptive Variable-Length Coding for Efficient Compression of Spacecraft Television Data , 1971 .

[14]  Hongda Shen,et al.  Predictive Lossless Compression of Regions of Interest in Hyperspectral Images With No-Data Regions , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Li-Rong Dai,et al.  Deep belief network-based post-filtering for statistical parametric speech synthesis , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[17]  Marc'Aurelio Ranzato,et al.  Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Guillermo Sapiro,et al.  The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS , 2000, IEEE Trans. Image Process..

[19]  T. Robinson Simple Lossless and Near-lossless Waveform Compression , 1994 .

[20]  Matthew Klimesh,et al.  Exploiting Calibration-Induced Artifacts in Lossless Compression of Hyperspectral Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Joan Bartrina-Rapesta,et al.  JPEG2000 Encoding of Remote Sensing Multispectral Images With No-Data Regions , 2010, IEEE Geoscience and Remote Sensing Letters.

[22]  Jian-Jiun Ding,et al.  Adaptive Golomb Code for Joint Geometrically Distributed Data and Its Application in Image Coding , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[24]  A. Kiely Selecting the Golomb Parameter in Rice Coding , 2004 .

[25]  Hongda Shen,et al.  Predictive lossless compression of regions of interest in hyperspectral image via Maximum Correntropy Criterion based Least Mean Square learning , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[26]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[27]  Matthew A. Klimesh,et al.  Low-complexity lossless compression of hyperspectral imagery via adaptive filtering , 2005 .

[28]  David C. van Voorhis,et al.  Optimal source codes for geometrically distributed integer alphabets (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.