Golomb-Rice coding parameter learning using deep belief network for hyperspectral image compression

While Golomb-Rice codes are optimal for geometrically distributed source, the practically achievable coding efficiency depends on the accuracy of the coding parameter estimated from the input data. Most existing methods are based on the assumption of geometric distribution and thus would suffer from a loss in coding efficiency if the underlying distribution deviates from the geometric distribution, which is usually the case in practice. We proposed a data-driven parameter estimation method without assuming the underlying distribution. We formulated the problem of choosing the best coding parameter for the given input data as a pattern classification problem. To this end, we trained a deep belief network using the data segments to be coded, along with their “labels”, which are the optimal coding parameters that yield the shortest codewords. Simulations on data synthesized using statistical models, as well as data in hyperspectral image coding showed that the proposed deep learning method tended to be more robust than several state-of-the-art parameter estimation methods, with the capability to further improve the accuracies of these methods.

[1]  Matthew A. Klimesh,et al.  Low-complexity lossless compression of hyperspectral imagery via adaptive filtering , 2005 .

[2]  Laurenz Wiskott,et al.  Gaussian-binary restricted Boltzmann machines for modeling natural image statistics , 2014, PloS one.

[3]  Solomon W. Golomb,et al.  Run-length encodings (Corresp.) , 1966, IEEE Trans. Inf. Theory.

[4]  Jian-Jiun Ding,et al.  Adaptive Golomb Code for Joint Geometrically Distributed Data and Its Application in Image Coding , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  W. David Pan,et al.  Fast Golomb coding parameter estimation using partial data and its application in hyperspectral image compression , 2016, SoutheastCon 2016.

[6]  Hongda Shen,et al.  Predictive Lossless Compression of Regions of Interest in Hyperspectral Images With No-Data Regions , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Li-Rong Dai,et al.  Deep belief network-based post-filtering for statistical parametric speech synthesis , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[9]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[10]  Robert F. Rice,et al.  Some practical universal noiseless coding techniques , 1979 .

[11]  Yuriy Reznik,et al.  Low-complexity lossless codes for image and video coding , 2010, Optical Engineering + Applications.

[12]  A. Kiely Selecting the Golomb Parameter in Rice Coding , 2004 .