On the optimality of code options for a universal noiseless coder

A universal noiseless coding structure was developed that provides efficient performance over an extremely broad range of source entropy. This is accomplished by adaptively selecting the best of several easily implemented variable length coding algorithms. Custom VLSI coder and decoder modules capable of processing over 20 million samples per second are currently under development. The first of the code options used in this module development is shown to be equivalent to a class of Huffman code under the Humblet condition, other options are shown to be equivalent to the Huffman codes of a modified Laplacian symbol set, at specified symbol entropy values. Simulation results are obtained on actual aerial imagery, and they confirm the optimality of the scheme. On sources having Gaussian or Poisson distributions, coder performance is also projected through analysis and simulation.

[1]  D. Huffman A Method for the Construction of Minimum-Redundancy Codes , 1952 .

[2]  R. F. Rice,et al.  Noiseless coding for the magnetometer , 1987 .

[3]  E. E. Hilbert,et al.  Block adaptive rate controlled image data compression , 1979 .

[4]  Hatsukazu Tanaka,et al.  Data structure of Huffman codes and its application to efficient encoding and decoding , 1987, IEEE Trans. Inf. Theory.

[5]  Julia Abrahams,et al.  On the redundancy of optimal binary prefix-condition codes for finite and infinite sources , 1987, IEEE Trans. Inf. Theory.

[6]  Pierre A. Humblet,et al.  Optimal source coding for a class of integer alphabets (Corresp.) , 1978, IEEE Trans. Inf. Theory.

[7]  Jeffrey Scott Vitter,et al.  Design and analysis of dynamic Huffman codes , 1987, JACM.

[8]  R. F. Rice,et al.  Noiseless coding for the Gamma Ray spectrometer , 1985 .

[9]  R. F. Rice,et al.  Some practical universal noiseless coding techniques, part 2 , 1983 .

[10]  R. F. Rice,et al.  Algorithms for a very high speed universal noiseless coding module , 1991 .

[11]  Inder Jeet Taneja,et al.  Bounds on the redundancy of Huffman codes , 1986, IEEE Trans. Inf. Theory.

[12]  Robert F. Rice,et al.  Some practical universal noiseless coding techniques , 1979 .

[13]  Donald E. Knuth,et al.  Dynamic Huffman Coding , 1985, J. Algorithms.

[14]  R. Nigel Horspool,et al.  Algorithms for Adaptive Huffman Codes , 1984, Inf. Process. Lett..

[15]  Robert G. Gallager,et al.  Variations on a theme by Huffman , 1978, IEEE Trans. Inf. Theory.