Differential pulse-code modulation (PCM) with entropy coding

As the transmission rate R gets large, differential pulse-code modulation (PCM) when followed by entropy coding forms a source encoding system which performs within 1.53 dB of Shannon's rate distortion function which bounds the performance of any encoding system with a minimum mean-square error (mmse) fidelity criterion. This is true for any ergodic signal source. Furthermore, this source encoder introduces the same amount of uncertainty as the mmse encoder. The 1.53 dB difference between this encoder and the mmse encoder is perceptually so small that it would probably not be noticed by a human user of a high quality (signal-to-noise ratio (S/N) \geq 30 dB) speech or television source encoding system.

[1]  Ira J. Hirsh,et al.  The measurement of hearing , 1954 .

[2]  Toby Berger,et al.  Permutation codes for sources , 1972, IEEE Trans. Inf. Theory.

[3]  Herbert Gish,et al.  Asymptotically efficient quantizing , 1968, IEEE Trans. Inf. Theory.

[4]  D. Huffman.  A Method for the Construction of Minimum-Redundancy Codes , 1952 .

[5]  E. Kretzmer.  Statistics of television signals , 1952 .

[6]  J. M. Barstow,et al.  The measurement of random video interference to monochrome and color television pictures , 1962, Transactions of the American Institute of Electrical Engineers, Part I: Communication and Electronics.

[7]  D. Slepian,et al.  Some computer experiments in picture processing for bandwidth reduction , 1971 .

[8]  C. Harrison.  Experiments with linear prediction in television , 1952 .

[9]  John B. O'Neal.  Bounds on subjective performance measures for source encoding systems , 1971, IEEE Trans. Inf. Theory.

[10]  B. M. Oliver.  Efficient coding , 1952 .

[11]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[12]  Claude E. Shannon,et al.  The Mathematical Theory of Communication , 1950 .

[13]  J. B. O'Neal,et al.  Predictive quantizing systems (differential pulse code modulation) for the transmission of television signals , 1966 .

[14]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[15]  Thomas J. Goblick,et al.  Analog source digitization: A comparison of theory and practice (Corresp.) , 1967, IEEE Trans. Inf. Theory.

[16]  J. O'Neal,et al.  Entropy-Coded Adaptive Differential Pulse-Code Modulation (DPCM) for Speech , 1974, IEEE Trans. Commun..

[17]  Jr. J.B. O'Neal,et al.  A bound on signal-to-quantizing noise ratios for digital encoding systems , 1967 .

[18]  D. A. Lewinski.  A new objective for message circuit noise , 1964 .

[19]  D. A. Lewinski,et al.  Evaluation of message circuit noise , 1960 .

[20]  John B. O'Neal,et al.  Entropy coding in speech and television differential PCM systems (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[21]  ROGER C. WOOD,et al.  On optimum quantization , 1969, IEEE Trans. Inf. Theory.

[22]  Ming-Chwan Chow.  Variable-Length Redundancy Removal Coders for Differentially Coded Video Telephone Signals , 1971 .

[23]  Sandeep Goyal,et al.  Entropy Coded Differential Pulse-Code Modulation Systems for Television , 1975, IEEE Trans. Commun..

[24]  T. Kailath.  The innovations approach to detection and estimation theory , 1970 .

[25]  John B. O'Neal,et al.  Coding isotropic images , 1977, IEEE Trans. Inf. Theory.