Some Remarks on the Role of Inaccuracy in Shannon’s Theory of Information Transmission

The paper contains an approach to the problems of universal encoding and decoding which is based on the concept of inaccuracy. The areas of noiseless source coding, source coding for noisy channels and channel coding and decoding are covered. Another purpose of the paper is to get a deeper understanding of the role of inaccuracy in the theory of information transmission.

[1]  C. T. Ng.  Representation for Measures of Information with the Branching Property , 1974, Inf. Control..

[2]  R. Gray,et al.  A Generalization of Ornstein's $\bar d$ Distance with Applications to Information Theory , 1975 .

[3]  P. Kannappan.  On directed divergence and inaccuracy , 1972 .

[4]  Robert G. Gallager,et al.  A simple derivation of the coding theorem and some applications , 1965, IEEE Trans. Inf. Theory.

[5]  D. Blackwell,et al.  The Capacity of a Class of Channels , 1959 .

[6]  Jacob Ziv,et al.  Coding of sources with unknown statistics-I: Probability of encoding error , 1972, IEEE Trans. Inf. Theory.

[7]  Jim K. Omura,et al.  A coding theorem for discrete-time sources , 1973, IEEE Trans. Inf. Theory.

[8]  Irvin G. Stiglitz,et al.  Coding for a class of unknown channels , 1966, IEEE Trans. Inf. Theory.

[9]  D. Kerridge.  Inaccuracy and Inference , 1961 .

[10]  A. M. Ostrowski,et al.  On the characterization of Shannon's entropy by Shannon's inequality , 1973, Journal of the Australian Mathematical Society.

[11]  Jacob Wolfowitz.  Coding Theorems of Information Theory , 1962 .

[12]  P. Nath.  Inaccuracy and coding theory , 1968 .

[13]  David L. Neuhoff,et al.  Fixed rate universal block source coding with a fidelity criterion , 1975, IEEE Trans. Inf. Theory.

[14]  Edgar N. Gilbert,et al.  Codes based on inaccurate source probabilities , 1971, IEEE Trans. Inf. Theory.

[15]  Lee D. Davisson,et al.  Universal noiseless coding , 1973, IEEE Trans. Inf. Theory.

[16]  P. Fischer.  On the inequality Σpif(pi)≥ pif(qi) , 1972 .

[17]  Yogeshwar Dayal Mathur.  Information Improvement and Computation of the Rate-Distortion Function Under True and Inaccurate Input Distributions , 1974, J. Inf. Process. Cybern..

[18]  DAVID J. SAKRISON,et al.  The Rate Distortion Function for a Class of Sources , 1969, Inf. Control..