Maximum Entropy and the Method of Moments in Performance Evaluation of Digital Communications Systems

The maximum entropy criterion for estimating an unknown probability density function from its moments is applied to the evaluation of the average error probability in digital communications. Accurate averages are obtained, even when a few moments are available. The method is stable and results compare well with those from the powerful and widely used Gauss quadrature rules (GQR) method. For test cases presented in this work, the maximum entropy method achieved results with typically a few moments, while the GQR method required many more moments to obtain the same, as accurately. The method requires about the same number of moments as techniques based on orthogonal expansions. In addition, it provides an estimate of the probability density function of the target variable in a digital communication application.

[1]  A. Papoulis.  Maximum entropy and spectral estimation: A review , 1981 .

[2]  L. Mead,et al.  Maximum entropy in the problem of moments , 1984 .

[3]  Jan M. Van Campenhout,et al.  Maximum entropy and conditional probability , 1981, IEEE Trans. Inf. Theory.

[4]  Y. S. Yeh,et al.  A new approach for evaluating the error probability in the presence of intersymbol interference and additive Gaussian noise , 1970, Bell Syst. Tech. J..

[5]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[6]  V. K. Prabhu,et al.  Some considerations of error bounds in digital systems , 1971 .

[7]  V. Prabhu,et al.  Error-Rate Considerations for Digital Phase-Modulation Systems , 1969 .

[8]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[9]  Claude E. Shannon,et al.  A Mathematical Theory of Communications , 1948 .

[10]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.

[11]  M. H. Meyers,et al.  Computing the distribution of a random variable via Gaussian quadrature rules , 1982, The Bell System Technical Journal.

[12]  M. Kavehrad,et al.  Performance of cross-polarized M-ary QAM signals over nondispersive fading channels , 1984, AT&T Bell Laboratories Technical Journal.

[13]  Sergio Benedetto,et al.  Error Probability in the Presence of Intersymbol Interference and Additive Noise for Multilevel Digital Signals , 1973, IEEE Trans. Commun..

[14]  R. Weinstock.  Calculus of Variations: with Applications to Physics and Engineering , 1952 .

[15]  Mohsen Kavehrad,et al.  On the Performance of Combined Quadrature Amplitude Modulation and Convolutional Codes for Cross-Coupled Multidimensional Channels , 1986, IEEE Trans. Commun..

[16]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[17]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[18]  J. Murphy.  Binary Error Rate Caused by Intersymbol Interference and Gaussian Noise , 1973, IEEE Trans. Commun..

[19]  M. Celebiler,et al.  The Probability of Error Due to Intersymbol Interference and Gaussian Noise in Digital Communication Systems , 1971 .

[20]  R W Lucky,et al.  Principles of data communication , 1968 .