Ieee Transactions on Signal Processing 1 Spectrum Estimation Using Multirate Observations Edics: 2-spec, 2-mwav, 2-info

In this paper, we are interested in estimating the power spectral density of a stationary random signal x(n) when the signal itself is not available but some low-resolution measurements derived from it are observed. We consider a model where x(n) is being measured using a set of linear multirate sensors. Each sensor outputs a measurement signal v/sub i/(n) whose sampling rate is only a fraction of the sampling rate assumed for the original signal. Based on this model, we pose the following problem: Given certain autocorrelation coefficients of the observable signals v/sub i/(n), estimate the power spectral density of the original signal x(n). It turns out that this problem is ill-posed. We suggest to resolve this issue by using the principle of maximum entropy (ME). We address technical difficulties associated with the ME solution and then devise a practical algorithm for its approximate computation. We demonstrate the viability of this algorithm through simulation examples.

[1]  Jos Uffink,et al.  Can the maximum entropy principle be explained as a consistency requirement , 1995 .

[2]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[3]  Harald Bergstriim.  Mathematical Theory of Probability and Statistics , 1966 .

[4]  Bruce A. Francis,et al.  Relative information of multi-rate sensors , 2004, Inf. Fusion.

[5]  Jos Uffink,et al.  The constraint rule of the maximum entropy principle , 1996 .

[6]  S. Namiki,et al.  Photonic analog-to-digital conversion , 2005, Digest of the LEOS Summer Topical Meetings, 2005..

[7]  Amiel Feinstein,et al.  Information and information stability of random variables and processes , 1964 .

[8]  Marc Teboulle,et al.  Convergence of best phi-entropy estimates , 1993, IEEE Trans. Inf. Theory.

[9]  P. P. Vaidyanathan,et al.  Effects of Multirate Systems on the Statistical Properties of Random Signals , 1993, IEEE Trans. Signal Process..

[10]  Donald B. Percival,et al.  Spectral Analysis for Physical Applications , 1993 .

[11]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[12]  R. Johnson,et al.  Properties of cross-entropy minimization , 1981, IEEE Trans. Inf. Theory.

[13]  I. J. Good,et al.  Theory of Probability Harold Jeffreys (Third edition, 447 + ix pp., Oxford Univ. Press, 84s.) , 1962 .

[14]  Jonathan M. Borwein,et al.  Convergence of Best Entropy Estimates , 1991, SIAM J. Optim..

[15]  V. Kreinovič,et al.  The maximum entropy method , 1979, Nature.

[16]  I. Vajda.  Theory of statistical inference and information , 1989 .

[17]  Jonathan M. Borwein,et al.  Partially-Finite Programming in L1 and the Existence of Maximum Entropy Estimates , 1993, SIAM J. Optim..

[18]  A. S. Leonov,et al.  A generalization of the maximal entropy method for solving ill-posed problems , 2000 .

[19]  A. Tikhonov,et al.  Nonlinear Ill-Posed Problems , 1997 .

[20]  H. Jeffreys,et al.  Theory of probability , 1896 .

[21]  I. Good,et al.  Mathematical Theory of Probability and Statistics , 1966 .

[22]  Jos Uunk,et al.  Can the Maximum Entropy Principle Be Explained as a Consistency Requirement? , 1997 .

[23]  Umberto Amato,et al.  Maximum entropy regularization of Fredholm integral equations of the first kind , 1991 .

[24]  Ryan J. Kuchler.  Theory of Multirate Statistical Signal Processing and Applications , 2005 .

[25]  Martin Klaus,et al.  A Hilbert space approach to maximum entropy reconstruction , 1988 .

[26]  I. Csiszár.  Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[27]  I. Csiszár.  Maxent, Mathematics, and Information Theory , 1996 .

[28]  P. Vaidyanathan.  Multirate Systems And Filter Banks , 1992 .

[29]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[30]  Burkhard Buttkus,et al.  Spectral Analysis and Filter Theory in Applied Geophysics , 2000 .

[31]  E. T. Jaynes,et al.  Papers on probability, statistics and statistical physics , 1983 .

[32]  Heinz W. Engl,et al.  Convergence rates for maximum entropy regularization , 1993 .

[33]  J. Cadzow.  Maximum Entropy Spectral Analysis , 2006 .

[34]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[35]  J. Borwein,et al.  Convex Analysis And Nonlinear Optimization , 2000 .

[36]  Adrian S. Lewis,et al.  Convex Analysis And Nonlinear Optimization , 2000 .

[37]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.