On the threshold effect in the estimation of chaotic sequences

Chaotic sequences and chaotic dynamical systems are attractive candidates for use in signal synthesis and analysis as well as in communications applications. In previous works, various methods for the estimation of chaotic sequences under noise were developed. However, although the methods were different, their qualitative performance was the same: for high signal-to-noise ratio (SNR) the performance was good, but below some threshold SNR, a sharp degradation in performance occurred. We prove and quantify the existence of this threshold effect and derive lower bounds on the value of the threshold SNR. Using information-theoretic tools, we prove that for any ergodic chaotic system, there is a certain threshold SNR level below which the ratio between the mean-square error obtained by any estimator of the system's initial state at the output of additive white Gaussian noise (AWGN) channel and the Cramer-Rao bound increases exponentially fast as the number of observations N grows without bound. We explain the connection between the existence of a threshold effect in the estimation of chaotic sequences and the converse to the joint source-channel coding theorem. We derive lower bounds on SNR/sub th/, the value of the threshold SNR, as a function of the system's Lyapunov exponent. Our bounds have two versions, one for a finite number of observations, and one for the asymptotic regime as N/spl rarr//spl infin/. For the asymptotic regime, the bound we develop on the threshold SNR incorporates the key parameters of chaotic systems, the Lyapunov exponent, and the chaotic sequence power spectrum into a simple formula. We demonstrate our results on the chaotic system governed by the r-diadic map.

[1]  Ott,et al.  Observing chaos: Deducing and tracking the state of a chaotic system from limited observation. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  B. Cazelles,et al.  Adaptive control of chaotic systems in a noisy environment , 1995 .

[3]  Alan V. Oppenheim,et al.  Synchronization of Lorenz-based chaotic circuits with applications to communications , 1993 .

[4]  James S. Lehnert,et al.  TCM/SSMA communication systems with cascaded sequences and PAM/QAM signal sets , 1998, IEEE Trans. Commun..

[5]  Abraham Boyarsky,et al.  Matrices and eigenfunctions induced by Markov maps , 1981 .

[6]  J. D. Farmer,et al.  Optimal shadowing and noise reduction , 1991 .

[7]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[8]  Stephen M. Hammel,et al.  A noise reduction method for chaotic systems , 1990 .

[9]  Gregory W. Wornell,et al.  Signal processing in the context of chaotic signals , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Boris Hasselblatt,et al.  Introduction to the Modern Theory of Dynamical Systems: INTRODUCTION: WHAT IS LOW-DIMENSIONAL DYNAMICS? , 1995 .

[11]  Gregory W. Wornell,et al.  Analog error-correcting codes based on chaotic dynamical systems , 1998, IEEE Trans. Commun..

[12]  C. Myers,et al.  Signal separation for nonlinear dynamical systems , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Andrew C. Singer,et al.  Nonlinear Autoregressive Modeling and Estimation in the Presence of Noise , 1994 .

[14]  J. Zukas Introduction to the Modern Theory of Dynamical Systems , 1998 .

[15]  M. Melamed Detection , 2021, SETI: Astronomy as a Contact Sport.

[16]  V. I. Oseledec A multiplicative ergodic theorem: Lyapunov characteristic num-bers for dynamical systems , 1968 .

[17]  Michael C. Mackey,et al.  Chaos, Fractals, and Noise , 1994 .

[18]  Daniel F. Drake Information's role in the estimation of chaotic signals , 1998 .

[19]  Gregory W. Wornell,et al.  Statistical analysis and spectral estimation techniques for one-dimensional chaotic signals , 1997, IEEE Trans. Signal Process..

[20]  Steven Kay,et al.  Asymptotic maximum likelihood estimator performance for chaotic signals in noise , 1995, IEEE Trans. Signal Process..

[21]  Abraham Boyarsky,et al.  On a class of transformations which have unique absolutely continuous invariant measures , 1979 .

[22]  J.H.B. Deane,et al.  Chaotic behaviour in current-mode controlled DC-DC convertor , 1991 .

[23]  L. Risbo On the design of tone-free /spl Sigma//spl Delta/ modulators , 1995 .

[24]  Haralabos C. Papadopoulos,et al.  Maximum-likelihood estimation of a class of chaotic signals , 1995, IEEE Trans. Inf. Theory.

[25]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[26]  L. Risbo On the design of tome-free ΣΔ modulators , 1995 .

[27]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[28]  L. Chua,et al.  Chaos: A tutorial for engineers , 1987, Proceedings of the IEEE.

[29]  Jacob Ziv,et al.  On functionals satisfying a data-processing theorem , 1973, IEEE Trans. Inf. Theory.

[30]  Ott,et al.  Observing chaos: Deducing and tracking the state of a chaotic system from limited observation. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[31]  Carroll,et al.  Synchronization in chaotic systems. , 1990, Physical review letters.

[32]  Venkatesh Nagesha,et al.  Methods for chaotic signal estimation , 1995, IEEE Trans. Signal Process..

[33]  강태원,et al.  [서평]「Chaos and Fractals : New Frontiers of Science」 , 1998 .

[34]  Changbao Wu,et al.  Asymptotic Theory of Nonlinear Least Squares Estimation , 1981 .

[35]  Laurence B. Milstein,et al.  Spread Spectrum Communications , 1983, Encyclopedia of Wireless and Mobile Communications.