Contextual hidden Markov models for wavelet-domain signal processing

Wavelet-domain hidden Markov models (HMMs) provide a powerful new approach for statistical modeling and processing of wavelet coefficients. In addition to characterizing the statistics of individual wavelet coefficients, HMMs capture some of the key interactions between wavelet coefficients. However, as HMMs model an increasing number of wavelet coefficient interactions, HMM-based signal processing becomes increasingly complicated. In this paper, we propose a new approach to HMMs based on the notion of context. By modeling wavelet coefficient inter-dependencies via contexts, we retain the approximation capabilities of HMMs, yet substantially reduce their complexity. To illustrate the power of this approach, we develop new algorithms for signal estimation and for efficient synthesis of nonGaussian, long-range-dependent network traffic.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  Gregory W. Wornell,et al.  A Karhunen-Loève-like expansion for 1/f processes via wavelets , 1990, IEEE Trans. Inf. Theory.

[3]  Patrick Flandrin,et al.  Wavelet analysis and synthesis of fractional Brownian motion , 1992, IEEE Trans. Inf. Theory.

[4]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[5]  Walter Willinger,et al.  On the Self-Similar Nature of Ethernet Traffic ( extended version ) , 1995 .

[6]  C.-C. Jay Kuo,et al.  Fractal estimation from noisy data via discrete fractional Gaussian noise (DFGN) and the Haar basis , 1993, IEEE Trans. Signal Process..

[7]  Murad S. Taqqu,et al.  On the Self-Similar Nature of Ethernet Traffic , 1993, SIGCOMM.

[8]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[9]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[10]  Helmut Lucke,et al.  Which stochastic models allow Baum-Welch training? , 1996, IEEE Trans. Signal Process..

[11]  Robert D. Nowak,et al.  Signal estimation using wavelet-Markov models , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  H. Chipman,et al.  Adaptive Bayesian Wavelet Shrinkage , 1997 .

[13]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..