Sparse Parametric Models for Robust Nonstationary Signal Analysis: Leveraging the Power of Sparse Regression

Recent research and experimental findings, as well as technological development and commercialization efforts, suggest that even a modest amount of data can deliver superior signal modeling and reconstruction performance if sparsity is present and accounted for. Early sparsity-aware signal processing techniques have mostly targeted stationary signal analysis using offline algorithms for signal and image reconstruction from Fourier samples. On the other hand, sparsity-aware time-frequency tools for nonstationary signal analysis have recently received growing attention. In this context, sparse regression has offered a new paradigm for instantaneous frequency estimation, over classical time-frequency representations. Standard techniques for estimating model parameters from time series yield erroneous fits when, e.g., abrupt changes or outliers cause model mismatches. Accordingly, the need arises for basic research in robust processing of nonstationary parametric models that leverage sparsity to accomplish tasks such as tracking of signal variations, outlier rejection, robust parameter estimation, and change detection. This article aims at delineating the analytical background of sparsity-aware time-series analysis and introducing sparsity-aware robust and nonstationary parametric models to the signal processing readership, through readily appreciated applications in frequency-hopping (FH) communications and speech compression. Preliminary results strongly support the vision of seeking the right form of sparsity for the right application to enable sparsity-cognizant estimation of robust parametric models for nonstationary signal analysis.

[1]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series, with Engineering Applications , 1949 .

[2]  Georgios B. Giannakis,et al.  From Sparse Signals to Sparse Residuals for Robust Sensing , 2011, IEEE Transactions on Signal Processing.

[3]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[4]  Mika P. Tarvainen,et al.  Estimation of nonstationary EEG with Kalman smoother approach: an application to event-related synchronization (ERS) , 2004, IEEE Transactions on Biomedical Engineering.

[5]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[6]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[7]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[8]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[9]  Marc Moonen,et al.  Sparse Linear Prediction and Its Applications to Speech Processing , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[10]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[11]  Georgios B. Giannakis,et al.  Sparsity-Cognizant Total Least-Squares for Perturbed Compressive Sampling , 2010, IEEE Transactions on Signal Processing.

[12]  Marc Lavielle,et al.  Optimal segmentation of random processes , 1998, IEEE Trans. Signal Process..

[13]  Gabriel Rilling,et al.  One or Two Frequencies? The Empirical Mode Decomposition Answers , 2008, IEEE Transactions on Signal Processing.

[14]  Georgios B. Giannakis,et al.  Group lassoing change-points in piecewise-constant AR processes , 2012, EURASIP J. Adv. Signal Process..

[15]  Nikos D. Sidiropoulos,et al.  Estimating Multiple Frequency-Hopping Signal Parameters via Sparse Linear Regression , 2010, IEEE Transactions on Signal Processing.

[16]  Patrick Flandrin,et al.  Time-Frequency Energy Distributions Meet Compressed Sensing , 2010, IEEE Transactions on Signal Processing.

[17]  Georgios B. Giannakis,et al.  Doubly Robust Smoothing of Dynamical Processes via Outlier Sparsity Constraints , 2011, IEEE Transactions on Signal Processing.

[18]  G. Wahba Spline models for observational data , 1990 .

[19]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[20]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[21]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[22]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[23]  Nikos D. Sidiropoulos,et al.  Blind high resolution localization and tracking of multiple frequency hopped signals , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[24]  S. Mitter,et al.  Robust Recursive Estimation in the Presence of Heavy-Tailed Observation Noise , 1994 .

[25]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[26]  Georgios B. Giannakis,et al.  Online Adaptive Estimation of Sparse Signals: Where RLS Meets the $\ell_1$ -Norm , 2010, IEEE Transactions on Signal Processing.

[27]  David L. Donoho,et al.  Application of basis pursuit in spectrum estimation , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[28]  B. Hofmann-Wellenhof,et al.  Introduction to spectral analysis , 1986 .

[29]  Patrick Flandrin,et al.  One or Two frequencies? The Synchrosqueezing Answers , 2011, Adv. Data Sci. Adapt. Anal..

[30]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.