Compressive sensing meets time-frequency: An overview of recent advances in time-frequency processing of sparse signals

Compressive sensing is a framework for acquiring sparse signals at sub-Nyquist rates. Once compressively acquired, many signals need to be processed using advanced techniques such as time-frequency representations. Hence, we overview recent advances dealing with time-frequency processing of sparse signals acquired using compressive sensing approaches. The paper is geared towards signal processing practitioners and we emphasize practical aspects of these algorithms. First, we briefly review the idea of compressive sensing. Second, we review two major approaches for compressive sensing in the time-frequency domain. Thirdly, compressive sensing based time-frequency representations are reviewed followed by descriptions of compressive sensing approaches based on the polynomial Fourier transform and the short-time Fourier transform. Lastly, we provide brief conclusions along with several future directions for this field.

[1]  Irena Orović,et al.  A software companion for compressively sensed time-frequency processing of sparse nonstationary signals , 2018, SoftwareX.

[2]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[3]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[4]  Branka Jokanovic,et al.  A sparsity-perspective to quadratic time-frequency distributions , 2015, Digit. Signal Process..

[5]  Srdjan Stankovic,et al.  Local polynomial Fourier transform: A review on recent developments and applications , 2011, Signal Process..

[6]  Tom Chau,et al.  Compressive sampling of swallowing accelerometry signals using time-frequency dictionaries based on modulated discrete prolate spheroidal sequences , 2012, EURASIP J. Adv. Signal Process..

[7]  Keith Worden,et al.  TIME–FREQUENCY ANALYSIS IN GEARBOX FAULT DETECTION USING THE WIGNER–VILLE DISTRIBUTION AND PATTERN RECOGNITION , 1997 .

[8]  Cornel Ioana,et al.  Compressive Sensing in Signal Processing: Algorithms and Transform Domain Formulations , 2016 .

[9]  A. Robert Calderbank,et al.  Sensitivity to Basis Mismatch in Compressed Sensing , 2011, IEEE Trans. Signal Process..

[10]  Jean-Luc Starck,et al.  Compressed Sensing in Astronomy , 2008, IEEE Journal of Selected Topics in Signal Processing.

[11]  Irena Orovic,et al.  L-statistics based modification of reconstruction algorithms for compressive sensing in the presence of impulse noise , 2013, Signal Process..

[12]  Irena Orovic,et al.  A Class of Highly Concentrated Time-Frequency Distributions Based on the Ambiguity Domain Representation and Complex-Lag Moment , 2009, EURASIP J. Adv. Signal Process..

[13]  Qiang Fu,et al.  Compressed Sensing of Complex Sinusoids: An Approach Based on Dictionary Refinement , 2012, IEEE Transactions on Signal Processing.

[14]  Bahram Javidi,et al.  Overview of compressive sensing techniques applied in holography [Invited]. , 2013, Applied optics.

[15]  Boualem Boashash,et al.  A unified approach to the STFT, TFDs, and instantaneous frequency , 1992, IEEE Trans. Signal Process..

[16]  Nikos D. Sidiropoulos,et al.  Sparse Parametric Models for Robust Nonstationary Signal Analysis: Leveraging the Power of Sparse Regression , 2013, IEEE Signal Processing Magazine.

[17]  A. Medl,et al.  Time Frequency and Wavelets in Biomedical Signal Processing , 1998, IEEE Engineering in Medicine and Biology Magazine.

[18]  Bin Dong,et al.  ℓ0 Minimization for wavelet frame based image restoration , 2011, Math. Comput..

[19]  Branka Jokanovic,et al.  Reduced Interference Sparse Time-Frequency Distributions for Compressed Observations , 2015, IEEE Transactions on Signal Processing.

[20]  Jin Jiang,et al.  Time-frequency feature representation using energy concentration: An overview of recent advances , 2009, Digit. Signal Process..

[21]  Yimin D. Zhang,et al.  High resolution time-frequency distributions for maneuvering target detection in over-the-horizon radars , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[22]  Luis F. Chaparro,et al.  Time-frequency representations based on compressive samples , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[23]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[24]  Marie-Françoise Lucas,et al.  Compression of Biomedical Signals With Mother Wavelet Optimization and Best-Basis Wavelet Packet Selection , 2007, IEEE Transactions on Biomedical Engineering.

[25]  Seda Senay,et al.  Signal Reconstruction from Nonuniformly Spaced Samples Using Evolutionary Slepian Transform-Based POCS , 2010, EURASIP J. Adv. Signal Process..

[26]  Holger Rauhut,et al.  Sparsity in Time-Frequency Representations , 2007, ArXiv.

[27]  Irena Orovic,et al.  Polynomial Fourier domain as a domain of signal sparsity , 2014, Signal Process..

[28]  George Tzanetakis,et al.  Musical genre classification of audio signals , 2002, IEEE Trans. Speech Audio Process..

[29]  F. Hlawatsch,et al.  Linear and quadratic time-frequency signal representations , 1992, IEEE Signal Processing Magazine.

[30]  Thomas Strohmer,et al.  Measure What Should be Measured: Progress and Challenges in Compressive Sensing , 2012, ArXiv.

[31]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[32]  M. Vetterli,et al.  Sparse Sampling of Signal Innovations , 2008, IEEE Signal Processing Magazine.

[33]  Victor Sucic,et al.  Nonlinear IF Estimation Based on the Pseudo WVD Adapted Using the Improved Sliding Pairwise ICI Rule , 2009, IEEE Signal Processing Letters.

[34]  E. Sejdic,et al.  Recovering heart sounds from sparse samples , 2012, 2012 38th Annual Northeast Bioengineering Conference (NEBEC).

[35]  I. Djurovic,et al.  Realization of robust filters in the frequency domain , 2002, IEEE Signal Processing Letters.

[36]  T. Thayaparan,et al.  Signal Decomposition by Using the S-Method With Application to the Analysis of HF Radar Signals in Sea-Clutter , 2006, IEEE Transactions on Signal Processing.

[37]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[38]  Boualem Boashash,et al.  Estimating and interpreting the instantaneous frequency of a signal. II. A/lgorithms and applications , 1992, Proc. IEEE.

[39]  Luca De Marchi,et al.  Best basis compressive sensing of guided waves in structural health monitoring , 2015, Digit. Signal Process..

[40]  R. Kitney,et al.  Biomedical signal processing (in four parts) , 1991, Medical and Biological Engineering and Computing.

[41]  Irena Orovic,et al.  Time-frequency-based instantaneous frequency estimation of sparse signals from incomplete set of samples , 2014, IET Signal Process..

[42]  Kareem E. Baddour,et al.  Channel estimation using DPSS based frames , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[43]  P. Vandergheynst,et al.  Compressed sensing imaging techniques for radio interferometry , 2008, 0812.4933.

[44]  Boualem Boashash,et al.  Time-Frequency Signal Analysis and Processing: A Comprehensive Reference , 2015 .

[45]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[46]  Patrick Flandrin,et al.  Time-Frequency Energy Distributions Meet Compressed Sensing , 2010, IEEE Transactions on Signal Processing.

[47]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[48]  Shuilong He,et al.  Compressed sparse time–frequency feature representation via compressive sensing and its applications in fault diagnosis , 2015 .

[49]  Ramesh Raskar,et al.  Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Irena Orovic,et al.  A Virtual Instrument for Time-Frequency Analysis of Signals With Highly Nonstationary Instantaneous Frequency , 2011, IEEE Transactions on Instrumentation and Measurement.

[51]  Karlheinz Gröchenig,et al.  Foundations of Time-Frequency Analysis , 2000, Applied and numerical harmonic analysis.

[52]  Irena Orovic,et al.  An automated signal reconstruction method based on analysis of compressive sensed signals in noisy environment , 2014, Signal Process..

[53]  Irena Orovic,et al.  Video Frames Reconstruction Based on Time-Frequency Analysis and Hermite Projection Method , 2010, EURASIP J. Adv. Signal Process..

[54]  Irena Orovic,et al.  Time-frequency rate distributions with complex-lag argument , 2010 .

[55]  Ben Adcock,et al.  BREAKING THE COHERENCE BARRIER: A NEW THEORY FOR COMPRESSED SENSING , 2013, Forum of Mathematics, Sigma.

[56]  Irena Orovic,et al.  Multimedia Signals and Systems: Basic and Advanced Algorithms for Signal Processing , 2015 .

[57]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[58]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[59]  Liam Kilmartin,et al.  Compressed Sensing for Bioelectric Signals: A Review , 2015, IEEE Journal of Biomedical and Health Informatics.

[60]  Srdjan Stankovic,et al.  Introducing time-frequency distribution with a 'complex-time' argument , 1996 .

[61]  Thomas Y. Hou,et al.  Adaptive Data Analysis via Sparse Time-Frequency Representation , 2011, Adv. Data Sci. Adapt. Anal..

[62]  C. Li,et al.  Detection of ECG characteristic points using wavelet transforms. , 1995, IEEE transactions on bio-medical engineering.

[63]  Irena Orovic,et al.  Compressive Sensing Based Separation of Nonstationary and Stationary Signals Overlapping in Time-Frequency , 2013, IEEE Transactions on Signal Processing.

[64]  Leif Sörnmo,et al.  Sequential characterization of atrial tachyarrhythmias based on ECG time-frequency analysis , 2004, IEEE Transactions on Biomedical Engineering.

[65]  Ralph Etienne-Cummings,et al.  Real Time Compressive Sensing Video Reconstruction in Hardware , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[66]  Kok-Kiong Poh,et al.  Compressive Sampling of EEG Signals with Finite Rate of Innovation , 2010, EURASIP J. Adv. Signal Process..

[67]  Boualem Boashash,et al.  A methodology for detection and classification of some underwater acoustic signals using time-frequency analysis techniques , 1990, IEEE Trans. Acoust. Speech Signal Process..

[68]  Parikshit Shah,et al.  Compressed Sensing Off the Grid , 2012, IEEE Transactions on Information Theory.

[69]  Blanco,et al.  Time-frequency analysis of electroencephalogram series. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[70]  D. Slepian Prolate spheroidal wave functions, fourier analysis, and uncertainty — V: the discrete case , 1978, The Bell System Technical Journal.

[71]  Yijun Sun,et al.  Time-frequency analysis for plastic landmine detection via forward-looking ground penetrating radar , 2003 .

[72]  Sungyoung Lee,et al.  Compressive sensing: From theory to applications, a survey , 2013, Journal of Communications and Networks.

[73]  Karthikeyan Umapathy,et al.  Multigroup classification of audio signals using time-frequency parameters , 2005, IEEE Transactions on Multimedia.

[74]  Yonina C. Eldar,et al.  Compressed Sensing with Coherent and Redundant Dictionaries , 2010, ArXiv.

[75]  Volkan Cevher,et al.  Bearing Estimation via Spatial Sparsity using Compressive Sensing , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[76]  Jing Lin,et al.  Feature Extraction Based on Morlet Wavelet and its Application for Mechanical Fault Diagnosis , 2000 .

[77]  Pierre Vandergheynst,et al.  Compressed Sensing and Redundant Dictionaries , 2007, IEEE Transactions on Information Theory.

[78]  Shengli Zhou,et al.  Sparse channel estimation for multicarrier underwater acoustic communication: From subspace methods to compressed sensing , 2009, OCEANS 2009-EUROPE.

[79]  Esther Rodríguez-Villegas,et al.  Compressive sensing scalp EEG signals: implementations and practical performance , 2011, Medical & Biological Engineering & Computing.

[80]  A. Cohen,et al.  Wavelets: the mathematical background , 1996, Proc. IEEE.

[81]  Irena Orovic,et al.  Separation and reconstruction of the rigid body and micro-Doppler signal in ISAR part II – statistical analysis , 2015 .

[82]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[83]  Srdjan Stankovic,et al.  Missing samples analysis in signals for applications to L-estimation and compressive sensing , 2014, Signal Process..

[84]  David Brie,et al.  A METHOD FOR ANALYSING GEARBOX FAULTS USING TIME–FREQUENCY REPRESENTATIONS , 1997 .

[85]  John M. O'Toole,et al.  Time-Frequency Processing of Nonstationary Signals: Advanced TFD Design to Aid Diagnosis with Highlights from Medical Applications , 2013, IEEE Signal Processing Magazine.

[86]  R. Haddad,et al.  Multiresolution Signal Decomposition: Transforms, Subbands, and Wavelets , 1992 .

[87]  H. Sompolinsky,et al.  Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis. , 2012, Annual review of neuroscience.

[88]  Joachim H. G. Ender,et al.  On compressive sensing applied to radar , 2010, Signal Process..

[89]  Irena Orovic,et al.  Sparse Time-Frequency Representation for Signals with Fast Varying Instantaneous Frequency , 2015, ArXiv.

[90]  Rowan Leary,et al.  Compressed sensing electron tomography. , 2013, Ultramicroscopy.

[91]  Irena Orovic,et al.  Time-Frequency Analysis and Hermite Projection Method Applied to Swallowing Accelerometry Signals , 2010, EURASIP J. Adv. Signal Process..

[92]  Emre Ertin,et al.  Sparsity and Compressed Sensing in Radar Imaging , 2010, Proceedings of the IEEE.

[93]  T. Zemen,et al.  Time-variant channel estimation using discrete prolate spheroidal sequences , 2005, IEEE Transactions on Signal Processing.

[94]  SenaySeda,et al.  Reconstruction of nonuniformly sampled time-limited signals using prolate spheroidal wave functions , 2009 .

[95]  M. Martorella,et al.  Novel approach for ISAR image cross-range scaling , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[96]  Héloïse Bleton,et al.  Cognitive tasks and cerebral blood flow through anterior cerebral arteries: a study via functional transcranial Doppler ultrasound recordings , 2016, BMC Medical Imaging.

[97]  Ali Cafer Gürbüz,et al.  A robust compressive sensing based technique for reconstruction of sparse radar scenes , 2014, Digit. Signal Process..

[98]  J.T.E. McDonnell,et al.  Time-frequency and time-scale techniques for the classification of native and bioprosthetic heart valve sounds , 1998, IEEE Transactions on Biomedical Engineering.

[99]  Luis F. Chaparro,et al.  Reconstruction of nonuniformly sampled time-limited signals using prolate spheroidal wave functions , 2009, Signal Process..

[100]  Irena Orovic,et al.  Averaged multiple L-spectrogram for analysis of noisy nonstationary signals , 2012, Signal Process..

[101]  Blanco,et al.  Time-frequency analysis of electroencephalogram series. II. Gabor and wavelet transforms. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[102]  Irena Orovic,et al.  Improved higher order robust distributions based on compressive sensing reconstruction , 2014, IET Signal Process..

[103]  M. Redfern,et al.  A Comprehensive Assessment of Gait Accelerometry Signals in Time, Frequency and Time-Frequency Domains , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[104]  Irena Orovic,et al.  Separation and reconstruction of the rigid body and micro-Doppler signal in ISAR part I – theory , 2015 .

[105]  T. Hou,et al.  Data-driven time-frequency analysis , 2012, 1202.5621.

[106]  Vladimir Katkovnik A new form of the Fourier transform for time-varying frequency estimation , 1995, Signal Process..

[107]  Robert D. Nowak,et al.  Compressed Channel Sensing: A New Approach to Estimating Sparse Multipath Channels , 2010, Proceedings of the IEEE.

[108]  T. Claasen,et al.  THE WIGNER DISTRIBUTION - A TOOL FOR TIME-FREQUENCY SIGNAL ANALYSIS , 1980 .

[109]  Paolo Rocca,et al.  Compressive Sensing in Electromagnetics - A Review , 2015, IEEE Antennas and Propagation Magazine.

[110]  Jin Jiang,et al.  Fault diagnosis in machine tools using selective regional correlation , 2006 .

[111]  R I Kitney,et al.  Biomedical signal processing (in four parts) , 1990, Medical and Biological Engineering and Computing.

[112]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[113]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[114]  Holger Rauhut,et al.  Compressive Estimation of Doubly Selective Channels in Multicarrier Systems: Leakage Effects and Sparsity-Enhancing Processing , 2009, IEEE Journal of Selected Topics in Signal Processing.

[115]  Feng Wu,et al.  Image representation by compressive sensing for visual sensor networks , 2010, J. Vis. Commun. Image Represent..

[116]  Boualem Boashash,et al.  Estimating and interpreting the instantaneous frequency of a signal. I. Fundamentals , 1992, Proc. IEEE.