Multivariate time-frequency analysis

Recent advances in time-frequency theory have led to the development of high resolution time-frequency algorithms, such as the empirical mode decomposition (EMD) and the synchrosqueezing transform (SST). These algorithms provide enhanced localization in representing time varying oscillatory components over conventional linear and quadratic time-frequency algorithms. However, with the emergence of low cost multichannel sensor technology, multivariate extensions of time-frequency algorithms are needed in order to exploit the inter-channel dependencies that may arise for multivariate data. Applications of this framework range from filtering to the analysis of oscillatory components. To this end, this thesis first seeks to introduce a multivariate extension of the synchrosqueezing transform, so as to identify a set of oscillations common to the multivariate data. Furthermore, a new framework for multivariate time-frequency representations is developed using the proposed multivariate extension of the SST. The performance of the proposed algorithms are demonstrated on a wide variety of both simulated and real world data sets, such as in phase synchrony spectrograms and multivariate signal denoising. Finally, multivariate extensions of the EMD have been developed that capture the inter-channel dependencies in multivariate data. This is achieved by processing such data directly in higher dimensional spaces where they reside, and by accounting for the power imbalance across multivariate data channels that are recorded from real world sensors, thereby preserving the multivariate structure of the data. These optimized performance of such data driven algorithms when processing multivariate data with power imbalances and inter-channel correlations, and is demonstrated on the real world examples of Doppler radar processing.

[1]  Gabriel Rilling,et al.  Empirical mode decomposition as a filter bank , 2004, IEEE Signal Processing Letters.

[2]  Steve McLaughlin,et al.  Development of EMD-Based Denoising Methods Inspired by Wavelet Thresholding , 2009, IEEE Transactions on Signal Processing.

[3]  Dennis Gabor,et al.  Theory of communication , 1946 .

[4]  Danilo P. Mandic,et al.  Multiscale Image Fusion Using Complex Extensions of EMD , 2009, IEEE Transactions on Signal Processing.

[5]  Muhammad Altaf,et al.  Rotation Invariant Complex Empirical Mode Decomposition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[6]  Danilo P. Mandic,et al.  Bivariate EMD analysis for aircraft component inspection , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[7]  Quan Pan,et al.  Two denoising methods by wavelet transform , 1999, IEEE Trans. Signal Process..

[8]  Danilo P. Mandic,et al.  Dynamically-Sampled Bivariate Empirical Mode Decomposition , 2014, IEEE Signal Processing Letters.

[9]  Boualem Boashash,et al.  Estimating and interpreting the instantaneous frequency of a signal. I. Fundamentals , 1992, Proc. IEEE.

[10]  K. Kodera,et al.  Analysis of time-varying signals with small BT values , 1978 .

[11]  Sofia C. Olhede,et al.  Bivariate Instantaneous Frequency and Bandwidth , 2009, IEEE Transactions on Signal Processing.

[12]  Danilo P. Mandic,et al.  Empirical Mode Decomposition for Trivariate Signals , 2010, IEEE Transactions on Signal Processing.

[13]  Pak-Chung Ching,et al.  On wavelet denoising and its applications to time delay estimation , 1999, IEEE Trans. Signal Process..

[14]  Jean-Christophe Cexus,et al.  Denoising via empirical mode decomposition , 2006 .

[15]  Sylvain Meignen,et al.  A New Algorithm for Multicomponent Signals Analysis Based on SynchroSqueezing: With an Application to Signal Sampling and Denoising , 2012, IEEE Transactions on Signal Processing.

[16]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[17]  Bernard C. Picinbono,et al.  On circularity , 1994, IEEE Trans. Signal Process..

[18]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[19]  Danilo P. Mandic,et al.  Bivariate Empirical Mode Decomposition for Unbalanced Real-World Signals , 2013, IEEE Signal Processing Letters.

[20]  LJubisa Stankovic,et al.  Time-frequency representation based on the reassigned S-method , 1999, Signal Process..

[21]  Norden E. Huang,et al.  On Instantaneous Frequency , 2009, Adv. Data Sci. Adapt. Anal..

[22]  Harald Niederreiter,et al.  Random number generation and Quasi-Monte Carlo methods , 1992, CBMS-NSF regional conference series in applied mathematics.

[23]  Wei Hu,et al.  Soil water prediction based on its scale-specific control using multivariate empirical mode decomposition , 2013 .

[24]  Jürgen Kurths,et al.  Detection of n:m Phase Locking from Noisy Data: Application to Magnetoencephalography , 1998 .

[25]  Sofia C. Olhede,et al.  Wavelet ridge estimation of jointly modulated multivariate oscillations , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[26]  L. Mandel Interpretation of Instantaneous Frequencies , 1974 .

[27]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[28]  Chris Brooks,et al.  A trading strategy based on the lead–lag relationship between the spot index and futures contract for the FTSE 100 , 2001 .

[29]  Steven D. Glaser,et al.  Wavelet denoising techniques with applications to experimental geophysical data , 2009, Signal Process..

[30]  Slawomir J. Nasuto,et al.  A novel approach to the detection of synchronisation in EEG based on empirical mode decomposition , 2007, Journal of Computational Neuroscience.

[31]  D. Looney,et al.  Time-Frequency Analysis of EEG Asymmetry Using Bivariate Empirical Mode Decomposition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  T. Bartosch,et al.  Spectrogram analysis of selected tremor signals using short-time Fourier transform and continuous wavelet transform , 1999 .

[33]  Edward Bedrosian,et al.  The Analytic Signal Representation of Modulated Waveforms , 1962, Proceedings of the IRE.

[34]  Bernard C. Picinbono,et al.  On instantaneous amplitude and phase of signals , 1997, IEEE Trans. Signal Process..

[35]  Yan Li,et al.  Wind Turbine Gearbox Fault Diagnosis Using Adaptive Morlet Wavelet Spectrum , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[36]  Danilo P. Mandic,et al.  Noise assisted multivariate empirical mode decomposition applied to Doppler radar data , 2012 .

[37]  Ljubisa Stankovic,et al.  Time-Frequency Signal Analysis With Applications , 2013 .

[38]  T. Claasen,et al.  THE WIGNER DISTRIBUTION - A TOOL FOR TIME-FREQUENCY SIGNAL ANALYSIS , 1980 .

[39]  Visa Koivunen,et al.  Complex Elliptically Symmetric Random Variables—Generation, Characterization, and Circularity Tests , 2011, IEEE Transactions on Signal Processing.

[40]  Sofia C. Olhede,et al.  Analysis of Modulated Multivariate Oscillations , 2011, IEEE Transactions on Signal Processing.

[41]  Mirko van der Baan,et al.  Empirical mode decomposition for seismic time-frequency analysis , 2013 .

[42]  Sylvain Meignen,et al.  The fourier-based synchrosqueezing transform , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[43]  J. Oswald The Theory of Analytic Band-Limited Signals Applied to Carrier Systems , 1956 .

[44]  J. Hull Options, Futures, and Other Derivatives , 1989 .

[45]  P. Loughlin,et al.  Comments on the interpretation of instantaneous frequency , 1997, IEEE Signal Processing Letters.

[46]  D. P. Mandic,et al.  Measuring phase synchrony using complex extensions of EMD , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[47]  Jacob Benesty,et al.  Audio Signal Processing for Next-Generation Multimedia Communication Systems , 2004 .

[48]  Danilo P. Mandic,et al.  Estimation of phase synchrony using the synchrosqueezing transform , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[49]  Toshihisa Tanaka,et al.  Complex Empirical Mode Decomposition , 2007, IEEE Signal Processing Letters.

[50]  Patrick J. Loughlin,et al.  Modified Cohen-Lee time-frequency distributions and instantaneous bandwidth of multicomponent signals , 2001, IEEE Trans. Signal Process..

[51]  Ljubisa Stankovic,et al.  Synchrosqueezing-based time-frequency analysis of multivariate data , 2015, Signal Process..

[52]  Danilo P. Mandic,et al.  Algorithmic Trading Using Phase Synchronization , 2012, IEEE Journal of Selected Topics in Signal Processing.

[53]  William J. Williams,et al.  Improved time-frequency representation of multicomponent signals using exponential kernels , 1989, IEEE Trans. Acoust. Speech Signal Process..

[54]  Toshihisa Tanaka,et al.  Multivariate EMD based approach to EOG artifacts separation from EEG , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[55]  Ali Yener Mutlu,et al.  A Time-Frequency-Based Approach to Phase and Phase Synchrony Estimation , 2011, IEEE Transactions on Signal Processing.

[56]  D. P. Mandic,et al.  Multivariate empirical mode decomposition , 2010, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[57]  Joel W. Burdick,et al.  Spike detection using the continuous wavelet transform , 2005, IEEE Transactions on Biomedical Engineering.

[58]  Boualem Boashash,et al.  Time-Frequency Signal Analysis and Processing: A Comprehensive Reference , 2015 .

[59]  Richard Stutely,et al.  Numbers Guide: The Essentials of Business Numeracy , 2003 .

[60]  Chung Yim Edward Yiu,et al.  Lead-Lag Relationship between the Real Estate Spot and Forward Contracts Markets , 2005 .

[61]  Vince D. Calhoun,et al.  The Fourth Annual 2008 MLSP competition , 2008 .

[62]  Andrzej Cichocki,et al.  Emd Approach to Multichannel EEG Data - the amplitude and Phase Components Clustering Analysis , 2010, J. Circuits Syst. Comput..

[63]  Gabriel Rilling,et al.  Bivariate Empirical Mode Decomposition , 2007, IEEE Signal Processing Letters.

[64]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[65]  A. Nuttall,et al.  On the quadrature approximation to the Hilbert transform of modulated signals , 1966 .

[66]  Michael A. H. Dempster,et al.  Computational learning techniques for intraday FX trading using popular technical indicators , 2001, IEEE Trans. Neural Networks.

[67]  Patrick Flandrin,et al.  Improving the readability of time-frequency and time-scale representations by the reassignment method , 1995, IEEE Trans. Signal Process..

[68]  Jean-Michel Poggi,et al.  Multivariate denoising using wavelets and principal component analysis , 2006, Comput. Stat. Data Anal..

[69]  E. Wigner On the quantum correction for thermodynamic equilibrium , 1932 .

[70]  Jean Claude Nunes,et al.  Image analysis by bidimensional empirical mode decomposition , 2003, Image Vis. Comput..

[71]  Cheolsoo Park,et al.  Classification of Motor Imagery BCI Using Multivariate Empirical Mode Decomposition , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[72]  Ram Bilas Pachori,et al.  Classification of Seizure and Nonseizure EEG Signals Using Empirical Mode Decomposition , 2012, IEEE Transactions on Information Technology in Biomedicine.

[73]  Gabriel Rilling,et al.  On empirical mode decomposition and its algorithms , 2003 .

[74]  I. Daubechies,et al.  Synchrosqueezed wavelet transforms: An empirical mode decomposition-like tool , 2011 .

[75]  Danilo P. Mandic,et al.  Empirical Mode Decomposition-Based Time-Frequency Analysis of Multivariate Signals: The Power of Adaptive Data Analysis , 2013, IEEE Signal Processing Magazine.

[76]  Gabriel Rilling,et al.  One or Two Frequencies? The Empirical Mode Decomposition Answers , 2008, IEEE Transactions on Signal Processing.

[77]  Patrizia Vergallo,et al.  Empirical Mode Decomposition vs. Wavelet Decomposition for the Extraction of Respiratory Signal From Single-Channel ECG: A Comparison , 2013, IEEE Sensors Journal.

[78]  Danilo P. Mandic,et al.  Application of multivariate empirical mode decomposition for seizure detection in EEG signals , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[79]  Jonathan M. Lilly Modulated Oscillations in Three Dimensions , 2011, IEEE Transactions on Signal Processing.

[80]  Toshihisa Tanaka,et al.  Detection of phase synchronization in EEG with Bivariate Empirical Mode Decomposition , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[81]  Sylvain Meignen,et al.  Time-Frequency Reassignment and Synchrosqueezing: An Overview , 2013, IEEE Signal Processing Magazine.

[82]  Danilo P. Mandic,et al.  A Class of Multivariate Denoising Algorithms Based on Synchrosqueezing , 2015, IEEE Transactions on Signal Processing.

[83]  L. Cohen,et al.  Time-frequency distributions-a review , 1989, Proc. IEEE.

[84]  D. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models , 2009 .

[85]  A. Walden,et al.  The Hilbert spectrum via wavelet projections , 2004, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[86]  Danilo P. Mandic,et al.  Filter Bank Property of Multivariate Empirical Mode Decomposition , 2011, IEEE Transactions on Signal Processing.

[87]  Ljubisa Stankovic,et al.  Performance of quadratic time-frequency distributions as instantaneous frequency estimators , 2003, IEEE Trans. Signal Process..

[88]  E. Bedrosian A Product Theorem for Hilbert Transforms , 1963 .

[89]  M. Teplan FUNDAMENTALS OF EEG MEASUREMENT , 2002 .

[90]  R Quian Quiroga,et al.  Performance of different synchronization measures in real data: a case study on electroencephalographic signals. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[91]  Hau-Tieng Wu,et al.  The Synchrosqueezing algorithm for time-varying spectral analysis: Robustness properties and new paleoclimate applications , 2011, Signal Process..

[92]  Esa Ollila,et al.  On the Circularity of a Complex Random Variable , 2008, IEEE Signal Processing Letters.

[93]  Jeffrey S. Racine,et al.  Statistical inference, the bootstrap, and neural-network modeling with application to foreign exchange rates , 2001, IEEE Trans. Neural Networks.

[94]  A. Grossmann,et al.  Cycle-octave and related transforms in seismic signal analysis , 1984 .