Modelling of complex signals using gaussian processes

In complex-valued signal processing, estimation algorithms require complete knowledge (or accurate estimation) of the second order statistics, this makes Gaussian processes (GP) well suited for modelling complex signals, as they are designed in terms of covariance functions. Dealing with bivariate signals using GPs require four covariance matrices, or equivalently, two complex matrices. We propose a GP-based approach for modelling complex signals, whereby the second-order statistics are learnt through maximum likelihood; in particular, the complex GP approach allows for circularity coefficient estimation in a robust manner when the observed signal is corrupted by (circular) white noise. The proposed model is validated using climate signals, for both circular and noncircular cases. The results obtained open new possibilities for collaboration between the complex signal processing and Gaussian processes communities towards an appealing representation and statistical description of bivariate signals.

[1]  N. R. Goodman.  Statistical analysis based on a certain multivariate complex Gaussian distribution , 1963 .

[2]  Pascal Chevalier,et al.  Widely linear estimation with complex data , 1995, IEEE Trans. Signal Process..

[3]  Iain Murray.  Introduction To Gaussian Processes , 2008 .

[4]  Edwin V. Bonilla,et al.  Multi-task Gaussian Process Prediction , 2007, NIPS.

[5]  Marc Peter Deisenroth,et al.  Analytic Long-Term Forecasting with Periodic Gaussian Processes , 2014, AISTATS.

[6]  Esa Ollila,et al.  On the Circularity of a Complex Random Variable , 2008, IEEE Signal Processing Letters.

[7]  Danilo P. Mandic,et al.  A novel augmented complex valued kernel LMS , 2012, 2012 IEEE 7th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[8]  D. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models , 2009 .

[9]  Danilo P. Mandic,et al.  THE AUGMENTED COMPLEX LEAST MEAN SQUARE ALGORITHM WITH APPLICATION TO ADAPTIVE PREDICTION PROBLEMS 1 , 2008 .

[10]  Tülay Adali,et al.  Complex-Valued Signal Processing: The Proper Way to Deal With Impropriety , 2011, IEEE Transactions on Signal Processing.

[11]  Juan José Murillo-Fuentes,et al.  Gaussian processes regressors for complex proper signals in digital communications , 2014, 2014 IEEE 8th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[12]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[13]  Felipe Tobar.  KERNEL-BASED ADAPTIVE ESTIMATION: MULTIDIMENSIONAL AND STATE-SPACE APPROACHES , 2014 .

[14]  Danilo P. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters , 2009 .

[15]  Igor N. Aizenberg,et al.  Complex-Valued Neural Networks with Multi-Valued Neurons , 2011, Studies in Computational Intelligence.

[16]  Neil D. Lawrence,et al.  Sparse Convolved Gaussian Processes for Multi-output Regression , 2008, NIPS.

[17]  Bernard C. Picinbono,et al.  On circularity , 1994, IEEE Trans. Signal Process..

[18]  K. S. Miller,et al.  Complex Gaussian Processes , 1969 .

[19]  Sergios Theodoridis,et al.  The Augmented Complex Kernel LMS , 2011, IEEE Transactions on Signal Processing.