Sparse plus low-rank graphical models of time series for functional connectivity in MEG

Inferring graphical models from high dimensional observations has become an important problem in machine learning and statistics because of its importance in a variety of application domains. One such application is inferring functional connectivity between brain regions from neuroimaging data such as magnetoencephalograpy (MEG) recordings that produce signals with good temporal and spatial resolution. Unfortunately, existing techniques to learn graphical models that have been applied to neuroimaging data have assumed the data to be i.i.d. over time, ignoring key temporal dynamics. Additionally, the signals that arise from neuroimaging data do not exist in isolation as the brain is performing many tasks simultaneously so that most existing methods can introduce spurious connections. We address these issues by introducing a method to learn Gaussian graphical models between multiple time series with latent processes. In addition, we allow for heterogeneity between different groups of MEG recordings by using a hierarchical penalty. The proposed methods are formulated as convex optimization problems that we efficiently solve by developing an alternating directions method of multipliers algorithm. We evaluate the proposed model on synthetic data as well as on global stock index returns and a real MEG data set.

[1]  Michael I. Jordan,et al.  Learning graphical models for stationary time series , 2004, IEEE Transactions on Signal Processing.

[2]  Kim-Chuan Toh,et al.  Solving Log-Determinant Optimization Problems by a Newton-CG Primal Proximal Point Algorithm , 2010, SIAM J. Optim..

[3]  Jean-Baptiste Poline,et al.  Brain covariance selection: better individual functional connectivity models using population prior , 2010, NIPS.

[4]  Bamdev Mishra,et al.  Sparse plus low-rank autoregressive identification in neuroimaging time series , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[5]  Lieven Vandenberghe,et al.  Topology Selection in Graphical Models of Autoregressive Processes , 2010, J. Mach. Learn. Res..

[6]  Ali Jalali,et al.  Learning the Dependence Graph of Time Series with Latent Factors , 2011, ICML.

[7]  A. T. Walden,et al.  Graphical modelling for brain connectivity via partial coherence , 2009, Journal of Neuroscience Methods.

[8]  E. Bullmore,et al.  Undirected graphs of frequency-dependent functional connectivity in whole brain networks , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[9]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[10]  Shiqian Ma,et al.  Alternating Direction Methods for Latent Variable Gaussian Graphical Model Selection , 2012, Neural Computation.

[11]  D. Bessler,et al.  The Structure of Interdependence in International Stock Markets , 2003 .

[12]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[13]  R. Dahlhaus Graphical interaction models for multivariate time series1 , 2000 .

[14]  Moritz Grosse-Wentrup,et al.  Machine Learning and Interpretation in Neuroimaging: International Workshop, MLINI 2011, Held at NIPS 2011, Sierra Nevada, Spain, December 16-17 , 2012 .

[15]  A. Willsky,et al.  Latent variable graphical model selection via convex optimization , 2010 .

[16]  Julien Mairal,et al.  Proximal Methods for Hierarchical Sparse Coding , 2010, J. Mach. Learn. Res..

[17]  Alexander Jung,et al.  Graphical LASSO based Model Selection for Time Series , 2014, IEEE Signal Processing Letters.

[18]  Emily B. Fox,et al.  Bayesian Structure Learning for Stationary Time Series , 2015, UAI.

[19]  B. E. Eckbo,et al.  Appendix , 1826, Epilepsy Research.

[20]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.