SINGLE INDEX LATENT VARIABLE MODELS FOR NETWORK TOPOLOGY INFERENCE

A semi-parametric, non-linear regression model in the presence of latent variables is applied towards learning network graph structure. These latent variables can correspond to un-modeled phenomena or unmeasured agents in a complex system of interacting entities. This formulation jointly estimates non-linearities in the underlying data generation, the direct interactions between measured entities, and the indirect effects of unmeasured processes on the observed data. The learning is posed as regularized empirical risk minimization. Details of the algorithm for learning the model are outlined. Experiments demonstrate the performance of the learned model on real data.

[1]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[2]  José M. F. Moura,et al.  Signal Processing on Graphs: Causal Modeling of Unstructured Data , 2015, IEEE Transactions on Signal Processing.

[3]  Robert D. Nowak,et al.  Learning Single Index Models in High Dimensions , 2015, ArXiv.

[4]  José M. F. Moura,et al.  SILVar: Single Index Latent Variable Models , 2017, IEEE Transactions on Signal Processing.

[5]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[6]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[7]  A. Willsky,et al.  Latent variable graphical model selection via convex optimization , 2010 .

[8]  Robert D. Nowak,et al.  Causal Network Inference Via Group Sparse Regularization , 2011, IEEE Transactions on Signal Processing.

[9]  Ali Jalali,et al.  Learning the Dependence Graph of Time Series with Latent Factors , 2011, ICML.

[10]  Joydeep Ghosh,et al.  Parameter Estimation of Generalized Linear Models without Assuming their Link Function , 2015, AISTATS.

[11]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[12]  H. Ichimura,et al.  SEMIPARAMETRIC LEAST SQUARES (SLS) AND WEIGHTED SLS ESTIMATION OF SINGLE-INDEX MODELS , 1993 .

[13]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[14]  Eric P. Xing,et al.  Fast structure learning in generalized stochastic processes with latent factors , 2013, KDD.

[15]  G. Michailidis,et al.  Regularized estimation in sparse high-dimensional time series models , 2013, 1311.4175.