Nonlinear structural equation models for network topology inference

Linear structural equation models (SEMs) have been widely adopted for inference of causal interactions in complex networks. Recent examples include unveiling topologies of hidden causal networks over which processes such as spreading diseases, or rumors propagation. However, these approaches are limited because they assume linear dependence among observable variables. The present paper advocates a more general nonlinear structural equation model based on polynomial expansions, which compensates for possible nonlinear dependencies between network nodes. To this end, a group-sparsity regularized estimator is put forth to leverage the inherent edge sparsity that is present in most real-world networks. A novel computationally-efficient proximal gradient algorithm is developed to estimate the polynomial SEM coefficients, and hence infer the edge structure. Preliminary tests on simulated data demonstrate the effectiveness of the novel approach.

[1]  Sergios Theodoridis,et al.  Online Sparse System Identification and Signal Reconstruction Using Projections Onto Weighted $\ell_{1}$ Balls , 2010, IEEE Transactions on Signal Processing.

[2]  Brandi A. Weiss,et al.  A comparison of methods for estimating quadratic effects in nonlinear structural equation models. , 2012, Psychological methods.

[3]  Yasuo Amemiya,et al.  Estimation for Polynomial Structural Equation Models , 2000 .

[4]  Gonzalo Mateos,et al.  Proximal-Gradient Algorithms for Tracking Cascades Over Social Networks , 2014, IEEE Journal of Selected Topics in Signal Processing.

[5]  Xin-Yuan Song,et al.  Model comparison of nonlinear structural equation models with fixed covariates , 2003 .

[6]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[7]  Georgios B. Giannakis,et al.  Inference of Gene Regulatory Networks with Sparse Structural Equation Models Exploiting Genetic Perturbations , 2013, PLoS Comput. Biol..

[8]  D. Kaplan Structural Equation Modeling: Foundations and Extensions , 2000 .

[9]  Fan Yang,et al.  Nonlinear structural equation models: The Kenny-Judd model with Interaction effects , 1996 .

[10]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[11]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[12]  A. Goldberger STRUCTURAL EQUATION METHODS IN THE SOCIAL SCIENCES , 1972 .

[13]  Holger Brandt,et al.  A Nonlinear Structural Equation Mixture Modeling Approach for Nonnormally Distributed Latent Predictor Variables , 2014 .

[14]  B. Muthén A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators , 1984 .

[15]  Sik-Yum Lee,et al.  Maximum Likelihood Estimation of Nonlinear Structural Equation Models with Ignorable Missing Data , 2003 .

[16]  Georgios B. Giannakis,et al.  Sparse graphical modeling of piecewise-stationary time series , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Christos Faloutsos,et al.  Kronecker Graphs: An Approach to Modeling Networks , 2008, J. Mach. Learn. Res..

[18]  Sankaran Mahadevan,et al.  Bayesian nonlinear structural equation modeling for hierarchical validation of dynamical systems , 2010 .