Mixed-Effect Time-Varying Network Model and Application in Brain Connectivity Analysis

Abstract Time-varying networks are fast emerging in a wide range of scientific and business applications. Most existing dynamic network models are limited to a single-subject and discrete-time setting. In this article, we propose a mixed-effect network model that characterizes the continuous time-varying behavior of the network at the population level, meanwhile taking into account both the individual subject variability as well as the prior module information. We develop a multistep optimization procedure for a constrained likelihood estimation and derive the associated asymptotic properties. We demonstrate the effectiveness of our method through both simulations and an application to a study of brain development in youth. Supplementary materials for this article are available online.

[1]  Raymond J Carroll,et al.  Generalized Functional Linear Models With Semiparametric Single-Index Interactions , 2010, Journal of the American Statistical Association.

[2]  A. Rinaldo.  Properties and refinements of the fused lasso , 2008, 0805.0234.

[3]  Han Liu,et al.  A depression network of functionally connected regions discovered via multi-attribute canonical correlation graphs , 2016, NeuroImage.

[4]  Suzanne E. Welcome,et al.  Mapping cortical change across the human life span , 2003, Nature Neuroscience.

[5]  Damien A. Fair,et al.  Development of large-scale functional networks from birth to adulthood: A guide to the neuroimaging literature , 2017, NeuroImage.

[6]  Yunpeng Zhao,et al.  A survey on theoretical advances of community detection in networks , 2017, ArXiv.

[7]  Peter J. Bickel,et al.  Inferring gene-gene interactions and functional modules using sparse canonical correlation analysis , 2014, 1401.6504.

[8]  T. Jernigan,et al.  Development of cortical and subcortical brain structures in childhood and adolescence: a structural MRI study , 2002, Developmental medicine and child neurology.

[9]  J. Gilmore,et al.  Structural and Maturational Covariance in Early Childhood Brain Development , 2016, Cerebral cortex.

[10]  H. D. Brunk,et al.  Statistical inference under order restrictions : the theory and application of isotonic regression , 1973 .

[11]  Hua Liang,et al.  Semiparametric GEE analysis in partially linear single-index models for longitudinal data , 2015, 1507.08473.

[12]  Jonathan D. Power,et al.  Functional Brain Networks Develop from a “Local to Distributed” Organization , 2009, PLoS Comput. Biol..

[13]  T. Turner,et al.  Locating a maximum using isotonic regression , 1997 .

[14]  Yikai Wang,et al.  An Efficient and Reliable Statistical Method for Estimating Functional Connectivity in Large Scale Brain Networks Using Partial Correlation , 2016, Front. Neurosci..

[15]  Kaustubh Supekar,et al.  Development of Large-Scale Functional Brain Networks in Children , 2009, NeuroImage.

[16]  Ji Zhu,et al.  Consistency of community detection in networks under degree-corrected stochastic block models , 2011, 1110.3854.

[17]  Han Liu,et al.  Joint estimation of multiple graphical models from high dimensional time series , 2013, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[18]  R. Carroll,et al.  Variance function partially linear single‐index models , 2015 .

[19]  S. Aerts,et al.  Mapping gene regulatory networks from single-cell omics data , 2018, Briefings in functional genomics.

[20]  P. Tseng.  Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[21]  Ulman Lindenberger,et al.  Age differences in brain signal variability are robust to multiple vascular controls , 2017, Scientific Reports.

[22]  Hongzhe Li,et al.  A Markov random field model for network-based analysis of genomic data , 2007, Bioinform..

[23]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[24]  H. White,et al.  Misspecified models with dependent observations , 1982 .

[25]  P. Bickel,et al.  A nonparametric view of network models and Newman–Girvan and other modularities , 2009, Proceedings of the National Academy of Sciences.

[26]  Martin J. Wainwright,et al.  A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers , 2009, NIPS.

[27]  Sara van de Geer,et al.  Statistics for High-Dimensional Data: Methods, Theory and Applications , 2011 .

[28]  Xiao-Tong Yuan,et al.  Truncated power method for sparse eigenvalue problems , 2011, J. Mach. Learn. Res..

[29]  Hyonho Chun,et al.  On an Additive Semigraphoid Model for Statistical Networks With Application to Pathway Analysis , 2014, Journal of the American Statistical Association.

[30]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[31]  Joaquín Goñi,et al.  Changes in structural and functional connectivity among resting-state networks across the human lifespan , 2014, NeuroImage.

[32]  Tengyuan Liang,et al.  On Detection and Structural Reconstruction of Small-World Random Networks , 2016, IEEE Transactions on Network Science and Engineering.

[33]  Franck Picard,et al.  A mixture model for random graphs , 2008, Stat. Comput..

[34]  Lin Li,et al.  Cell-specific network constructed by single-cell RNA sequencing data , 2019, Nucleic acids research.

[35]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[36]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data: Methods and Models , 2009 .

[37]  Stephen M Smith,et al.  Correspondence of the brain's functional architecture during activation and rest , 2009, Proceedings of the National Academy of Sciences.

[38]  H. Zou,et al.  STRONG ORACLE OPTIMALITY OF FOLDED CONCAVE PENALIZED ESTIMATION. , 2012, Annals of statistics.

[39]  Ali Shojaie,et al.  Network Reconstruction From High-Dimensional Ordinary Differential Equations , 2016, Journal of the American Statistical Association.

[40]  Bin Yu,et al.  Spectral clustering and the high-dimensional stochastic blockmodel , 2010, 1007.1684.

[41]  Li Wang,et al.  Estimation and Inference for Generalized Geoadditive Models , 2020, Journal of the American Statistical Association.

[42]  Marianna Pensky,et al.  Dynamic network models and graphon estimation , 2016, The Annals of Statistics.

[43]  Sara van de Geer,et al.  Statistics for High-Dimensional Data , 2011 .

[44]  D. Hu,et al.  Decoding Lifespan Changes of the Human Brain Using Resting-State Functional Connectivity MRI , 2012, PloS one.

[45]  Nancy E. Heckman,et al.  Spline Smoothing in a Partly Linear Model , 1986 .

[46]  Gérard Govaert,et al.  Assessing a Mixture Model for Clustering with the Integrated Completed Likelihood , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  R. Stewart,et al.  Single-cell RNA-seq reveals novel regulators of human embryonic stem cell differentiation to definitive endoderm , 2016, Genome Biology.

[48]  Jiguo Cao,et al.  Finding Common Modules in a Time-Varying Network with Application to the Drosophila Melanogaster Gene Regulation Network , 2017 .

[49]  Gaël Varoquaux,et al.  Learning and comparing functional connectomes across subjects , 2013, NeuroImage.

[50]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[51]  Xiaotong Shen,et al.  Structural Pursuit Over Multiple Undirected Graphs , 2014, Journal of the American Statistical Association.

[52]  Ji Zhu,et al.  Link Prediction for Partially Observed Networks , 2013, ArXiv.

[53]  T. Cai,et al.  A Constrained ℓ1 Minimization Approach to Sparse Precision Matrix Estimation , 2011, 1102.2233.

[54]  Xiangyu Chang,et al.  Asymptotic Normality of Maximum Likelihood and its Variational Approximation for Stochastic Blockmodels , 2012, ArXiv.

[55]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data , 2009 .

[56]  B. Li,et al.  A Nonparametric Graphical Model for Functional Data With Application to Brain Networks Based on fMRI , 2018, Journal of the American Statistical Association.

[57]  Guoqing Wang,et al.  A parsimonious statistical method to detect groupwise differentially expressed functional connectivity networks , 2015, Human brain mapping.

[58]  T. Cai,et al.  Direct estimation of differential networks. , 2014, Biometrika.

[59]  Cun-Hui Zhang.  Risk bounds in isotonic regression , 2002 .

[60]  Alfred O. Hero,et al.  Dynamic Stochastic Blockmodels for Time-Evolving Social Networks , 2014, IEEE Journal of Selected Topics in Signal Processing.

[61]  Xiaotong Shen,et al.  Journal of the American Statistical Association Likelihood-based Selection and Sharp Parameter Estimation Likelihood-based Selection and Sharp Parameter Estimation , 2022 .

[62]  Efstathios D. Gennatas,et al.  Network-level structural covariance in the developing brain , 2010, Proceedings of the National Academy of Sciences.

[63]  Lexin Li,et al.  Hypothesis testing of matrix graph model with application to brain connectivity analysis , 2015, Biometrics.

[64]  L. Uddin,et al.  Moment-to-Moment BOLD Signal Variability Reflects Regional Changes in Neural Flexibility across the Lifespan , 2017, The Journal of Neuroscience.

[65]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[66]  J. Horowitz,et al.  VARIABLE SELECTION IN NONPARAMETRIC ADDITIVE MODELS. , 2010, Annals of statistics.

[67]  J. Lafferty,et al.  Adaptive risk bounds in unimodal regression , 2015, Bernoulli.

[68]  Vincent Miele,et al.  Statistical clustering of temporal networks through a dynamic stochastic block model , 2015, 1506.07464.