Covariate Assisted Principal Regression for Covariance Matrix Outcomes

Modeling variances in data has been an important topic in many fields, including in financial and neuroimaging analysis. We consider the problem of regressing covariance matrices on a vector covariates, collected from each observational unit. The main aim is to uncover the variation in the covariance matrices across units that are explained by the covariates. This paper introduces Covariate Assisted Principal (CAP) regression, an optimization-based method for identifying the components predicted by (generalized) linear models of the covariates. We develop computationally efficient algorithms to jointly search the projection directions and regression coefficients, and we establish the asymptotic properties. Using extensive simulation studies, our method shows higher accuracy and robustness in coefficient estimation than competing methods. Applied to a resting-state functional magnetic resonance imaging study, our approach identifies the human brain network changes associated with age and sex.

[1]  Calyampudi R. Rao.  The use and interpretation of principal component analysis in applied research , 1964 .

[2]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[3]  T. W. Anderson.  Asymptotically Efficient Estimation of Covariance Matrices with Linear Structure , 1973 .

[4]  A. Harvey.  Estimating Regression Models with Multiplicative Heteroscedasticity , 1976 .

[5]  W. Krzanowski.  Between-Groups Comparison of Principal Components , 1979 .

[6]  B. Flury.  Common Principal Components in k Groups , 1984 .

[7]  Asymptotic theory for common principal component analysis , 1986 .

[8]  W. Gautschi,et al.  An algorithm for simultaneous orthogonal transformation of several positive definite symmetric matrices to nearly diagonal form , 1986 .

[9]  B. Flury.  Common Principal Components and Related Multivariate Models , 1988 .

[10]  Gordon K. Smyth,et al.  Generalized linear models with varying dispersion , 1989 .

[11]  Karl J. Friston,et al.  Functional Connectivity: The Principal-Component Analysis of Large (PET) Data Sets , 1993, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[12]  Siddhartha R. Dalal,et al.  Robust, smoothly heterogeneous variance regression , 1993 .

[13]  R. Engle,et al.  Multivariate Simultaneous Generalized ARCH , 1995, Econometric Theory.

[14]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[15]  Tom Leonard,et al.  The Matrix-Logarithmic Covariance Model , 1996 .

[16]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo in Practice: A Roundtable Discussion , 1998 .

[17]  M. Pourahmadi.  Joint mean-covariance models with applications to longitudinal data: Unconstrained parameterisation , 1999 .

[18]  Robert J. Boik,et al.  Spectral models for covariance matrices , 2002 .

[19]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[20]  Kuncheng Li,et al.  Altered functional connectivity in early Alzheimer's disease: A resting‐state fMRI study , 2007, Human brain mapping.

[21]  M. Just,et al.  Functional and anatomical cortical underconnectivity in autism: evidence from an FMRI study of an executive function task and corpus callosum morphometry. , 2007, Cerebral cortex.

[22]  Calyampudi R. Rao.  Algebra of Vectors and Matrices , 2008 .

[23]  Peter D. Hoff,et al.  A hierarchical eigenmodel for pooled covariance estimation , 2008, 0804.0031.

[24]  Kevin Murphy,et al.  The impact of global signal regression on resting state correlations: Are anti-correlated networks introduced? , 2009, NeuroImage.

[25]  M. Corbetta,et al.  Learning sculpts the spontaneous activity of the resting human brain , 2009, Proceedings of the National Academy of Sciences.

[26]  M. Fox,et al.  The global signal and observed anticorrelated resting state brain networks. , 2009, Journal of neurophysiology.

[27]  Q. Gong,et al.  Altered functional connectivity in default mode network in absence epilepsy: A resting‐state fMRI study , 2011, Human brain mapping.

[28]  Alan C. Evans,et al.  Brain Connectivity , 2011, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[29]  Karl J. Friston.  Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[30]  Thomas E. Nichols,et al.  Handbook of Functional MRI Data Analysis: Index , 2011 .

[31]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[32]  Thomas E. Nichols,et al.  Handbook of Functional MRI Data Analysis: Index , 2011 .

[33]  Peter D. Hoff,et al.  A Covariance Regression Model , 2011, 1102.5721.

[34]  Michael P. Milham,et al.  Resting State Functional Connectivity Correlates of Inhibitory Control in Children with Attention-Deficit/Hyperactivity Disorder , 2012, Front. Psychiatry.

[35]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[36]  Jeroen van der Grond,et al.  Resting state functional connectivity differences between behavioral variant frontotemporal dementia and Alzheimer's disease , 2015, Front. Hum. Neurosci..

[37]  David B. Dunson,et al.  Bayesian nonparametric covariance regression , 2011, J. Mach. Learn. Res..

[38]  Hyunjin Park,et al.  Differences in connectivity patterns between child and adolescent attention deficit hyperactivity disorder patients , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Chih-Ling Tsai,et al.  Covariance Regression Analysis , 2015 .

[40]  Christof Seiler,et al.  Multivariate Heteroscedasticity Models for Functional Brain Connectivity , 2017, bioRxiv.

[41]  Chao Zhang,et al.  Functional connectivity predicts gender: Evidence for gender differences in resting brain connectivity , 2018, Human brain mapping.