Regularized Estimation and Testing for High-Dimensional Multi-Block Vector-Autoregressive Models

Dynamical systems comprising of multiple components that can be partitioned into distinct blocks originate in many scientific areas. A pertinent example is the interactions between financial assets and selected macroeconomic indicators, which has been studied at aggregate level---e.g. a stock index and an employment index---extensively in the macroeconomics literature. A key shortcoming of this approach is that it ignores potential influences from other related components (e.g. Gross Domestic Product) that may exert influence on the system's dynamics and structure and thus produces incorrect results. To mitigate this issue, we consider a multi-block linear dynamical system with Granger-causal ordering between blocks, wherein the blocks' temporal dynamics are described by vector autoregressive processes and are influenced by blocks higher in the system hierarchy. We derive the maximum likelihood estimator for the posited model for Gaussian data in the high-dimensional setting based on appropriate regularization schemes for the parameters of the block components. To optimize the underlying non-convex likelihood function, we develop an iterative algorithm with convergence guarantees. We establish theoretical properties of the maximum likelihood estimates, leveraging the decomposability of the regularizers and a careful analysis of the iterates. Finally, we develop testing procedures for the null hypothesis of whether a block "Granger-causes" another block of variables. The performance of the model and the testing procedures are evaluated on synthetic data, and illustrated on a data set involving log-returns of the US S&P100 component stocks and key macroeconomic variables for the 2001--16 period.

[1]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[2]  N. Meinshausen,et al.  Stability selection , 2008, 0809.2932.

[3]  T. W. Anderson,et al.  Statistical analysis of time series , 1972 .

[4]  Mark W. Watson,et al.  AN EMPIRICAL COMPARISON OF METHODS FOR FORECASTING USING MANY PREDICTORS , 2005 .

[5]  Roger E. A. Farmer,et al.  The Stock Market Crash Really Did Cause the Great Recession , 2013 .

[6]  Mohsen Pourahmadi,et al.  High-Dimensional Covariance Estimation , 2013 .

[7]  Y. Nesterov Gradient methods for minimizing composite objective function , 2007 .

[8]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[9]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[10]  T. Abeysinghe Estimation of direct and indirect impact of oil price on growth , 2001 .

[11]  Yu. I. Ingster,et al.  Detection boundary in sparse regression , 2010, 1009.1706.

[12]  Dominique M. Hanssens,et al.  The Category-Demand Effects of Price Promotions , 2000 .

[13]  George C Tseng,et al.  Statistical Methods in Integrative Genomics. , 2016, Annual review of statistics and its application.

[14]  T. W. Anderson Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal Distributions , 1951 .

[15]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[16]  Michael I. Jordan,et al.  A Probabilistic Interpretation of Canonical Correlation Analysis , 2005 .

[17]  Jean Boivin,et al.  Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach , 2003 .

[18]  G. Michailidis,et al.  Regularized estimation in sparse high-dimensional time series models , 2013, 1311.4175.

[19]  A. Lo,et al.  Econometric Measures of Connectedness and Systemic Risk in the Finance and Insurance Sectors , 2011 .

[20]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[21]  P. Hsu,et al.  On the Limiting Distribution of Roots of a Determinantal Equation , 1941 .

[22]  J-M Loubes,et al.  Penalized maximum likelihood estimation with l1 penalty , 2009 .

[23]  Allen M. Weiss,et al.  Moving from Free to Fee: How Online Firms Market to Change Their business Model Successfully. , 2008 .

[24]  T. Sargent,et al.  Recursive Models of Dynamic Linear Economies , 2013 .

[25]  Mathias Drton,et al.  A SINful approach to Gaussian graphical model selection , 2005 .

[26]  George Michailidis,et al.  Penalized Maximum Likelihood Estimation of Multi-layered Gaussian Graphical Models , 2016, J. Mach. Learn. Res..

[27]  Edmund S. Phelps,et al.  Behind This Structural Boom: The Role of Asset Valuations , 1999 .

[28]  A. Seth Interoceptive inference, emotion, and the embodied self , 2013, Trends in Cognitive Sciences.

[29]  Dean Fantazzini,et al.  A copula-VAR-X approach for industrial production modelling and forecasting , 2008 .

[30]  E. J. Hannan,et al.  Multiple time series , 1970 .

[31]  E. Candès,et al.  Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism , 2010, 1007.1434.

[32]  C.W. Anderson,et al.  Multivariate autoregressive models for classification of spontaneous electroencephalographic signals during mental tasks , 1998, IEEE Transactions on Biomedical Engineering.

[33]  Martin J. Wainwright,et al.  Estimation of (near) low-rank matrices with noise and high-dimensional scaling , 2009, ICML.

[34]  Peter Hall Resampling a coverage pattern , 1985 .

[35]  C. Sims Interpreting the macroeconomic time series facts: The effects of monetary policy☆ , 1992 .

[36]  T. W. Anderson Canonical correlation analysis and reduced rank regression in autoregressive models , 2002 .

[37]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[38]  C. Sims Policy Analysis with Econometric Models , 1982 .

[39]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[40]  Martin J. Wainwright,et al.  A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers , 2009, NIPS.

[41]  G. Reinsel,et al.  Maximum Likelihood Estimation of Vector Autoregressive Moving Average Models. , 1976 .

[42]  M. Pesaran,et al.  Modeling Regional Interdependencies Using a Global Error-Correcting Macroeconometric Model , 2004 .

[43]  Ali Shojaie,et al.  Adaptive Thresholding for Reconstructing Regulatory Networks from Time-Course Gene Expression Data , 2012 .

[44]  T. W. Anderson Asymptotic distribution of the reduced rank regression estimator under general conditions , 1999 .

[45]  G. Michailidis,et al.  Interconnectedness in the Interbank Market , 2015, Journal of Financial Economics.

[46]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[47]  P. Hsu,et al.  ON THE PROBLEM OF RANK AND THE LIMITING DISTRIBUTION OF FISHER'S TEST FUNCTION , 1941 .

[48]  J. Wellner,et al.  Empirical Processes with Applications to Statistics , 2009 .

[49]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[50]  Fang Han,et al.  Robust Estimation of Transition Matrices in High Dimensional Heavy-tailed Vector Autoregressive Processes , 2015, ICML.

[51]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[52]  Mahedi Masuduzzaman Sir Impact of the Macroeconomic Variables on the Stock Market Returns: The Case of Germany and the United Kingdom , 2012 .

[53]  William B. Nicholson,et al.  VARX-L: Structured Regularization for Large Vector Autoregressions with Exogenous Variables , 2015, 1508.07497.

[54]  C. Sims MACROECONOMICS AND REALITY , 1977 .

[55]  Po-Ling Loh,et al.  High-dimensional regression with noisy and missing data: Provable guarantees with non-convexity , 2011, NIPS.

[56]  Martin J. Wainwright,et al.  Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions , 2011, ICML.

[57]  Y. Hsing,et al.  Impacts of Macroeconomic Variables on the U.S. Stock Market Index and Policy Implications , 2011 .

[58]  R. Luce,et al.  A method of matrix analysis of group structure , 1949, Psychometrika.

[59]  E. Carlstein The Use of Subseries Values for Estimating the Variance of a General Statistic from a Stationary Sequence , 1986 .

[60]  Bruno Rémillard,et al.  Copula-Based Semiparametric Models for Multivariate Time Series , 2011, J. Multivar. Anal..

[61]  S. Johansen STATISTICAL ANALYSIS OF COINTEGRATION VECTORS , 1988 .

[62]  Adel Javanmard,et al.  Confidence intervals and hypothesis testing for high-dimensional regression , 2013, J. Mach. Learn. Res..

[63]  M. Rudelson,et al.  Hanson-Wright inequality and sub-gaussian concentration , 2013 .

[64]  Andreas Humpe,et al.  Can Macroeconomic Variables Explain Long Term Stock Market Movements? A Comparison of the US and Japan , 2007 .

[65]  Joseph P. Romano,et al.  Large Sample Confidence Regions Based on Subsamples under Minimal Assumptions , 1994 .

[66]  Christian Gourieroux,et al.  Financial Econometrics: Problems, Models, and Methods , 2001 .

[67]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[68]  H. Künsch The Jackknife and the Bootstrap for General Stationary Observations , 1989 .

[69]  D. Donoho,et al.  Higher criticism for detecting sparse heterogeneous mixtures , 2004, math/0410072.

[70]  Gylfi Zoega,et al.  Roots of the Recent Recoveries: Labor Reforms or Private Sector Forces? , 2000 .

[71]  Bin Yu,et al.  High-dimensional covariance estimation by minimizing ℓ1-penalized log-determinant divergence , 2008, 0811.3628.

[72]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[73]  Tao Zha,et al.  Identifying monetary policy in a small open economy under flexible exchange rates , 2022 .