A Bayesian chi-squared test for hypothesis testing

Abstract A new Bayesian test statistic is proposed to test a point null hypothesis based on a quadratic loss. The proposed test statistic may be regarded as the Bayesian version of the Lagrange multiplier test. Its asymptotic distribution is obtained based on a set of regular conditions and follows a chi-squared distribution when the null hypothesis is correct. The new statistic has several important advantages that make it appealing in practical applications. First, it is well-defined under improper prior distributions. Second, it avoids Jeffrey–Lindley’s paradox. Third, it always takes a non-negative value and is relatively easy to compute, even for models with latent variables. Fourth, its numerical standard error is relatively easy to obtain. Finally, it is asymptotically pivotal and its threshold values can be obtained from the chi-squared distribution. The method is illustrated using some real examples in economics and finance.

[1]  Jeffrey R. Russell,et al.  Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data , 1998 .

[2]  R. McCulloch.  Local Model Influence , 1989 .

[3]  W. Gilks,et al.  Adaptive Rejection Metropolis Sampling Within Gibbs Sampling , 1995 .

[4]  Chris Brooks,et al.  Introductory Econometrics for Finance , 2002 .

[5]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[6]  Jae-Young Kim,et al.  Large Sample Properties of Posterior Densities, Bayesian Information Criterion and the Likelihood Principle in Nonstationary Time Series Models , 1998 .

[7]  Christian P. Robert,et al.  The Bayesian choice : from decision-theoretic foundations to computational implementation , 2007 .

[8]  A. O'Hagan,et al.  Fractional Bayes factors for model comparison , 1995 .

[9]  J. Magnus,et al.  Matrix Differential Calculus with Applications , 1988 .

[10]  J. Bernardo,et al.  Bayesian Hypothesis Testing: a Reference Approach , 2002 .

[11]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[12]  S. Chib,et al.  Marginal Likelihood From the Metropolis–Hastings Output , 2001 .

[13]  Adrian Pagan,et al.  The Lagrange Multiplier Test and its Applications to Model Specification in Econometrics , 1980 .

[14]  Jae-Young Kim,et al.  Bayesian Asymptotic Theory in a Time Series Model with a Possible Nonstationary Process , 1994, Econometric Theory.

[15]  Drew D. Creal.  A Survey of Sequential Monte Carlo Methods for Economics and Finance , 2012 .

[16]  W. Newey,et al.  A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelationconsistent Covariance Matrix , 1986 .

[17]  Chan‐Fu Chen.  On Asymptotic Normality of Limiting Density Functions with Bayesian Implications , 1985 .

[18]  Sun Yat-sen,et al.  Bayesian Hypothesis Testing in Latent Variable Models∗ , 2010 .

[19]  J. Berger,et al.  The Intrinsic Bayes Factor for Model Selection and Prediction , 1996 .

[20]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics (Revised Edition) , 1999 .

[21]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[22]  Dale J. Poirier.  A predictive motivation for loss function specification in parametric hypothesis testing , 1997 .

[23]  Dale J. Poirier,et al.  Intermediate Statistics and Econometrics: A Comparative Approach , 1995 .

[24]  John Geweke,et al.  Bayesian Model Comparison and Validation , 2007 .

[25]  H. Jeffreys,et al.  Theory of probability , 1896 .

[26]  Frank Schorfheide,et al.  Bayesian Analysis of DSGE Models—Rejoinder , 2007 .

[27]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo Methods for Computing Bayes Factors , 2001 .

[28]  L. Dousset.  Understanding Human Relations (Kinship Systems) , 2011 .

[29]  Jeffrey M. Wooldridge,et al.  Introductory Econometrics: A Modern Approach , 1999 .

[30]  A. Doucet,et al.  Robust inference on parameters via particle filters and sandwich covariance matrices , 2012 .

[31]  Philip Heidelberger,et al.  Simulation Run Length Control in the Presence of an Initial Transient , 1983, Oper. Res..

[32]  Sumeetpal S. Singh,et al.  Particle approximations of the score and observed information matrix in state space models with application to parameter estimation , 2011 .

[33]  J. Geweke,et al.  Contemporary Bayesian Econometrics and Statistics , 2005 .

[34]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[35]  L. Bauwens,et al.  The stochastic conditional duration model: a latent variable model for the analysis of financial durations , 2004 .

[36]  Jie W Weiss,et al.  Bayesian Statistical Inference for Psychological Research , 2008 .

[37]  Tao Zeng,et al.  A new approach to Bayesian hypothesis testing , 2014 .

[38]  Andrew T. Ching,et al.  Bayesian Estimation of Dynamic Discrete Choice Models , 2009 .

[39]  T. Mroz,et al.  The Sensitivity of an Empirical Model of Married Women's Hours of Work to Economic and Statistical Assumptions , 1987 .

[40]  Tao Zeng,et al.  Robust Deviance Information Criterion for Latent Variable Models , 2013 .

[41]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .