Bayesian analysis of binary and polychotomous response data

Abstract A vast literature in statistics, biometrics, and econometrics is concerned with the analysis of binary and polychotomous response data. The classical approach fits a categorical response regression model using maximum likelihood, and inferences about the model are based on the associated asymptotic theory. The accuracy of classical confidence statements is questionable for small sample sizes. In this article, exact Bayesian methods for modeling categorical response data are developed using the idea of data augmentation. The general approach can be summarized as follows. The probit regression model for binary outcomes is seen to have an underlying normal regression structure on latent continuous data. Values of the latent data can be simulated from suitable truncated normal distributions. If the latent data are known, then the posterior distribution of the parameters can be computed using standard results for normal linear models. Draws from this posterior are used to sample new latent data, and t...

[1]  D. J. Finney,et al.  The estimation from individual records of the relationship between dose and quantal response. , 1947, Biometrika.

[2]  John Aitchison,et al.  THE GENERALIZATION OF PROBIT ANALYSIS TO THE CASE OF MULTIPLE RESPONSES , 1957 .

[3]  J. Gurland,et al.  Polychotomous Quantal Response in Biological Assay , 1960 .

[4]  David R. Cox.  The analysis of binary data , 1970 .

[5]  John Aitchison,et al.  Polychotomous quantal response by maximum indicant , 1970 .

[6]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[7]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[8]  D. McFadden.  Conditional logit analysis of qualitative choice behavior , 1972 .

[9]  R. McKelvey,et al.  A statistical model for the analysis of ordinal level dependent variables , 1975 .

[10]  Arnold Zellner,et al.  Bayesian Analysis of Regression Error Terms , 1975 .

[11]  R. Prentice,et al.  A generalization of the probit and logit methods for dose response curves. , 1976, Biometrics.

[12]  D. Wise,et al.  A CONDITIONAL PROBIT MODEL FOR QUALITATIVE CHOICE: DISCRETE DECISIONS RECOGNIZING INTERDEPENDENCE AND HETEROGENEOUS PREFERENCES' , 1978 .

[13]  E. Olusegun George,et al.  A remark on the shape of the logistic distribution , 1978 .

[14]  P. McCullagh.  Regression Models for Ordinal Data , 1980 .

[15]  J. Naylor,et al.  Applications of a Method for the Efficient Computation of Posterior Distributions , 1982 .

[16]  G. Maddala.  Limited-dependent and qualitative variables in econometrics: Introduction , 1983 .

[17]  Linus Schrage,et al.  A guide to simulation , 1983 .

[18]  Paul Bratley,et al.  A guide to simulation , 1983 .

[19]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[20]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[21]  Peter E. Rossi,et al.  Bayesian analysis of dichotomous quantal response models , 1984 .

[22]  L. Devroye.  Non-Uniform Random Variate Generation , 1986 .

[23]  R. H. Myers.  Classical and modern regression with applications , 1986 .

[24]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[25]  William E. Griffiths,et al.  Small Sample Properties of Probit Model Estimators , 1987 .

[26]  K. Chaloner,et al.  A Bayesian approach to outlier detection and residual analysis , 1988 .

[27]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[28]  Martin A. Tanner,et al.  Posterior Computations for Censored Regression Data , 1990 .

[29]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[30]  S. E. Hills,et al.  Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling , 1990 .

[31]  Scott L. Zeger,et al.  Generalized linear models with random e ects: a Gibbs sampling approach , 1991 .

[32]  Nicholas G. Polson,et al.  Inference for nonconjugate Bayesian Models using the Gibbs sampler , 1991 .

[33]  John Geweke,et al.  Efficient Simulation from the Multivariate Normal and Student-t Distributions Subject to Linear Constraints and the Evaluation of Constraint Probabilities , 1991 .

[34]  S. Chib.  Bayes inference in the Tobit censored regression model , 1992 .

[35]  Adrian F. M. Smith,et al.  Bayesian Inference for Generalized Linear and Proportional Hazards Models Via Gibbs Sampling , 1993 .