Testing Predicted Choices Against Observations in Probabilistic Discrete-Choice Models

Probabilistic discrete-choice models, such as multinomial logit models, are widely used to predict changes in market shares or total demand resulting from changes in policy variables under management control. These models often are evaluated in terms of their ability to predict choices in a holdout sample. This paper presents a new test for comparing predicted and observed choices. The results of a Monte Carlo experiment indicate that the new test has good finite-sample properties and high power in several circumstances likely to arise frequently in applications.

[1]  William L. Moore,et al.  Experiments in Constrained Choice , 1987 .

[2]  Wagner A. Kamakura,et al.  An Ideal-Point Probabilistic Choice Model for Heterogeneous Preferences , 1986 .

[3]  R. Jennrich.  Asymptotic Properties of Non-Linear Least Squares Estimators , 1969 .

[4]  Frank S. Koppelman,et al.  TRANSFERABILITY ANALYSIS OF DISAGGREGATE CHOICE MODELS , 1982 .

[5]  D. Andrews.  Chi-Square Diagnostic Tests for Econometric Models: Theory , 1988 .

[6]  D. McFadden.  Quantitative Methods for Analyzing Travel Behaviour of Individuals: Some Recent Developments , 1977 .

[7]  Dennis H. Gensch,et al.  Empirical Evidence Supporting the Use of Multiple Choice Models in Analyzing a Population , 1987 .

[8]  Jordan J. Louviere,et al.  Design and Analysis of Simulated Consumer Choice or Allocation Experiments: An Approach Based on Aggregate Data , 1983 .

[9]  Dennis H. Gensch,et al.  The Influence of Involvement on Disaggregate Attribute Choice Models , 1987 .

[10]  Imran S. Currim.  Predictive Testing of Consumer Choice Models Not Subject to Independence of Irrelevant Alternatives , 1982 .

[11]  D. Gensch.  Empirically Testing a Disaggregate Choice Model for Segments , 1985 .

[12]  Imran S. Currim,et al.  Using Segmentation Approaches for Better Prediction and Understanding from Consumer Mode Choice Models , 1981 .

[13]  Jerry A. Hausman,et al.  Assessing the potential demand for electric cars , 1981 .

[14]  Joel L. Horowitz.  Specification tests for probabilistic discrete choice models of consumer behaviour. , 1988 .

[15]  J. Horowitz.  Testing probabilistic discrete choice models of travel demand by comparing predicted and observed aggregate choice shares , 1985 .

[16]  C. R. Rao,et al.  Linear Statistical Inference and its Applications , 1968 .

[17]  Jordan J. Louviere,et al.  CONJOINT ANALYSIS MODELLING OF STATED PREFERENCES , 1988 .

[18]  Randall G. Chapaaan,et al.  Exploiting Rank Ordered Choice Set Data within the Stochastic Utility Model , 1982 .

[19]  John R. Hauser,et al.  Testing the Accuracy, Usefulness, and Significance of Probabilistic Choice Models: An Information-Theoretic Approach , 1978, Oper. Res..

[20]  Jordan J. Louviere,et al.  A composite attitude-behavior model of traveler decision making , 1981 .

[21]  L. Krishnamurthi,et al.  A Model of Brand Choice and Purchase Quantity Price Sensitivities , 1988 .

[22]  Sanjoy Ghose,et al.  When Choice Models Fail: Compensatory Models in Negatively Correlated Environments , 1989 .