A Cross-Validity Comparison of Conjoint Analysis and Choice Models at Different Levels of Aggregation

Several (ratings-based) conjoint analysis and experimental choice (choice-based conjoint) models are compared on their ability to predict both aggregate choice shares among the sample and individual choices in an availability validation task. While there was a weak relationship between validations at the individual and aggregate levels, several models stand out. In general, models capturing individual differences validated well at both the individual and aggregate level. The hierarchical Bayes choice and conjoint models validated particularly well.Among choice models, the hierarchical Bayes choice model had the highest aggregate and individual level-validations. It was followed by the hybrid and seven segment latent segment choice models. Overall, the highest validating ratings-based conjoint model was the hierarchical Bayes model. However, the seven segment latent segment conjoint model produced better aggregate choice share validations than any other conjoint model. These results indicate that validations can be improved either by using benefit segment models and/or merging different types of data to estimate more individualized models.In most cases, rescaling improved the ratings-based, but not the choice-based choice share validations. This suggests that one might adjust for differences between ratings and choice tasks before making choice share predictions.

[1]  Paul E. Green,et al.  Hybrid Models for Conjoint Analysis: An Expository Review , 1984 .

[2]  William L. Moore,et al.  Levels of Aggregation in Conjoint Analysis: An Empirical Comparison , 1980 .

[3]  J. Louviere,et al.  The Role of the Scale Parameter in the Estimation and Comparison of Multinomial Logit Models , 1993 .

[4]  Steven H. Cohen,et al.  Market segmentation with choice-based conjoint analysis , 1995 .

[5]  Jordan J. Louviere,et al.  Design and Analysis of Simulated Consumer Choice or Allocation Experiments: An Approach Based on Aggregate Data , 1983 .

[6]  Paul E. Green,et al.  Segmenting Markets with Conjoint Analysis , 1991 .

[7]  M. Wedel,et al.  Metric Conjoint Segmentation Methods: A Monte Carlo Comparison , 1996 .

[8]  P. Lenk,et al.  Hierarchical Bayes Conjoint Analysis: Recovery of Partworth Heterogeneity from Reduced Experimental Designs , 1996 .

[9]  Michael R. Hagerty,et al.  The Cost of Simplifying Preference Models , 1986 .

[10]  G. Urban,et al.  Pre-Test-Market Evaluation of New Packaged Goods: A Model and Measurement Methodology , 1978 .

[11]  David B. Montgomery,et al.  Predictive Validity of Trade-Off Analysis for Alternative Segmentation Schemes , 1979 .

[12]  Paul E. Green,et al.  Effect of Level of Disaggregation on Conjoint Cross Validations: Some Comparative Findings* , 1998 .

[13]  Paul E. Green,et al.  Cross-Validation Assessment of Alternatives to Individual-Level Conjoint Analysis: A Case Study , 1989 .

[14]  Michel Wedel,et al.  Latent class metric conjoint analysis , 1992 .

[15]  E. Pessemier,et al.  Predicting Brand Purchase Behavior: Marketing Application of the Schönemann and Wang Unfolding Model , 1979 .

[16]  Edgar A. Pessemier,et al.  Using Laboratory Brand Preference Scales to Predict Consumer Brand Purchases , 1971 .

[17]  Greg M. Allenby,et al.  Modeling Household Purchase Behavior with Logistic Normal Regression , 1994 .

[18]  Jordan J. Louviere,et al.  Cross-task validity comparisons of stated preference choice models , 1993 .

[19]  Joel Huber,et al.  The Effectiveness of Alternative Preference Elicitation Procedures in Predicting Choice , 1993 .