A Comparison of Conjoint Analysis Response Formats

A split-sample design is used to evaluate the convergent validity of three response formats used in conjoint analysis experiments. We investigate whether recoding rating data to rankings and choose-one formats, and recoding ranking data to choose one, result in structural models and welfare estimates that are statistically indistinguishable from estimates based on ranking or choose-one questions. Our results indicate that convergent validity of ratings, ranks, and choose one is not established. In addition, we find that people frequently use ‘ties’ in responses to rating questions, and that the option not to choose any of the alternatives (‘opt-out’) affects some preference estimates. Copyright 2001, Oxford University Press.

[1]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[2]  M. Rokeach.  The Nature Of Human Values , 1974 .

[3]  Shlomo Kalish,et al.  A comparison of ranking, rating and reservation price measurement in conjoint analysis , 1991 .

[4]  Stephen K. Swallow,et al.  Asymmetries in Ordered Strength of Preference Models: Implications of Focus Shift for Discrete-Choice Preference Estimation , 1999 .

[5]  P. A. Russell,et al.  Ranking or rating? Some data and their implications for the measurement of evaluative response , 1994 .

[6]  Jerry A. Hausman,et al.  Contingent valuation : a critical assessment , 1993 .

[7]  Jordan J. Louviere,et al.  An Empirical Comparison of Ratings-Based and Choice-Based Conjoint Models , 1992 .

[8]  Guy Garrod,et al.  The non-use benefits of enhancing forest biodiversity: A contingent ranking study , 1997 .

[9]  John Mackenzie,et al.  A Comparison of Contingent Preference Models , 1993 .

[10]  William H. Desvousges,et al.  Estimating Stated Preferences with Rated-Pair Data: Environmental, Health, and Employment Effects of Energy Programs , 1997 .

[11]  Moshe Ben-Akiva,et al.  Analysis of the reliability of preference ranking data , 1991 .

[12]  W. Michael Hanemann,et al.  Valuing the Environment through Contingent Valuation , 1994 .

[13]  Jon A. Krosnick,et al.  The Measurement of Values in Surveys: A Comparison of Ratings and Rankings , 1985 .

[14]  N. Feather,et al.  The measurement of values: Effects of different assessment procedures , 1973 .

[15]  J. Louviere,et al.  Combining Revealed and Stated Preference Methods for Valuing Environmental Amenities , 1994 .

[16]  Kevin J. Boyle,et al.  Using Conjoint Analysis to Derive Estimates of Compensating Variation , 1996 .

[17]  C. Barrett,et al.  Conjoint Analysis of Groundwater Protection Programs , 1997, Agricultural and Resource Economics Review.

[18]  Paul S. Edelman,et al.  The Oil Pollution Act of 1990 , 1990, Pace Environmental Law Review.

[19]  Gregory L. Poe,et al.  Elicitation Effects in Contingent Valuation: Comparisons to a Multiple Bounded Discrete Choice Approach , 1998 .

[20]  Jon A. Krosnick,et al.  A TEST OF THE FORM-RESISTANT CORRELATION HYPOTHESIS RATINGS, RANKINGS, AND THE MEASUREMENT OF VALUES , 1988 .

[21]  Jordan J. Louviere,et al.  Analyzing Decision Making: Metric Conjoint Analysis , 1988 .

[22]  Jordan J. Louviere,et al.  Cross-task validity comparisons of stated preference choice models , 1993 .

[23]  T. F. Weaver,et al.  Evaluating Impacts from Noxious Facilities: Including Public Preferences in Current Siting Mechanisms , 1993 .

[24]  L. Mattsson,et al.  How do Different Forest Management Practices Affect the Non-timber Value of Forests?—an Economic Analysis , 1994 .

[25]  Jordan J. Louviere,et al.  Perceptions versus Objective Measures of Environmental Quality in Combined Revealed and Stated Preference Models of Environmental Valuation , 1997 .

[26]  Robert Cameron Mitchell,et al.  Using Surveys to Value Public Goods: The Contingent Valuation Method , 1989 .

[27]  Thomas P. Holmes,et al.  The effect of response time on conjoint analysis estimates of rainforest protection values. , 1998 .

[28]  N. Hanley,et al.  THE CONTINGENT VALUATION OF FOREST CHARACTERISTICS: TWO EXPERIMENTS , 1993 .

[29]  I. Krinsky,et al.  On Approximating the Statistical Properties of Elasticities , 1986 .