How Should Consumers’ Willingness to Pay be Measured? An Empirical Comparison of State-of-the-Art Approaches

This study compares the performance of four commonly used approaches to measure consumers’ willingness to pay with real purchase data (REAL): the open-ended (OE) question format; choice-based conjoint (CBC) analysis; Becker, DeGroot, and Marschak's (BDM) incentive-compatible mechanism; and incentive-aligned choice-based conjoint (ICBC) analysis. With this five-in-one approach, the authors test the relative strengths of the four measurement methods, using REAL as the benchmark, on the basis of statistical criteria and decision-relevant metrics. The results indicate that the BDM and ICBC approaches can pass statistical and decision-oriented tests. The authors find that respondents are more price sensitive in incentive-aligned settings than in non-incentive-aligned settings and the REAL setting. Furthermore, they find a large number of “none” choices under ICBC than under hypothetical conjoint analysis. This study uncovers an intriguing possibility: Even when the OE format and CBC analysis generate hypothetical bias, they may still lead to the right demand curves and right pricing decisions.

[1]  Richard C. Bishop,et al.  Which Response Format Reveals the Truth about Donations to a Public Good , 1996 .

[2]  Peeter W. J. Verlegh,et al.  Range and Number-of-Levels Effects in Derived and Stated Measures of Attribute Importance , 2002 .

[3]  On the futility of criticizing Simon´s rational choice model , 2008 .

[4]  Kamel Jedidi,et al.  Measuring Heterogeneous Reservation Prices for Product Bundles , 2003 .

[5]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[6]  Joel Huber,et al.  The Importance of Utility Balance in Efficient Choice Designs , 1996 .

[7]  Thomas Otter,et al.  Heterogeneity distributions of willingness-to-pay in choice models , 2007 .

[8]  I. Ivanov,et al.  What price management? , 2023, The New England journal of medicine.

[9]  J. Lindén,et al.  Eliciting Reservation Prices: Becker–Degroot–Marschak Mechanisms vs. Markets , 1997 .

[10]  T. Schroeder,et al.  Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks , 2004 .

[11]  Richard H. Thaler,et al.  Mental Accounting and Consumer Choice , 1985, Mark. Sci..

[12]  Alexander Chernev,et al.  Reverse Pricing and Online Price Elicitation Strategies in Consumer Choice , 2003 .

[13]  Jordan J. Louviere,et al.  Design and Analysis of Simulated Consumer Choice or Allocation Experiments: An Approach Based on Aggregate Data , 1983 .

[14]  Michael Creel,et al.  Confidence intervals for evaluating benefits estimates from dichotomous choice contingent valuation studies. , 1991 .

[15]  K. P. Kaas,et al.  Are the Vickrey Auction and the BDM Mechanism Really Incentive Compatible? — Empirical Results and Optimal Bidding Strategies in Cases of Uncertain Willingness-to-pay , 2006 .

[16]  Edward J. Balistreri,et al.  Can Hypothetical Questions Reveal True Values? A Laboratory Comparison of Dichotomous Choice and Open-Ended Contingent Values with Auction Values , 2001 .

[17]  Benjamin L. Campbell,et al.  On the Use of Valuation Mechanisms to Measure Consumers' Willingness to Pay for Novel Products: A Comparison of Hypothetical and Non-Hypothetical Values , 2007 .

[18]  Kenneth Train,et al.  Discrete Choice Models in Preference Space and Willingness-to Pay Space , 2005 .

[19]  Jack Abrams.  A New Method for Testing Pricing Decisions , 1964 .

[20]  Glenn W. Harrison,et al.  Chapter 81 Experimental Evidence on the Existence of Hypothetical Bias in Value Elicitation Methods , 2008 .

[21]  Rabikar Chatterjee,et al.  Reservation Price as a Range: An Incentive-Compatible Measurement Approach , 2007 .

[22]  Christina Sichtmann,et al.  An empirical comparison of methods to measure willingness to pay by examining the hypothetical bias , 2005 .

[23]  William L. Moore,et al.  The no-choice option and dual response choice designs , 2006 .

[24]  Z. John Zhang,et al.  Competitive Coupon Targeting , 1995 .

[25]  Min Ding.  An Incentive-Aligned Mechanism for Conjoint Analysis , 2007 .

[26]  Dick R. Wittink,et al.  The metric quality of full-profile judgments and the number-of-attribute-levels effect in conjoint analysis , 1994 .

[27]  Min Ding,et al.  A simple mechanism to incentive-align conjoint experiments , 2010 .

[28]  John R. Hauser,et al.  Probabilistic Polyhedral Methods for Adaptive Choice-Based Conjoint Analysis: Theory and Application , 2007 .

[29]  Trudy Ann Cameron,et al.  Estimating Willingness to Pay from Survey Data: An Alternative Pre-Test-Market Evaluation Procedure , 1987 .

[30]  Ronald M. Harstad.  Dominant Strategy Adoption and Bidders' Experience with Pricing Rules , 2000 .

[31]  Min Ding,et al.  Eliciting Preference for Complex Products: A Web-Based Upgrading Method , 2008 .

[32]  W. Michael Hanemann,et al.  Welfare Evaluations in Contingent Valuation Experiments with Discrete Responses , 1984 .

[33]  Pradeep K. Chintagunta,et al.  Customer Value Assessment in Business Markets: A State-of-Practice Study , 1992 .

[34]  Robert Cameron Mitchell,et al.  Using Surveys to Value Public Goods: The Contingent Valuation Method , 1989 .

[35]  Henrik Sattler,et al.  Measurement of Price Effects with Conjoint Analysis: Separating Informational and Allocative Effects of Price , 2003 .

[36]  Gregory L. Poe,et al.  Implementing the Convolutions Approach: A Companion to "Measuring the Difference (X-Y) of Simulated Distributions: A Convolutions Approach" , 1994 .

[37]  M. Degroot,et al.  Measuring utility by a single-response sequential method. , 1964, Behavioral science.

[38]  Rajdeep Grewal,et al.  Incentive-Aligned Conjoint Analysis , 2005 .

[39]  P. Frykblom,et al.  Hypothetical Question Modes and Real Willingness to Pay , 1997 .

[40]  Bryan K. Orme,et al.  Which Conjoint Method Should I Use? , 2001 .

[41]  Robert M. Freund,et al.  Optimizing Product Line Designs: Efficient Methods and Comparisons , 2008, Manag. Sci..

[42]  Ronald M. Harstad,et al.  Information Impact and Allocation Rules in Auctions with Affiliated Private Values: A Laboratory Study , 1987 .

[43]  J. Kagel,et al.  Independent Private Value Auctions: Bidder Behaviour in First-, Second- and Third-Price Auctions with Varying Numbers of Bidders , 1993 .

[44]  Kamel Jedidi,et al.  Willingness to Pay: Measurement and Managerial Implications , 2009 .

[45]  I. Krinsky,et al.  On Approximating the Statistical Properties of Elasticities , 1986 .

[46]  Z. John Zhang,et al.  Augmenting Conjoint Analysis to Estimate Consumer Reservation Price , 2002, Manag. Sci..

[47]  Franziska Völckner,et al.  The dual role of price: decomposing consumers’ reactions to price , 2008 .

[48]  Franziska Voelckner,et al.  An empirical comparison of methods for measuring consumers’ willingness to pay , 2006 .

[49]  B. Skiera,et al.  Measuring Consumers' Willingness to Pay at the Point of Purchase , 2002 .

[50]  Rosedith Sitgreaves Bowker.  Measurement Theory for the Behavioral Sciences , 1983 .

[51]  J. Louviere,et al.  The Role of the Scale Parameter in the Estimation and Comparison of Multinomial Logit Models , 1993 .

[52]  V. Mahajan,et al.  A Reservation-Price Model for Optimal Pricing of Multiattribute Products in Conjoint Analysis , 1991 .

[53]  Dick R. Wittink,et al.  The effect of differences in the number of attribute levels on conjoint results , 1990 .

[54]  Z. John Zhang,et al.  Pay to Switch or Pay to Stay: Preference-Based Price Discrimination in Markets with Switching Costs , 2000 .

[55]  P. Massart.  The Tight Constant in the Dvoretzky-Kiefer-Wolfowitz Inequality , 1990 .

[56]  Jørgen Drud Hansen,et al.  Price as Indicator for Quality ? , 2022 .

[57]  Joel Huber,et al.  Improving Parameter Estimates and Model Prediction by Aggregate Customization in Choice Experiments , 2001 .