Modeling price response from retail sales: An empirical comparison of models with different representations of heterogeneity

Abstract We assess the performance of store sales models with discrete versus continuous representations of heterogeneity. Specifically, we compare the general heterogeneity model introduced by Allenby, Arora, and Ginter (1998) and Lenk and DeSarbo (2000) to its nested versions, a homogeneous model ignoring heterogeneity in marketing effects, a hierarchical Bayes model and a latent class model within a fully Bayesian framework. In an empirical application with scanner data of a large retail chain, we analyze the possible improvements in model fit and predictive validity for approaches that allow for heterogeneity compared to the homogeneous model, and illustrate differences between the various model versions regarding price elasticities. We further compare the performance of the different models to the zone pricing model practiced by the retailer. We find that the more parsimonious models with discrete representations of heterogeneity clearly outperform their continuous counterparts in terms of the model likelihood. Moreover, incorporating heterogeneity does not improve the model fit for many brands compared to the homogeneous model. The prediction accuracy of models with discrete representations of heterogeneity is comparable or even superior to that of continuous heterogeneity models. Noticeably, the predictive performance of the retailer’s zone model is considerably worse than that of the best model for the majority of brands. Our empirical study further demonstrates that models with different representations of heterogeneity provide similar implications for price elasticities, suggesting that there is little benefit from using more complex continuous heterogeneity models from a managerial point of view, at least for the present data.

[1]  J. M. Villas-Boas,et al.  Endogeneity in Brand Choice Models , 1999 .

[2]  Nada Wasi,et al.  COMPARING ALTERNATIVE MODELS OF HETEROGENEITY IN CONSUMER CHOICE BEHAVIOR , 2012 .

[3]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[4]  V. Srinivasan,et al.  An approach to improve the predictive power of choice-based conjoint analysis , 2017 .

[5]  Sylvia Frühwirth-Schnatter,et al.  Capturing consumer heterogeneity in metric conjoint analysis using Bayesian mixture models , 2004 .

[6]  Martina Vandebroek,et al.  Bayesian estimation of mixed logit models: Selecting an appropriate prior for the covariance matrix , 2017, Journal of Choice Modelling.

[7]  Peter E. Rossi,et al.  Marketing models of consumer heterogeneity , 1998 .

[8]  Winfried Steiner,et al.  On the effect of HB covariance matrix prior settings: A simulation study , 2019, Journal of Choice Modelling.

[9]  Markus Christen,et al.  Using Market-Level Data to Understand Promotion Effects in a Nonlinear Model , 1997 .

[10]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[11]  Sylvia Frühwirth-Schnatter,et al.  Model Likelihoods and Bayes Factors for Switching and Mixture Models , 2000 .

[12]  Pradeep K. Chintagunta,et al.  Investigating Heterogeneity in Brand Preferences in Logit Models for Panel Data , 1991 .

[13]  Andreas Brezger,et al.  Flexible estimation of price response functions using retail scanner data , 2007 .

[14]  A. Montgomery Creating Micro-Marketing Pricing Strategies Using Supermarket Scanner Data , 1997 .

[15]  S. Frühwirth-Schnatter Estimating Marginal Likelihoods for Mixture and Markov Switching Models Using Bridge Sampling Techniques , 2004 .

[16]  Michel Wedel,et al.  Discrete and Continuous Representations of Unobserved Heterogeneity in Choice Modeling , 1999 .

[17]  Dick R. Wittink,et al.  Varying parameter models to accommodate dynamic promotion effects , 1998 .

[18]  Xiao-Li Meng,et al.  SIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION , 1996 .

[19]  Sungho Park,et al.  Handling Endogenous Regressors by Joint Estimation Using Copulas , 2012, Mark. Sci..

[20]  Gary J. Russell,et al.  A Probabilistic Choice Model for Market Segmentation and Elasticity Structure , 1989 .

[21]  Sunil Gupta,et al.  Commercial Use of UPC Scanner Data: Industry and Academic Perspectives , 1999 .

[22]  Friederike Paetz,et al.  The benefits of incorporating utility dependencies in finite mixture probit models , 2017, OR Spectr..

[23]  Wayne S. DeSarbo,et al.  Bayesian inference for finite mixtures of generalized linear models with random effects , 2000 .

[24]  K. Train Discrete Choice Methods with Simulation , 2003 .

[25]  M. Stephens Dealing with label switching in mixture models , 2000 .

[26]  Naufel J. Vilcassim,et al.  Modeling Purchase-Timing and Brand-Switching Behavior Incorporating Explanatory Variables and Unobserved Heterogeneity , 1991 .

[27]  Steven T. Berry,et al.  Automobile Prices in Market Equilibrium , 1995 .

[28]  D. Wittink,et al.  A comparison and an exploration of the forecasting accuracy of a loglinear model at different levels of aggregation , 1994 .

[29]  H. Hruschka Relevance of Aggregation Level and Heterogeneity in Sales Response Models , 2003 .

[30]  Greg M. Allenby,et al.  On the Heterogeneity of Demand , 1998 .

[31]  P. Green,et al.  Corrigendum: On Bayesian analysis of mixtures with an unknown number of components , 1997 .

[32]  Robert C. Blattberg,et al.  How Promotions Work , 1995 .

[33]  Pradeep K. Chintagunta,et al.  Balancing Profitability and Customer Welfare in a Supermarket Chain , 2003 .

[34]  Winfried J. Steiner,et al.  Smooth Quantile‐Based Modeling Of Brand Sales, Price And Promotional Effects From Retail Scanner Panels , 2014 .

[35]  Stefan Lang,et al.  Accommodating heterogeneity and nonlinearity in price effects for predicting brand sales and profits , 2015, Eur. J. Oper. Res..

[36]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing , 2005 .

[37]  Peter E. Rossi,et al.  Estimating Price Elasticities with Theory-Based Priors , 1999 .

[38]  Harald J. van Heerde,et al.  Semiparametric Analysis to Estimate the Deal Effect Curve , 2001 .

[39]  S. Frühwirth-Schnatter,et al.  Bayesian Analysis of the Heterogeneity Model , 2004 .

[40]  H. Hruschka Functional Flexibility, Latent Heterogeneity and Endogeneity in Aggregate Market Response Models , 2017 .

[41]  Michel Wedel,et al.  Solving and Testing for Regressor-Error (in)Dependence When no Instrumental Variables are Available: With New Evidence for the Effect of Education on Income , 2005 .

[42]  Harald Hruschka,et al.  Relevance of functional flexibility for heterogeneous sales response models: A comparison of parametric and semi-nonparametric models , 2006, Eur. J. Oper. Res..

[43]  Sylvia Frühwirth-Schnatter,et al.  Capturing Unobserved Consumer Heterogeneity Using the Bayesian Heterogeneity Model , 2005 .

[44]  Peter Kurz,et al.  Analyzing the capabilities of the HB logit model for choice-based conjoint analysis: a simulation study , 2020, Journal of Business Economics.

[45]  Peter E. Rossi,et al.  Determinants of Store-Level Price Elasticity , 1995 .

[46]  Carl F. Mela,et al.  The Dynamic Effect of Discounting on Sales: Empirical Analysis and Normative Pricing Implications , 1999 .

[47]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[48]  Robert C. Blattberg,et al.  Shrinkage Estimation of Price and Promotional Elasticities: Seemingly Unrelated Equations , 1991 .

[49]  Daniel Guhl,et al.  Addressing endogeneity in aggregate logit models with time-varying parameters for optimal retail-pricing , 2019, Eur. J. Oper. Res..

[50]  Harald J. van Heerde,et al.  How Promotions Work: Scan Pro-Based Evolutionary Model Building , 2002 .

[51]  Rohit Verma,et al.  Issues in the use of ratings-based versus choice-based conjoint analysis in operations management research , 2009, Eur. J. Oper. Res..

[52]  C. Robert,et al.  Computational and Inferential Difficulties with Mixture Posterior Distributions , 2000 .

[53]  D. Wittink,et al.  Building Models for Marketing Decisions , 2000 .

[54]  Kirthi Kalyanam,et al.  Estimating Irregular Pricing Effects: A Stochastic Spline Regression Approach , 1998 .

[55]  Stefan Lang,et al.  A comparison of semiparametric and heterogeneous store sales models for optimal category pricing , 2017, OR Spectr..

[56]  Füsun F. Gönül,et al.  Modeling Multiple Sources of Heterogeneity in Multinomial Logit Models: Methodological and Managerial Issues , 1993 .

[57]  Rick L. Andrews,et al.  Hierarchical Bayes versus Finite Mixture Conjoint Analysis Models: A Comparison of Fit, Prediction, and Partworth Recovery , 2002 .

[58]  Harald Hruschka,et al.  Clusterwise pricing in stores of a retail chain , 2007, OR Spectr..

[59]  S. Frühwirth-Schnatter Fully Bayesian Analysis of Switching Gaussian State Space Models , 2001 .

[60]  Andreas Brezger,et al.  Monotonic Regression Based on Bayesian P-Splines: An Application to Estimating Price Response Functions from Store-Level Scanner Data , 2008 .

[61]  S. Frühwirth-Schnatter Markov chain Monte Carlo Estimation of Classical and Dynamic Switching and Mixture Models , 2001 .

[62]  J. Heckman,et al.  A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data , 1984 .

[63]  Rick L. Andrews,et al.  Estimating the SCAN*PRO Model of Store Sales: HB, FM or just OLS? , 2008 .

[64]  G. Verbeke,et al.  A Linear Mixed-Effects Model with Heterogeneity in the Random-Effects Population , 1996 .

[65]  Rick L. Andrews,et al.  An Empirical Comparison of Logit Choice Models with Discrete versus Continuous Representations of Heterogeneity , 2002 .

[66]  G. Tellis The Price Elasticity of Selective Demand: A Meta-Analysis of Econometric Models of Sales , 1988 .

[67]  K. Train,et al.  A Control Function Approach to Endogeneity in Consumer Choice Models , 2010 .