Estimating Primary Demand for Substitutable Products from Sales Transaction Data

We propose a method for estimating substitute and lost demand when only sales and product availability data are observable, not all products are displayed in all periods (e.g., due to stock-outs or availability controls), and the seller knows its aggregate market share. The model combines a multinomial logit (MNL) choice model with a non-homogeneous Poisson model of arrivals over multiple periods. Our key idea is to view the problem in terms of primary (or first-choice) demand; that is, the demand that would have been observed if all products had been available in all periods. We then apply the expectation-maximization (EM) method to this model, and treat the observed demand as an incomplete observation of primary demand. This leads to an efficient, iterative procedure for estimating the parameters of the model, which provably converges to a stationary point of the incomplete data log-likelihood function. Every iteration of the algorithm consists of simple, closed-form calculations. We illustrate the effectiveness of the procedure on simulated data and two industry data sets.

[1]  Pradeep K. Chintagunta,et al.  Investigating Purchase Incidence, Brand Choice and Purchase Quantity Decisions of Households , 1993 .

[2]  Els Gijsbrechts,et al.  The impact of retailer stockouts on whether, how much, and what to buy , 2003 .

[3]  Nils Rudi,et al.  Centralized and Competitive Inventory Models with Demand Substitution , 2002, Oper. Res..

[4]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[5]  Sven-Eric Andersson,et al.  Passenger choice analysis for seat capacity control: a pilot project in Scandinavian Airlines , 1998 .

[6]  Mark Ferguson,et al.  A Comparison of Unconstraining Methods to Improve Revenue Management Systems , 2009 .

[7]  John D. C. Little,et al.  A Logit Model of Brand Choice Calibrated on Scanner Data , 2011, Mark. Sci..

[8]  Sunil Gupta,et al.  Brand Choice, Purchase Incidence, and Segmentation: An Integrated Modeling Approach , 1992 .

[9]  Aviv Nevo.  Measuring Market Power in the Ready-to-Eat Cereal Industry , 1998 .

[10]  Garrett J. van Ryzin,et al.  Revenue Management Under a General Discrete Choice Model of Consumer Behavior , 2004, Manag. Sci..

[11]  Joffre Swait,et al.  The Effects of Temporal Consistency of Sales Promotions and Availability on Consumer Choice Behavior , 2002 .

[12]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[13]  Marshall L. Fisher,et al.  Demand Estimation and Assortment Optimization Under Substitution: Methodology and Application , 2007, Oper. Res..

[14]  Ananth Raman,et al.  Inventory Record Inaccuracy: An Empirical Analysis , 2008, Manag. Sci..

[15]  Kirthi Kalyanam,et al.  Deconstructing Each Item's Category Contribution , 2007 .

[16]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[17]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[18]  Steven T. Berry,et al.  Automobile Prices in Market Equilibrium , 1995 .

[19]  J. Norris.  Appendix: probability and measure , 1997 .

[20]  R. Ratliff,et al.  A multi-flight recapture heuristic for estimating unconstrained demand from airline bookings , 2008 .

[21]  Garrett J. van Ryzin,et al.  OM Practice - Choice-Based Revenue Management: An Empirical Study of Estimation and Optimization , 2010, Manuf. Serv. Oper. Manag..

[22]  Christopher T. Conlon,et al.  Demand Estimation Under Incomplete Product Availability , 2008 .

[23]  M. Dada,et al.  Estimation of Consumer Demand with Stock-Out Based Substitution: An Application to Vending Machine Products , 1998 .

[24]  W. Nicholson.  Microeconomic theory: basic principles and extensions , 1972 .

[25]  Naufel J. Vilcassim,et al.  Structural Demand Estimation with Varying Product Availability , 2008 .

[26]  Larry Weatherford,et al.  Better unconstraining of airline demand data in revenue management systems for improved forecast accuracy and greater revenues , 2002 .

[27]  Joseph C. Nunes,et al.  The Effect of Product Assortment Changes on Customer Retention , 2005 .

[28]  G. Fitzsimons.  Consumer Response to Stockouts , 2000 .

[29]  Eric T. Bradlow,et al.  Structural Estimation of the Effect of Out-of-Stocks , 2010, Manag. Sci..

[30]  Mark D. Uncles,et al.  Discrete Choice Analysis: Theory and Application to Travel Demand , 1987 .