Multi-period marketing-mix optimization with response spike forecasting

Optimizing the marketing budget and its distribution across various channels and target segments, along with the timing of each marketing action for maximum profit, are among the essential problems in marketing. A crucial requirement for effective decision making in direct marketing is an efficient optimization algorithm, coupled with reliable predictions on how the various marketing actions will impact consumers' purchase decisions. For maximizing mid-term revenues, while properly incorporating the temporal dynamics of individual consumers' mental states, we introduce a comprehensive optimization framework for obtaining a state-based marketing-mix policy, with a novel combination of machine learning, optimization, and simulation. Each consumer's purchase decision is modeled with a marked point process whose discrete-state approximation enables efficient optimization of high-dimensional decision variables, and whose discrete event simulation supplies accurate forecasts of the revenues and risks of the optimized policy. The key idea for ensuring the practicality of the proposed approach to marketing planning is a linear programming formulation that allows both handling of temporal dynamics and complex budget constraints across many periods, segments, and channels required in real marketing operations. A real-world case study based on an online retailing dataset implies high revenue gains when the simulation model can be relied on.

[1]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[2]  C. Chatfield,et al.  Results concerning Brand Choice , 1975 .

[3]  Richard F. Serfozo,et al.  Technical Note - An Equivalence Between Continuous and Discrete Time Markov Decision Processes , 1979, Oper. Res..

[4]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[5]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[6]  A. Taudes,et al.  A Multivariate Polya Model of Brand Choice and Purchase Incidence , 1986 .

[7]  David C. Schmittlein,et al.  Counting Your Customers: Who-Are They and What Will They Do Next? , 1987 .

[8]  Keith W. Ross,et al.  Markov Decision Processes with Sample Path Constraints: The Communicating Case , 1989, Oper. Res..

[9]  Keith W. Ross,et al.  Multichain Markov Decision Processes with a Sample Path Constraint: A Decomposition Approach , 1991, Math. Oper. Res..

[10]  J. Ross Quinlan,et al.  Improved Use of Continuous Attributes in C4.5 , 1996, J. Artif. Intell. Res..

[11]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[12]  E. Altman Constrained Markov Decision Processes , 1999 .

[13]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.

[14]  Arnd Huchzermeier,et al.  Special Issue: 2002 Franz Edelman Award for Achievement in Operations Research and the Management Sciences: Optimizing Rhenania's Mail-Order Business Through Dynamic Multilevel Modeling (DMLM) , 2003, Interfaces.

[15]  Prasad A. Naik,et al.  Understanding the Impact of Synergy in Multimedia Communications , 2003 .

[16]  Naoki Abe,et al.  Cross channel optimized marketing by reinforcement learning , 2004, KDD.

[17]  Richard C. Chen,et al.  Dynamic programming equations for discounted constrained stochastic control , 2004, IEEE Transactions on Automatic Control.

[18]  K. Raman,et al.  Planning Marketing-Mix Strategies in the Presence of Interaction Effects , 2005 .

[19]  M. Jacobsen Point Process Theory and Applications: Marked Point and Piecewise Deterministic Processes , 2005 .

[20]  Won Suk Lee,et al.  estWin: Online data stream mining of recent frequent itemsets by sliding window method , 2005, J. Inf. Sci..

[21]  Thore Graepel,et al.  Poisson-Networks: A Model for Structured Poisson Processes. , 2005 .

[22]  Gavin C. Cawley,et al.  Sparse Multinomial Logistic Regression via Bayesian L1 Regularisation , 2006, NIPS.

[23]  Alexey Piunovskiy,et al.  Dynamic programming in constrained Markov decision processes , 2006 .

[24]  Richard C. Chen,et al.  Non-randomized policies for constrained Markov decision processes , 2007, Math. Methods Oper. Res..

[25]  Vikram Krishnamurthy,et al.  MIMO Transmission Control in Fading Channels—A Constrained Markov Decision Process Formulation With Monotone Randomized Policies , 2007, IEEE Transactions on Signal Processing.

[26]  André Elisseeff,et al.  The 2005 ISMS Practice Prize Winner---Customer Equity and Lifetime Management (CELM) Finnair Case Study , 2007 .

[27]  A. Herrmann,et al.  Applying decision trees for value-based customer relations management: Predicting airline customers' future values , 2007 .

[28]  Claudia González-Vallejo,et al.  Cognitive Models of Choice: Comparing Decision Field Theory to the Proportional Difference Model , 2009, Cogn. Sci..

[29]  Yoram Singer,et al.  Efficient Online and Batch Learning Using Forward Backward Splitting , 2009, J. Mach. Learn. Res..

[30]  Naoki Abe,et al.  Optimizing debt collections using constrained reinforcement learning , 2010, KDD.

[31]  Andrzej Ruszczynski,et al.  Risk-averse dynamic programming for Markov decision processes , 2010, Math. Program..

[32]  Eric M. Schwartz,et al.  What Do People Talk About? Drivers of Immediate and Ongoing Word-of-Mouth , 2011 .

[33]  D. Schultz,et al.  Understanding consumer-created media synergy , 2011 .

[34]  Puyang Xu,et al.  A Model for Temporal Dependencies in Event Streams , 2011, NIPS.

[35]  Takayuki Osogami,et al.  Iterated risk measures for risk-sensitive Markov decision processes with discounted cost , 2011, UAI.

[36]  Pradeep Chintagunta,et al.  Assessing the Effect of Marketing Investments in a Business Marketing Context , 2011, Mark. Sci..

[37]  Takayuki Osogami,et al.  Robustness and risk-sensitivity in Markov decision processes , 2012, NIPS.

[38]  K. Raman,et al.  Optimal Resource Allocation with Time-varying Marketing Effectiveness, Margins and Costs , 2012 .

[39]  Marco Pavone,et al.  Stochastic optimal control with dynamic, time-consistent risk constraints , 2013, 2013 American Control Conference.

[40]  Naoki Abe,et al.  Collective Response Spike Prediction for Mutually Interacting Consumers , 2013, 2013 IEEE 13th International Conference on Data Mining.

[41]  Vivek S. Borkar,et al.  Risk-Constrained Markov Decision Processes , 2010, IEEE Trans. Autom. Control..