Efficient Allocation of Marketing Resources using Dynamic Programming

In this paper we address the following question: how to estimate a Markov Decision Process modeling the dynamics of customer relationships. Once the model is estimated, we discuss how to efficiently allocate marketing resources and instruments in order to maximize the long-term value generated by customers in a given future time horizon using dynamic programming. Our methodology allows us both to predict and to optimize the future value generated by customers. We show our approach using a case study involving a major European airline.

[1]  John N. Tsitsiklis,et al.  Dynamic Catalog Mailing Policies , 2006, Manag. Sci..

[2]  Ronald A. Howard,et al.  Comments on the Origin and Application of Markov Decision Processes , 2002, Oper. Res..

[3]  Saharon Rosset,et al.  Customer Lifetime Value Models for Decision Support , 2003, Data Mining and Knowledge Discovery.

[4]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[5]  K.-K. Wong,et al.  Customer lifetime value: stochastic optimization approach , 2004, J. Oper. Res. Soc..

[6]  P. Pfeifer,et al.  Modeling customer relationships as Markov chains , 2000 .

[7]  Sunil Gupta,et al.  Valuing customers , 2007 .

[8]  Füsun F. Gönül,et al.  Optimal Mailing of Catalogs: a New Methodology Using Estimable Structural Dynamic Programming Models , 1998 .

[9]  Katherine N. Lemon,et al.  Return on Marketing: Using Customer Equity to Focus Marketing Strategy , 2004 .

[10]  Piew Datta,et al.  Targeting Customers with Statistical and Data-Mining Techniques , 2001 .

[11]  Susana V. Mondschein,et al.  Mailing Decisions in the Catalog Sales Industry , 1996 .

[12]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[13]  Naoki Abe,et al.  Sequential cost-sensitive decision making with reinforcement learning , 2002, KDD.

[14]  K. Seltman.  Marketing for management. , 2004, Marketing health services.

[15]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[16]  D. Collings,et al.  Valuing customers , 2005 .

[17]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[18]  D. Jain,et al.  Customer lifetime value research in marketing: A review and future directions , 2002 .