An approximate dynamic programming approach for a product distribution problem

This paper proposes an approximate dynamic programming-based method for optimizing the distribution operations of a company manufacturing a certain product in numerous plants and distributing it to different regional markets for sale. The production at each plant and in each time period follows a nonstationary stochastic process. The product can be stored at the plants or be shipped to a regional market to serve the random demand. The proposed solution method formulates the problem as a dynamic program and uses approximations of the value function. We develop a tractable procedure to compute the marginal worth of a unit of inventory at a production plant. This quantity is used to update the value function approximations in an iterative improvement scheme. We numerically show that our method yields high quality solutions. Contributed by the Supply Chains/Production-Inventory Systems Department

[1]  Warren B. Powell,et al.  A Review of Sensitivity Results for Linear Networks and a New Approximation to Reduce the Effects of Degeneracy , 1989, Transp. Sci..

[2]  Paul H. Zipkin,et al.  Approximations of Dynamic, Multilocation Production and Inventory Problems , 1984 .

[3]  William C. Jordan,et al.  Principles on the benefits of manufacturing process flexibility , 1995 .

[4]  Martin W. P. Savelsbergh,et al.  The Stochastic Inventory Routing Problem with Direct Deliveries , 2002, Transp. Sci..

[5]  David C. Schmittlein,et al.  Counting Your Customers: Who-Are They and What Will They Do Next? , 1987 .

[6]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[7]  John A. Muckstadt,et al.  A computationally efficient approach for determining inventory levels in a capacitated multiechelon production‐distribution system , 2000 .

[8]  Carlo Vercellis,et al.  Capacity analysis in repetitive assemble-to-order manufacturing systems , 1994 .

[9]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[10]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[11]  Warren B. Powell,et al.  Learning Algorithms for Separable Approximations of Discrete Stochastic Optimization Problems , 2004, Math. Oper. Res..

[12]  Warren B. Powell,et al.  Stochastic Programming in Transportation and Logistics , 2003 .

[13]  R. Wets,et al.  Stochastic programming , 1989 .

[14]  Warrren B Powell,et al.  An Adaptive, Distribution-Free Algorithm for the Newsvendor Problem with Censored Demands, with Applications to Inventory and Distribution , 2001 .

[15]  Uday S. Karmarkar The Multilocation Multiperiod Inventory Problem: Bounds and Approximations , 1987 .

[16]  John N. Tsitsiklis,et al.  Analysis of temporal-difference learning with function approximation , 1996, NIPS 1996.

[17]  Hanif D. Sherali,et al.  Intertemporal Allocation of Capital Costs in Electric Utility Capacity Expansion Planning Under Uncertainty , 1984 .

[18]  P. Jackson Stock allocation in a two-echelon distribution system or “What to do until your ship comes in” , 1988 .

[19]  Warren B. Powell,et al.  Models and Algorithms for Distribution Problems with Uncertain Demands , 1996, Transp. Sci..

[20]  Uday S. Karmarkar,et al.  The Multiperiod Multilocation Inventory Problem , 1981, Oper. Res..

[21]  Cynthia Barnhart,et al.  Composite Variable Formulations for Express Shipment Service Network Design , 2002, Transp. Sci..

[22]  Benjamin Van Roy,et al.  A neuro-dynamic programming approach to retailer inventory management , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[23]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.

[24]  Benjamin Van Roy,et al.  The Linear Programming Approach to Approximate Dynamic Programming , 2003, Oper. Res..

[25]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[26]  Daniel Adelman,et al.  A Price-Directed Approach to Stochastic Inventory/Routing , 2004, Oper. Res..