Price-Directed Replenishment of Subsets: Methodology and Its Application to Inventory Routing

The idea of price-directed control is to use an operating policy that exploits optimal dual prices from a mathematical programming relaxation of the underlying control problem. We apply it to the problem of replenishing inventory to subsets of products/locations, such as in the distribution of industrial gases, so as to minimize long-run time average replenishment costs. Given a marginal value for each product/location, whenever there is a stockout the dispatcher compares the total value of each feasible replenishment with its cost, and chooses one that maximizes the surplus. We derive this operating policy using a linear functional approximation to the optimal value function of a semi-Markov decision process on continuous spaces. This approximation also leads to a math program whose optimal dual prices yield values and whose optimal objective value gives a lower bound on system performance. We use duality theory to show that optimal prices satisfy several structural properties and can be interpreted as estimates of lowest achievable marginal costs. On real-world instances, the price-directed policy achieves superior, near optimal performance as compared with other approaches.

[1]  Daniel Adelman Remnant inventory systems , 1997 .

[2]  Marshall L. Fisher,et al.  Optimal Solution of Vehicle Routing Problems Using Minimum K-Trees , 1994, Oper. Res..

[3]  Lap Mui Ann Chan,et al.  Probabilistic Analyses and Practical Algorithms for Inventory-Routing Models , 1998, Oper. Res..

[4]  S. K. Goyal,et al.  A dynamic programming algorithm for joint replenishment under general order cost functions , 1987 .

[5]  Joel S. Demski Managerial Uses of Accounting Information , 1997 .

[6]  Moshe Dror,et al.  Inventory/routing: Reduction from an annual to a short-period problem , 1987 .

[7]  Louis M. Dalberto,et al.  Improving the Distribution of Industrial Gases with an On-Line Computerized Routing and Scheduling Optimizer , 1983 .

[8]  W. Jewell Markov-Renewal Programming. II: Infinite Return Models, Example , 1963 .

[9]  George L. Nemhauser,et al.  Price-Directed Control of Remnant Inventory Systems , 1999, Oper. Res..

[10]  Warren B. Powell,et al.  Stochastic Programming in Transportation and Logistics , 2003 .

[11]  E. Denardo,et al.  Multichain Markov Renewal Programs , 1968 .

[12]  K. Talluri,et al.  An Analysis of Bid-Price Controls for Network Revenue Management , 1998 .

[13]  Mukul Majumdar,et al.  CONTROLLED SEMI-MARKOV MODELS UNDER LONG-RUN AVERAGE REWARDS , 1989 .

[14]  R. Bellman,et al.  Polynomial approximation—a new computational technique in dynamic programming: Allocation processes , 1963 .

[15]  O. Hernández-Lerma,et al.  Semi-Markov control models with average costs , 1998 .

[16]  Teodor Gabriel Crainic,et al.  Fleet management and logistics , 1998 .

[17]  M. Savelsbergh,et al.  The Inventory Routing Problem , 1998 .

[18]  Marshall L. Fisher,et al.  The Lagrangian Relaxation Method for Solving Integer Programming Problems , 2004, Manag. Sci..

[19]  Ronald W. Wolff,et al.  A Review of Regenerative Processes , 1993, SIAM Rev..

[20]  N. Dopuch,et al.  Accounting Implications of a Mathematical Programming Approach to the Transfer Price Problem , 1964 .

[21]  AdelmanDaniel Price-Directed Replenishment of Subsets , 2003 .

[22]  Manfred Schäl,et al.  On the Second Optimality Equation for Semi-Markov Decision Models , 1992, Math. Oper. Res..

[23]  Awi Federgruen,et al.  One warehouse multiple retailer systems with vehicle routing costs , 1990 .

[24]  Hans M. Amman,et al.  Handbook of Computational Economics , 1996 .

[25]  J. Hirshleifer On the Economics of Transfer Pricing , 1956 .

[26]  B. Fox Markov Renewal Programming by Linear Fractional Programming , 1966 .

[27]  Awi Federgruen,et al.  The Joint Replenishment Problem with General Joint Cost Structures , 1992, Oper. Res..

[28]  R. Bellman,et al.  FUNCTIONAL APPROXIMATIONS AND DYNAMIC PROGRAMMING , 1959 .

[29]  Paul H. Zipkin,et al.  Foundations of Inventory Management , 2000 .

[30]  Onésimo Hernández-Lerma,et al.  Controlled Markov Processes , 1965 .

[31]  George L. Nemhauser,et al.  Allocating Fibers in Cable Manufacturing , 1999, Manuf. Serv. Oper. Manag..

[32]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[33]  Garrett J. van Ryzin,et al.  Dynamic Vehicle Dispatching: Optimal Heavy Traffic Performance and Practical Insights , 1999, Oper. Res..

[34]  Satinder Singh,et al.  An upper bound on the loss from approximate optimal-value functions , 1994, Machine Learning.

[35]  Refael Hassin,et al.  Exact Computation of Optimal Inventory Policies Over an Unbounded Horizon , 1991, Math. Oper. Res..

[36]  Martin W. P. Savelsbergh,et al.  The Stochastic Inventory Routing Problem with Direct Deliveries , 2002, Transp. Sci..

[37]  O. Hernández-Lerma,et al.  Discrete-time Markov control processes , 1999 .

[38]  Nesa L'abbe Wu,et al.  Linear programming and extensions , 1981 .

[39]  R. Bellman Dynamic programming. , 1957, Science.

[40]  Lawrence M. Wein,et al.  Heavy Traffic Analysis of the Dynamic Stochastic Inventory-Routing Problem , 2015, Transp. Sci..

[41]  Rose-Anne Dana,et al.  Dynamic Programming in Economics , 2003 .

[42]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[43]  Robin O. Roundy,et al.  A Price-Directed Approach to Real-Time Scheduling of Production Operations , 1991 .

[44]  Warren B. Powell,et al.  Dynamic Control of Logistics Queueing Networks for Large-Scale Fleet Management , 1998, Transp. Sci..

[45]  O. Hernández-Lerma Adaptive Markov Control Processes , 1989 .

[46]  William S. Jewell,et al.  Markov-Renewal Programming. I: Formulation, Finite Return Models , 1963 .

[47]  Oded Berman,et al.  Deliveries in an Inventory/Routing Problem Using Stochastic Dynamic Programming , 2001, Transp. Sci..

[48]  Maurice Queyranne Comment on A Dynamic Programming Algorithm for Joint Replenishment Under General Order Cost Functions , 1987 .

[49]  Sean P. Meyn,et al.  Value iteration and optimization of multiclass queueing networks , 1999, Queueing Syst. Theory Appl..

[50]  Leon S. Lasdon,et al.  Optimization Theory of Large Systems , 1970 .

[51]  David Simchi-Levi,et al.  A Location Based Heuristic for General Routing Problems , 1995, Oper. Res..

[52]  Benjamin Van Roy,et al.  The Linear Programming Approach to Approximate Dynamic Programming , 2003, Oper. Res..

[53]  M. K. Ghosh,et al.  Discrete-time controlled Markov processes with average cost criterion: a survey , 1993 .

[54]  A. Federgruen,et al.  Rejoinder to “Comments on one-warehouse multiple retailer systems with vehicle routing costs” , 1991 .

[55]  Meir J. Rosenblatt,et al.  Note---A Dynamic Programming Algorithm for Joint Replenishment Under General Order Cost Functions , 1985 .

[56]  P. Schweitzer,et al.  Generalized polynomial approximations in Markovian decision processes , 1985 .

[57]  John Rust Numerical dynamic programming in economics , 1996 .

[58]  Dimitris Bertsimas,et al.  Restless Bandits, Linear Programming Relaxations, and a Primal-Dual Index Heuristic , 2000, Oper. Res..