Workload reduction of a generalized Brownian network

We consider a dynamic control problem associated with a generalized Brownian network, the objective being to minimize expected discounted cost over an infinite planning horizon. In this Brownian control problem (BCP), both the system manager's control and the associated cumulative cost process may be locally of unbounded variation. Due to this aspect of the cost process, both the precise statement of the problem and its analysis involve delicate technical issues. We show that the BCP is equivalent, in a certain sense, to a reduced Brownian control problem (RBCP) of lower dimension. The RBCP is a singular stochastic control problem, in which both the controls and the cumulative cost process are locally of bounded variation.

[1]  A. Banerjee.  Convex Analysis and Optimization , 2006 .

[2]  Maury Bramson,et al.  Two Workload Properties for Brownian Networks , 2003, Queueing Syst. Theory Appl..

[3]  J. Harrison.  A broader view of Brownian networks , 2003 .

[4]  Dimitri P. Bertsekas,et al.  Convex Analysis and Optimization , 2003 .

[5]  J. Michael Harrison,et al.  Stochastic Networks and Activity Analysis , 2002 .

[6]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[7]  J. Harrison.  Correction: Brownian models of open processing networks: canonical representation of workload , 2000, math/0610352.

[8]  H. Kushner.  Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[9]  Ruth J. Williams,et al.  Diffusion approximations for open multiclass queueing networks: sufficient conditions involving state space collapse , 1998, Queueing Syst. Theory Appl..

[10]  Jan A. Van Mieghem,et al.  Dynamic Control of Brownian Networks: State Space Collapse and Equivalent Workload Formulations , 1997 .

[11]  R. J. Williams,et al.  Existence and uniqueness of semimartingale reflecting Brownian motions in an orthant , 1993 .

[12]  S. Schaible,et al.  4. Application of Generalized Concavity to Economics , 1988 .

[13]  J. Michael Harrison,et al.  Brownian Models of Queueing Networks with Heterogeneous Customer Populations , 1988 .

[14]  M. Fiedler.  Special matrices and their applications in numerical mathematics , 1986 .

[15]  J. Michael Harrison,et al.  Instantaneous Control of Brownian Motion , 1983, Math. Oper. Res..

[16]  Volker Böhm.  On the continuity of the optimal policy set for linear programs , 1975 .

[17]  G. Dantzig,et al.  On the continuity of the minimum set of a continuous function , 1967 .

[18]  T. M. M.,et al.  The Theory of Functions of Real Variables , 1947, Nature.

[19]  Drinsmann Homogenizers,et al.  with A , 1865, Geological Magazine.