Asymptotic Analysis of a Multiclass Queueing Control Problem Under Heavy Traffic with Model Uncertainty

We study a multiclass M/M/1 queueing control problem with finite buffers under heavy-traffic where the decision maker is uncertain about the rates of arrivals and service of the system and by scheduling and admission/rejection decisions acts to minimize a discounted cost that accounts for the uncertainty. The main result is the asymptotic optimality of a $c\mu$-type of policy derived via underlying stochastic differential games studied in [16]. Under this policy, with high probability, rejections are not performed when the workload lies below some cut-off that depends on the ambiguity level. When the workload exceeds this cut-off, rejections are carried out and only from the buffer with the cheapest rejection cost weighted with the mean service rate in some reference model. The allocation part of the policy is the same for all the ambiguity levels. This is the first work to address a heavy-traffic queueing control problem with model uncertainty.

[1]  L. F. Martins,et al.  Routing and singular control for queueing networks in heavy traffic , 1990 .

[2]  Rami Atar,et al.  A Differential Game for a Multiclass Queueing Model in the Moderate-Deviation Heavy-Traffic Regime , 2016, Math. Oper. Res..

[3]  A. Budhiraja,et al.  Existence of optimal controls for singular control problems with state constraints , 2006, math/0702418.

[4]  Pascal J. Maenhout.  Robust Portfolio Rules and Asset Pricing , 2004 .

[5]  Ramandeep S. Randhawa,et al.  Capacity Sizing Under Parameter Uncertainty: Safety Staffing Principles Revisited , 2010, Manag. Sci..

[6]  R. Bass,et al.  Review: P. Billingsley, Convergence of probability measures , 1971 .

[7]  Ruth J. Williams,et al.  Existence and Uniqueness of Semimartingale Reflecting Brownian Motions in Convex Polyhedrons , 1996 .

[8]  Paul Dupuis.  Explicit Solution to a Robust Queueing Control Problem , 2003, SIAM J. Control. Optim..

[9]  J. Michael Harrison,et al.  Brownian Models of Queueing Networks with Heterogeneous Customer Populations , 1988 .

[10]  Dimitris Bertsimas,et al.  Robust Queueing Theory , 2015, Oper. Res..

[11]  L. F. Martins,et al.  Limit theorems for pathwise average cost per unit time problems for controlled queues in heavy traffic , 1993 .

[12]  Ward Whitt,et al.  Staffing a Call Center with Uncertain Arrival Rate and Absenteeism , 2006 .

[13]  Arka P. Ghosh,et al.  Controlled stochastic networks in heavy traffic: Convergence of value functions , 2012, 1205.0925.

[14]  Rami Atar,et al.  Optimality of the generalized c\mu- rule in the moderate deviation regime , 2015 .

[15]  Ronald J. Williams,et al.  Dynamic scheduling of a system with two parallel servers in heavy traffic with resource pooling: asymptotic optimality of a threshold policy , 2001 .

[16]  Karthyek R. A. Murthy,et al.  Quantifying Distributional Model Risk Via Optimal Transport , 2016, Math. Oper. Res..

[17]  Wei You,et al.  Using Robust Queueing to Expose the Impact of Dependence in Single-Server Queues , 2017, Oper. Res..

[18]  Anup Biswas,et al.  Control of the multiclass G/G/1 queue in the moderate deviation regime. , 2012, 1205.0351.

[19]  Xiongzhi Chen.  Brownian Motion and Stochastic Calculus , 2008 .

[20]  Asaf Cohen,et al.  Asymptotically optimal control for a multiclass queueing model in the moderate deviation heavy traffic regime , 2015 .

[21]  Erica L. Plambeck,et al.  A Multiclass Queue in Heavy Traffic with Throughput Time Constraints: Asymptotically Optimal Dynamic Controls , 2001, Queueing Syst. Theory Appl..

[22]  Amarjit Budhiraja,et al.  Convergent Numerical Scheme for Singular Stochastic Control with State Constraints in a Portfolio Selection Problem , 2007, SIAM J. Control. Optim..

[23]  Peter Maurer.  Lectures On Stochastic Analysis Diffusion Theory , 2016 .

[24]  Mihai Sirbu.  A note on the strong formulation of stochastic control problems with model uncertainty , 2014 .

[25]  Ian R. Petersen,et al.  Minimax optimal control of stochastic uncertain systems with relative entropy constraints , 2000, IEEE Trans. Autom. Control..

[26]  Anup Biswas.  Risk-Sensitive Control for the Multiclass Many-Server Queues in the Moderate Deviation Regime , 2014, Math. Oper. Res..

[27]  Thomas G. Kurtz,et al.  Random Time Changes and Convergence in Distribution Under the Meyer-Zheng Conditions , 1991 .

[28]  Rami Atar,et al.  On the non-Markovian multiclass queue under risk-sensitive cost , 2016, Queueing Syst. Theory Appl..

[29]  Lars Peter Hansen,et al.  Robust control and model misspecification , 2006, J. Econ. Theory.

[30]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[31]  P. Protter.  Stochastic integration and differential equations , 1990 .

[32]  Amarjit Budhiraja,et al.  Diffusion approximations for controlled stochastic networks: An asymptotic bound for the value function , 2006 .

[33]  Asaf Cohen,et al.  Brownian Control Problems for a Multiclass M/M/1 Queueing Problem with Model Uncertainty , 2017, Math. Oper. Res..

[34]  Erhan Bayraktar,et al.  Minimizing the Probability of Lifetime Ruin Under Ambiguity Aversion , 2015, SIAM J. Control. Optim..

[35]  Andrew E. B. Lim,et al.  On the optimality of threshold control in queues with model uncertainty , 2010, Queueing Syst. Theory Appl..

[36]  M. Manhart,et al.  Markov Processes , 2018, Introduction to Stochastic Processes and Simulation.

[37]  Eyer,et al.  Tightness criteria for laws of semimartingales , 2018 .

[38]  Henry Lam,et al.  Robust rare-event performance analysis with natural non-convex constraints , 2014, Proceedings of the Winter Simulation Conference 2014.

[39]  L. F. Martins,et al.  Numerical Methods for Stochastic Singular Control Problems , 1991 .

[40]  Henry Lam,et al.  Robust Sensitivity Analysis for Stochastic Systems , 2013, Math. Oper. Res..

[41]  P. Meyer,et al.  Probabilities and potential C , 1978 .

[42]  S. Shreve,et al.  An explicit formula for the Skorokhod map on [0,a]. , 2007, 0710.2977.

[43]  Asaf Cohen.  Stochastic differential games for a multiclass M/M/1 queueing problem with model uncertainty , 2017 .

[44]  Kellen Petersen August.  Real Analysis , 2009 .