Performance optimization of queueing systems with perturbation realization

[1]  Li Xia,et al.  Max-Min Optimality of Service Rate Control in Closed Queueing Networks , 2013, IEEE Transactions on Automatic Control.

[2]  Jian-Qiang Hu,et al.  Conditional Monte Carlo: Gradient Estimation and Optimization Applications , 2012 .

[3]  Quan-Lin Li.  Constructive Computation in Stochastic Models with Applications: The RG-Factorizations , 2010 .

[4]  James A. Rappold,et al.  Designing multi-echelon service parts networks with finite repair capacity , 2009, Eur. J. Oper. Res..

[5]  Xi Chen,et al.  Policy iteration for customer-average performance optimization of closed queueing systems , 2009, Autom..

[6]  Xi-Ren Cao,et al.  Continuous-time Markov decision processes with nth-bias optimality criteria , 2009, Autom..

[7]  Dimitri P. Bertsekas,et al.  Neuro-Dynamic Programming , 2009, Encyclopedia of Optimization.

[8]  Jung-Tai Chen.  Queueing models of certain manufacturing cells under product-mix sequencing rules , 2008, Eur. J. Oper. Res..

[9]  Nico Vandaele,et al.  Vehicle routing with dynamic travel times: A queueing approach , 2008, Eur. J. Oper. Res..

[10]  Xi-Ren Cao,et al.  Stochastic learning and optimization - A sensitivity-based approach , 2007, Annu. Rev. Control..

[11]  Li Xia,et al.  Aggregation of Perturbation Realization Factors and Service Rate-Based Policy Iteration for Queueing Systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[12]  Li Xia,et al.  Relationship Between Perturbation Realization Factors With Queueing Models and Markov Models , 2006, IEEE Transactions on Automatic Control.

[13]  Christos G. Cassandras,et al.  Infinitesimal Perturbation Analysis and Optimization for Make-to-Stock Manufacturing Systems Based on Stochastic Fluid Models , 2006, Discret. Event Dyn. Syst..

[14]  Xi-Ren Cao,et al.  Basic Ideas for Event-Based Optimization of Markov Systems , 2005, Discret. Event Dyn. Syst..

[15]  Christos G. Cassandras,et al.  Perturbation analysis and control of two-class stochastic fluid models for communication networks , 2003, IEEE Trans. Autom. Control..

[16]  Xi-Ren Cao,et al.  From Perturbation Analysis to Markov Decision Processes and Reinforcement Learning , 2003, Discret. Event Dyn. Syst..

[17]  Christos G. Cassandras,et al.  Perturbation analysis for online control and optimization of stochastic fluid models , 2002, IEEE Trans. Autom. Control..

[18]  C. Cassandras,et al.  Online IPA Gradient Estimators in Stochastic Continuous Fluid Models , 2002 .

[19]  Bernd Heidergott,et al.  Customer-Oriented Finite Perturbation Analysis for Queueing Networks , 2000, Discret. Event Dyn. Syst..

[20]  Xi-Ren Cao,et al.  A unified approach to Markov decision problems and performance sensitivity analysis , 2000, at - Automatisierungstechnik.

[21]  John N. Tsitsiklis,et al.  Call admission control and routing in integrated services networks using neuro-dynamic programming , 2000, IEEE Journal on Selected Areas in Communications.

[22]  Weibo Gong,et al.  Perturbation Analysis for Stochastic Fluid Queueing Systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[23]  Bernd Heidergott.  Optimisation of a single-component maintenance system: A smoothed perturbation analysis approach , 1999, Eur. J. Oper. Res..

[24]  John N. Tsitsiklis,et al.  Simulation-based optimization of Markov reward processes , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[25]  L. Sennott.  Stochastic Dynamic Programming and the Control of Queueing Systems , 1998 .

[26]  Xi-Ren Cao,et al.  Perturbation realization, potentials, and sensitivity analysis of Markov processes , 1997, IEEE Trans. Autom. Control..

[27]  Li Qiu,et al.  A single sample path-based performance sensitivity formula for Markov chains , 1996, IEEE Trans. Autom. Control..

[28]  V. Rykov,et al.  Controlled Queueing Systems , 1995 .

[29]  Dye-Jyun Ma,et al.  A direct approach to decentralized control of service rates in a closed Jackson network , 1994 .

[30]  Michael C. Fu,et al.  Smoothed perturbation analysis derivative estimation for Markov chains , 1994, Oper. Res. Lett..

[31]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[32]  Xi-Ren Cao,et al.  Realization Probabilities: The Dynamics of Queuing Systems , 1994 .

[33]  Shaler Stidham,et al.  A survey of Markov decision models for control of networks of queues , 1993, Queueing Syst. Theory Appl..

[34]  Paul Glasserman,et al.  Gradient Estimation Via Perturbation Analysis , 1990 .

[35]  P. Glasserman,et al.  Smoothed perturbation analysis for a class of discrete-event systems , 1990 .

[36]  Xi-Ren Cao,et al.  Convergence properties of infinitesimal perturbation analysis , 1988 .

[37]  David Yao,et al.  Decentralized control of service rates in a closed Jackson network , 1987, 26th IEEE Conference on Decision and Control.

[38]  Y. Ho,et al.  Smoothed (conditional) perturbation analysis of discrete event dynamical systems , 1987 .

[39]  X. Cao,et al.  Realization probability in closed Jackson queueing networks and its application , 1987, Advances in Applied Probability.

[40]  Xi-Ren Cao.  Convergence of parameter sensitivity estimates in a stochastic experiment , 1984, The 23rd IEEE Conference on Decision and Control.

[41]  L. Ljung.  Asymptotic variance expressions for identified black-box transfer function models , 1984, The 23rd IEEE Conference on Decision and Control.

[42]  Y. Ho,et al.  Perturbation analysis and optimization of queueing networks , 1982, 1982 21st IEEE Conference on Decision and Control.

[43]  Christos G. Cassandras,et al.  Infinitesimal and finite perturbation analysis for queueing networks , 1982, 1982 21st IEEE Conference on Decision and Control.

[44]  W. J. Gordon,et al.  Closed Queuing Systems with Exponential Servers , 1967, Oper. Res..