Perturbation analysis: A framework for data-driven control and optimization of discrete event and hybrid systems

[1]  Xi-Ren Cao,et al.  Relative Time and Stochastic Control With Non-Smooth Features , 2017, IEEE Transactions on Automatic Control.

[2]  B. Heidergott,et al.  A Critical Account of Perturbation Analysis of Markov Chains , 2016, 1609.04138.

[3]  Sudhakar Yalamanchili,et al.  IPA in the loop: Control design for throughput regulation in computer processors , 2016, 2016 13th International Workshop on Discrete Event Systems (WODES).

[4]  Christos G. Cassandras,et al.  Optimal event-driven multi-agent persistent monitoring of a finite set of targets , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[5]  Sudhakar Yalamanchili,et al.  Performance Regulation of Event-Driven Dynamical Systems Using Infinitesimal Perturbation Analysis , 2016, 1601.03799.

[6]  Marek Miskowicz,et al.  Event-Based Control and Signal Processing , 2015 .

[7]  Xi-Ren Cao,et al.  Optimization of Average Rewards of Time Nonhomogeneous Markov Chains , 2015, IEEE Transactions on Automatic Control.

[8]  Xi-Ren Cao,et al.  A tutorial on event-based optimization—a new optimization framework , 2014, Discret. Event Dyn. Syst..

[9]  C. Cassandras.  The event-driven paradigm for control, communication and optimization , 2014, J. Control. Decis..

[10]  Martin G. Dixon,et al.  Haswell: The Fourth-Generation Intel Core Processor , 2014, IEEE Micro.

[11]  Li Xia,et al.  A tutorial on event-based optimization—a new optimization framework , 2013, Discrete Event Dynamic Systems.

[12]  Xi-Ren Cao,et al.  SENSITIVITY ANALYSIS OF NONLINEAR BEHAVIOR WITH DISTORTED PROBABILITY , 2013 .

[13]  H. Caswell.  Sensitivity analysis of discrete Markov chains via matrix calculus , 2013 .

[14]  Jian-Qiang Hu,et al.  Conditional Monte Carlo: Gradient Estimation and Optimization Applications , 2012 .

[15]  Christos G. Cassandras,et al.  Asynchronous Distributed Optimization With Event-Driven Communication , 2010, IEEE Transactions on Automatic Control.

[16]  Xi-Ren Cao,et al.  Stochastic learning and optimization - A sensitivity-based approach , 2007, Annu. Rev. Control..

[17]  Xi-Ren Cao,et al.  A basic formula for online policy gradient algorithms , 2005, IEEE Transactions on Automatic Control.

[18]  Christos G. Cassandras,et al.  Perturbation Analysis of Multiclass Stochastic Fluid Models , 2004, Discret. Event Dyn. Syst..

[19]  Christos G. Cassandras,et al.  Perturbation analysis for online control and optimization of stochastic fluid models , 2002, IEEE Trans. Autom. Control..

[20]  Christos G. Cassandras,et al.  An improved Forward Algorithm for optimal control of a class of hybrid systems , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[21]  Peter L. Bartlett,et al.  Experiments with Infinite-Horizon, Policy-Gradient Estimation , 2001, J. Artif. Intell. Res..

[22]  Peter L. Bartlett,et al.  Infinite-Horizon Policy-Gradient Estimation , 2001, J. Artif. Intell. Res..

[23]  Bernd Heidergott,et al.  Customer-Oriented Finite Perturbation Analysis for Queueing Networks , 2000, Discret. Event Dyn. Syst..

[24]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[25]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems , 1999, The Kluwer International Series on Discrete Event Dynamic Systems.

[26]  John N. Tsitsiklis,et al.  Simulation-based optimization of Markov reward processes , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[27]  Jason H. Goodfriend,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1995 .

[28]  Edwin K. P. Chong,et al.  Discrete event systems: Modeling and performance analysis , 1994, Discret. Event Dyn. Syst..

[29]  C. O'Cinneide.  Entrywise perturbation theory and error analysis for Markov chains , 1993 .

[30]  Xiaolan Xie,et al.  Marking Optimization of Stochastic Timed Event Graphs , 1993, Application and Theory of Petri Nets.

[31]  Paul Glasserman,et al.  Gradient Estimation Via Perturbation Analysis , 1990 .

[32]  Alan Weiss,et al.  Sensitivity Analysis for Simulations via Likelihood Ratios , 1989, Oper. Res..

[33]  Christos G. Cassandras,et al.  Distributed routing with on-line marginal delay estimation , 1988, IEEE INFOCOM '88,Seventh Annual Joint Conference of the IEEE Computer and Communcations Societies. Networks: Evolution or Revolution?.

[34]  Xi-Ren Cao,et al.  A Sample Performance Function of Closed Jackson Queueing Networks , 1988, Oper. Res..

[35]  Y. Ho,et al.  Smoothed (conditional) perturbation analysis of discrete event dynamical systems , 1987 .

[36]  Xi-Ren Cao.  Sensitivity estimates based on one realization of a stochastic system , 1987 .

[37]  C. Cassandras,et al.  An event domain formalism for sample path perturbation analysis of discrete event dynamic systems , 1985 .

[38]  Xi-Ren Cao.  Convergence of parameter sensitivity estimates in a stochastic experiment , 1984, The 23rd IEEE Conference on Decision and Control.

[39]  Christos G. Cassandras,et al.  A new approach to the analysis of discrete event dynamic systems , 1983, Autom..

[40]  Christos G. Cassandras,et al.  Infinitesimal and finite perturbation analysis for queueing networks , 1982, 1982 21st IEEE Conference on Decision and Control.

[41]  Y. Ho,et al.  Perturbation analysis and optimization of queueing networks , 1982, 1982 21st IEEE Conference on Decision and Control.

[42]  Yu-chi Ho,et al.  A gradient technique for general buffer storage design in a production line , 1979, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[43]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[44]  P. Schweitzer.  Perturbation theory and finite Markov chains , 1968, Journal of Applied Probability.

[45]  C. Cassandras,et al.  An optimal control approach to the multi-agent persistent monitoring problem , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[46]  Christos G. Cassandras,et al.  Perturbation Analysis and Optimization of Stochastic Hybrid Systems , 2010, Eur. J. Control.

[47]  L. Jeff Hong,et al.  Estimating Quantile Sensitivities , 2009, Oper. Res..

[48]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems, Second Edition , 2008 .

[49]  Xi-Ren Cao,et al.  Realization Probabilities: The Dynamics of Queuing Systems , 1994 .

[50]  Ivan Herman,et al.  Manifold , 1994, Future Gener. Comput. Syst..

[51]  Jana Kosecka,et al.  Control of Discrete Event Systems , 1992 .

[52]  Xi-Ren Cao,et al.  Perturbation analysis of discrete event dynamic systems , 1991 .

[53]  R. Suri,et al.  Perturbation analysis gives strongly consistent sensitivity estimates for the M/G/ 1 queue , 1988 .

[54]  Walter Rudin,et al.  Real & Complex Analysis , 1987 .