An Introduction to Event-Based Optimization: Theory and Applications

This chapter contains sections titled: Introduction Literature Review Problem Formulation Policy Iteration for EBO Example: Material Handling Problem Conclusions References

[1]  Qing-Shan Jia,et al.  On Solving Event-Based Optimization With Average Reward Over Infinite Stages , 2011, IEEE Transactions on Automatic Control.

[2]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[3]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[4]  Xiaofeng Wang,et al.  Event-Triggering in Distributed Networked Control Systems , 2011, IEEE Transactions on Automatic Control.

[5]  Dimitri P. Bertsekas,et al.  Rollout Algorithms for Stochastic Scheduling Problems , 1999, J. Heuristics.

[6]  Sridhar Mahadevan,et al.  Recent Advances in Hierarchical Reinforcement Learning , 2003, Discret. Event Dyn. Syst..

[7]  Chao-Bo Yan,et al.  Efficient Simulation Method for General Assembly Systems With Material Handling Based on Aggregated Event-Scheduling , 2010, IEEE Transactions on Automation Science and Engineering.

[8]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[9]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[10]  Cristiano Cervellera,et al.  Neural network and regression spline value function approximations for stochastic dynamic programming , 2007, Comput. Oper. Res..

[11]  K. Åström,et al.  Comparison of Riemann and Lebesgue sampling for first order stochastic systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[12]  Xi-Ren Cao,et al.  Stochastic learning and optimization - A sensitivity-based approach , 2007, Annu. Rev. Control..

[13]  Cristiano Cervellera,et al.  Efficient sampling in approximate dynamic programming algorithms , 2007, Comput. Optim. Appl..

[14]  T. Başar,et al.  Optimal Estimation with Limited Measurements , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[15]  Karl Johan Åström,et al.  Event Based Control , 2008 .

[16]  S. Marcus,et al.  Approximate receding horizon approach for Markov decision processes: average reward case , 2003 .

[17]  Xi-Ren Cao,et al.  Lebesgue-Sampling-Based Optimal Control Problems With Time Aggregation , 2011, IEEE Transactions on Automatic Control.

[18]  Li Xia,et al.  A Structure Property of Optimal Policies for Maintenance Problems WithSafety-Critical Components , 2008, IEEE Transactions on Automation Science and Engineering.

[19]  Jerzy A. Filar,et al.  Control of singularly perturbed hybrid stochastic systems , 2001, IEEE Trans. Autom. Control..

[20]  Qing-Shan Jia,et al.  On State Aggregation to Approximate Complex Value Functions in Large-Scale Markov Decision Processes , 2011, IEEE Transactions on Automatic Control.

[21]  Qing-Shan Jia.  A Structural Property of Optimal Policies for Multi-Component Maintenance Problems , 2010, IEEE Transactions on Automation Science and Engineering.

[22]  W. P. M. H. Heemels,et al.  Analysis of event-driven controllers for linear systems , 2008, Int. J. Control.

[23]  Jerzy A. Filar,et al.  A two-factor stochastic production model with two time scales , 2001, Autom..

[24]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[25]  Xi Chen,et al.  Policy iteration for customer-average performance optimization of closed queueing systems , 2009, Autom..

[26]  Xi-Ren Cao,et al.  Event-Based Optimization of Markov Systems , 2008, IEEE Transactions on Automatic Control.

[27]  Xi-Ren Cao,et al.  Basic Ideas for Event-Based Optimization of Markov Systems , 2005, Discret. Event Dyn. Syst..

[28]  Qing-Shan Jia,et al.  On Solving Optimal Policies for Finite-Stage Event-Based Optimization , 2011, IEEE Transactions on Automatic Control.

[29]  Peter B. Luh,et al.  Incremental Value Iteration for Time-Aggregated Markov-Decision Processes , 2007, IEEE Transactions on Automatic Control.

[30]  Jerzy A. Filar,et al.  Singularly perturbed Markov control problem: Limiting average cost , 1991 .

[31]  Sandra Hirche,et al.  On LQG joint optimal scheduling and control under communication constraints , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[32]  B. Krogh,et al.  State aggregation in Markov decision processes , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[33]  Zhiyuan Ren,et al.  A time aggregation approach to Markov decision processes , 2002, Autom..

[34]  Qing-Shan Jia,et al.  Strategy optimization for controlled Markov process with descriptive complexity constraint , 2009, Science in China Series F: Information Sciences.

[35]  J.P. Hespanha,et al.  A Constant Factor Approximation Algorithm for Event-Based Sampling , 2007, 2007 American Control Conference.

[36]  J.P. Hespanha,et al.  Optimal communication logics in networked control systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[37]  Wei Wu,et al.  Optimal control of stochastic systems with costly observations - the general Markovian model and the LQG problem , 2005, Proceedings of the 2005, American Control Conference, 2005..