Optimistic optimization for model predictive control of max-plus linear systems

Model predictive control for max-plus linear discrete-event systems usually leads to a nonsmooth nonconvex optimization problem with real valued variables, which may be hard to solve efficiently. An alternative approach is to transform the given problem into a mixed integer linear programming problem. However, the computational complexity of current mixed integer linear programming algorithms increases in the worst case exponentially as a function of the prediction horizon. The focus of this paper is on making optimistic optimization suited to solve the given problem. Optimistic optimization is a class of algorithms that can find an approximation of the global optimum for general nonlinear optimization. A key advantage of optimistic optimization is that one can specify the computational budget in advance and guarantee bounds on the suboptimality with respect to the global optimum. We prove that optimistic optimization can be applied for the given problem by developing a dedicated semi-metric and by proving it satisfies the necessary requirements for optimistic optimization. Moreover, we show that the complexity of optimistic optimization is exponential in the control horizon instead of the prediction horizon. Hence, using optimistic optimization is more efficient when the control horizon is small and the prediction horizon is large.

[1]  Bertrand Cottenceau,et al.  Model reference control for timed event graphs in dioids , 2001, Autom..

[2]  Rémi Munos,et al.  From Bandits to Monte-Carlo Tree Search: The Optimistic Principle Applied to Optimization and Planning , 2014, Found. Trends Mach. Learn..

[3]  C. Leake Synchronization and Linearity: An Algebra for Discrete Event Systems , 1994 .

[4]  Rémi Munos,et al.  Optimistic Optimization of Deterministic Functions , 2011, NIPS 2011.

[5]  Bart De Schutter,et al.  Model predictive control for max-plus-linear discrete event systems , 2001, Autom..

[6]  Rémi Munos,et al.  Optimistic Planning of Deterministic Systems , 2008, EWRL.

[7]  Bart De Schutter,et al.  Optimistic planning with a limited number of action switches for near-optimal nonlinear control , 2014, 53rd IEEE Conference on Decision and Control.

[8]  Didier Dubois,et al.  A linear-system-theoretic view of discrete-event processes , 1983 .

[9]  Isabel Demongodin,et al.  Max-Plus Control Design for Temporal Constraints Meeting in Timed Event Graphs , 2012, IEEE Transactions on Automatic Control.

[10]  B. De Schutter,et al.  Model predictive control for max-plus-linear systems , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[11]  Lucian Busoniu,et al.  Consensus for black-box nonlinear agents using optimistic optimization , 2014, Autom..

[12]  Bertrand Cottenceau,et al.  Observer Design for $(\max, +)$ Linear Systems , 2010, IEEE Transactions on Automatic Control.

[13]  Ricardo Katz Max-Plus $(A,B)$-Invariant Spaces and Control of Timed Discrete-Event Systems , 2007, IEEE Transactions on Automatic Control.

[14]  Edward W. Kamen,et al.  Reachability and observability of linear systems over max-plus , 1999, Kybernetika.

[15]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[16]  Romain Postoyan,et al.  Near-optimal strategies for nonlinear networked control systems using optimistic planning , 2013, 2013 American Control Conference.

[17]  Jean-Louis Boimond,et al.  Control of (max, +)-linear systems minimizing delays , 2013, Discret. Event Dyn. Syst..

[18]  Rémi Munos,et al.  Stochastic Simultaneous Optimistic Optimization , 2013, ICML.

[19]  Laurent Hardouin,et al.  On the control of max-plus linear system subject to state restriction , 2011, Autom..

[20]  Bart De Schutter,et al.  Properties of MPC for Max-Plus-Linear Systems , 2002, Eur. J. Control.

[21]  Abdourrahmane M. Atto,et al.  Control of discrete event systems with respect to strict duration: Supervision of an industrial manufacturing plant , 2011, Comput. Ind. Eng..

[22]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[23]  Bertrand Cottenceau,et al.  Observer design for max-plus-linear systems , 2007 .

[24]  J. Boimond,et al.  Internal model control and max-algebra: controller design , 1996, IEEE Trans. Autom. Control..