Ensemble Control of Stochastic Linear Systems

In this paper, we consider the problem of steering a family of independent, structurally identical, finite-dimensional stochastic linear systems with variation in system parameters between initial and target states of interest by using an open-loop control function. Our exploration of this class of control problems, which falls under the rising subject of ensemble control, is motivated by pulse design problems in quantum control. Here we extend the concept of ensemble control to stochastic systems with additive diffusion and jump processes, which we model using Brownian motion and Poisson counters, respectively, and consider optimal steering problems. We derive a Fredholm integral equation that is used to solve for the optimal control, which minimizes both the mean square error (MSE) and the error in the mean of the terminal state. In addition, we present several example control problems for which optimal solutions are computed by numerically approximating the singular system of the associated Fredholm operator. We use Monte Carlo simulations to illustrate the performance of the resulting controls. Our work has immediate practical applications to the control of dynamical systems with additive noise and parameter dispersion, and also makes an important contribution to stochastic control theory.

[1]  N. Khaneja,et al.  Control of inhomogeneous quantum ensembles , 2006 .

[2]  Anatoly Zlotnik,et al.  Synthesis of optimal ensemble controls for linear systems using the singular value decomposition , 2011, 2012 American Control Conference (ACC).

[3]  Jr-Shin Li,et al.  Optimal pulse design in quantum control: A unified computational method , 2011, Proceedings of the National Academy of Sciences.

[4]  B. Sanders,et al.  Quantum encodings in spin systems and harmonic oscillators , 2001, quant-ph/0109066.

[5]  Jr-Shin Li,et al.  Ensemble Control of Finite-Dimensional Time-Varying Linear Systems , 2008, IEEE Transactions on Automatic Control.

[6]  Israel Gohberg,et al.  Basic Classes of Linear Operators , 2004 .

[7]  Jr-Shin Li,et al.  Minimum-Time Quantum Transport With Bounded Trap Velocity , 2011, IEEE Transactions on Automatic Control.

[8]  J. Pauly,et al.  Parameter relations for the Shinnar-Le Roux selective excitation pulse design algorithm [NMR imaging]. , 1991, IEEE transactions on medical imaging.

[9]  Eric Shea-Brown,et al.  On the Phase Reduction and Response Dynamics of Neural Oscillator Populations , 2004, Neural Computation.

[10]  Burkhard Luy,et al.  Pattern pulses: design of arbitrary excitation profiles as a function of pulse amplitude and offset. , 2005, Journal of magnetic resonance.

[11]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[12]  Jr-Shin Li,et al.  Control of a Network of Spiking Neurons , 2010 .

[13]  Jr-Shin Li Control of Inhomogeneous Ensembles , 2006 .

[14]  Lihua Xie,et al.  H/sub infinity / control and quadratic stabilization of systems with parameter uncertainty via output feedback , 1992 .

[15]  I. Michael Ross,et al.  Legendre Pseudospectral Approximations of Optimal Control Problems , 2003 .

[16]  Jr-Shin Li,et al.  Optimal Asymptotic Entrainment of Phase-Reduced Oscillators , 2011, ArXiv.

[17]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[18]  Jr-Shin Li,et al.  Ensemble Control of Bloch Equations , 2009, IEEE Transactions on Automatic Control.

[19]  Mazyar Mirrahimi,et al.  Controllability of quantum harmonic oscillators , 2004, IEEE Transactions on Automatic Control.

[20]  Justin Ruths,et al.  A multidimensional pseudospectral method for optimal control of quantum ensembles. , 2011, The Journal of chemical physics.

[21]  M. Sain Finite dimensional linear systems , 1972 .