State Observation and Sensor Selection for Nonlinear Networks

A large variety of dynamical systems, such as chemical and biomolecular systems, can be seen as networks of nonlinear entities. Prediction, control, and identification of such nonlinear networks require knowledge of the state of the system. However, network states are usually unknown, and only a fraction of the state variables are directly measurable. The observability problem concerns reconstructing the network state from this limited information. Here, we propose a general optimization-based approach for observing the states of nonlinear networks and for optimally selecting the observed variables. Our results reveal several fundamental limitations in network observability, such as the tradeoff between the fraction of observed variables and the observation length on one side, and the estimation error on the other side. We also show that, owing to the crucial role played by the dynamics, purely graph-theoretic observability approaches cannot provide conclusions about one's practical ability to estimate the states. We demonstrate the effectiveness of our methods by finding the key components in biological and combustion reaction networks from which we determine the full system state. Our results can lead to the design of novel sensing principles that can greatly advance prediction and control of the dynamics of such networks.

[1]  Robert Babuska,et al.  Parametric Bayesian Filters for Nonlinear Stochastic Dynamical Systems: A Survey , 2013, IEEE Transactions on Cybernetics.

[2]  Nahum Shimkin,et al.  Nonlinear Control Systems , 2008 .

[3]  P. Olver Nonlinear Systems , 2013 .

[4]  Harry K. Moffat,et al.  Cantera: An Object-oriented Software Toolkit for Chemical Kinetics, Thermodynamics, and Transport Processes. Version 2.2.1 , 2016 .

[5]  Jorge J. Moré,et al.  Computing a Trust Region Step , 1983 .

[6]  Steffen Klamt,et al.  Transforming Boolean models to continuous models: methodology and application to T-cell receptor signaling , 2009, BMC Systems Biology.

[7]  Aleksandar Haber,et al.  Subspace Identification of Large-Scale Interconnected Systems , 2013, IEEE Transactions on Automatic Control.

[8]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[9]  G. Akrivis A First Course In The Numerical Analysis Of Differential Equations [Book News & Reviews] , 1998, IEEE Computational Science and Engineering.

[10]  S. P. Cornelius,et al.  Realistic control of network dynamics , 2013, Nature Communications.

[11]  S. Turns An Introduction to Combustion: Concepts and Applications , 2000 .

[12]  Albert-László Barabási,et al.  Observability of complex systems , 2013, Proceedings of the National Academy of Sciences.

[13]  Mark Kostuk,et al.  Dynamical State and Parameter Estimation , 2009, SIAM J. Appl. Dyn. Syst..

[14]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[15]  Giorgio Battistelli,et al.  Moving-horizon state estimation for nonlinear discrete-time systems: New stability results and approximation schemes , 2008, Autom..

[16]  Shigeru Hanba,et al.  On the “Uniform” Observability of Discrete-Time Nonlinear Systems , 2009, IEEE Transactions on Automatic Control.

[17]  R. Albert,et al.  Network model of survival signaling in large granular lymphocyte leukemia , 2008, Proceedings of the National Academy of Sciences.

[18]  Robert Babuska,et al.  Saturated Particle Filter: Almost sure convergence and improved resampling , 2013, Autom..

[19]  Adilson E Motter,et al.  Control of Stochastic and Induced Switching in Biophysical Networks. , 2015, Physical review. X.

[20]  Thomas F. Coleman,et al.  A Preconditioned Conjugate Gradient Approach to Linear Equality Constrained Minimization , 2001, Comput. Optim. Appl..

[21]  Réka Albert,et al.  Cell Fate Reprogramming by Control of Intracellular Network Dynamics , 2014, PLoS Comput. Biol..

[22]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[23]  J. Slotine,et al.  Spectrum of controlling and observing complex networks , 2015, Nature Physics.

[24]  Marko Bacic,et al.  Model predictive control , 2003 .

[25]  Jonathan Currie,et al.  Opti: Lowering the Barrier Between Open Source Optimizers and the Industrial MATLAB User , 2012 .

[26]  John Lygeros,et al.  On Submodularity and Controllability in Complex Dynamical Networks , 2014, IEEE Transactions on Control of Network Systems.

[27]  Sean N. Brennan,et al.  Observability and Controllability of Nonlinear Networks: The Role of Symmetry , 2013, Physical review. X.

[28]  Sébastien Le Digabel,et al.  Algorithm xxx : NOMAD : Nonlinear Optimization with the MADS algorithm , 2010 .

[29]  James B. Rawlings,et al.  Particle filtering and moving horizon estimation , 2006, Comput. Chem. Eng..

[30]  Juergen Hahn,et al.  Determining Optimal Sensor Locations for State and Parameter Estimation for Stable Nonlinear Systems , 2005 .

[31]  Arthur J. Krener,et al.  Measures of unobservability , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[32]  J. Marsden,et al.  A subspace approach to balanced truncation for model reduction of nonlinear control systems , 2002 .

[33]  Marc Timme,et al.  Revealing network connectivity from response dynamics. , 2006, Physical review letters.

[34]  V. Verdult,et al.  Filtering and System Identification: A Least Squares Approach , 2007 .

[35]  J. Grizzle,et al.  Observer design for nonlinear systems with discrete-time measurements , 1995, IEEE Trans. Autom. Control..

[36]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[37]  Fu Lin,et al.  Design of Optimal Sparse Feedback Gains via the Alternating Direction Method of Multipliers , 2011, IEEE Transactions on Automatic Control.

[38]  Xin Liu,et al.  Dynamical and Structural Analysis of a T Cell Survival Network Identifies Novel Candidate Therapeutic Targets for Large Granular Lymphocyte Leukemia , 2011, PLoS Comput. Biol..

[39]  Nickolay Smirnov,et al.  Modeling and simulation of hydrogen combustion in engines , 2014 .

[40]  D. Goodwin,et al.  Cantera: An Object-oriented Software Toolkit for Chemical Kinetics, Thermodynamics, and Transport Processes. Version 2.2.0 , 2015 .

[41]  Kai Sun,et al.  Optimal PMU placement for power system dynamic state estimation by using empirical observability Gramian , 2015, 2015 IEEE Power & Energy Society General Meeting.

[42]  B. Fiedler,et al.  Dynamics and Control at Feedback Vertex Sets. I: Informative and Determining Nodes in Regulatory Networks , 2013, Journal of Dynamics and Differential Equations.

[43]  Stelios Couris,et al.  Combustion Diagnostics with Femtosecond Laser Radiation , 2014 .

[44]  Rolf D. Reitz,et al.  An Analytical Jacobian Approach to Sparse Reaction Kinetics for Computationally Efficient Combustion Modeling with Large Reaction Mechanisms , 2012 .

[45]  Danny C. Sorensen,et al.  Minimization of a Large-Scale Quadratic FunctionSubject to a Spherical Constraint , 1997, SIAM J. Optim..

[46]  Denis Thieffry,et al.  Mathematical Modelling of Cell-Fate Decision in Response to Death Receptor Engagement , 2010, PLoS Comput. Biol..

[47]  Sirish L. Shah,et al.  Nonlinear Bayesian state estimation: A review of recent developments , 2012 .

[48]  C. Westbrook,et al.  A comprehensive modeling study of hydrogen oxidation , 2004 .

[49]  Richard H. Byrd,et al.  Approximate solution of the trust region problem by minimization over two-dimensional subspaces , 1988, Math. Program..

[50]  Hong-Bo Sun,et al.  Sensing combustion intermediates by femtosecond filament excitation. , 2013, Optics letters.

[51]  Ulrich Maas,et al.  Simplifying chemical kinetics: Intrinsic low-dimensional manifolds in composition space , 1992 .

[52]  Biao Huang,et al.  System Identification , 2000, Control Theory for Physicists.

[53]  B. Fiedler,et al.  Dynamics and control at feedback vertex sets. II: a faithful monitor to determine the diversity of molecular activities in regulatory networks. , 2013, Journal of theoretical biology.

[54]  Nathan D. Powel,et al.  Empirical observability Gramian rank condition for weak observability of nonlinear systems with control , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).