Model Boundary Approximation Method as a Unifying Framework for Balanced Truncation and Singular Perturbation Approximation

We show that two widely accepted model reduction techniques, balanced truncation (BT) and balanced singular perturbation approximation (BSPA), can be derived as limiting approximations of a carefully constructed parameterization of linear time invariant systems by employing the model boundary approximation method (MBAM) [1]. We also show that MBAM provides a novel way to interpolate between BT and BSPA, by exploring the set of approximations on the boundary of the “model manifold,” which is associated with the specific choice of model parameterization and initial condition and is embedded in a sample space of measured outputs, between the elements that correspond to the two model reduction techniques. This paper suggests similar types of approximations may be obtainable in topologically similar places (i.e., on certain boundaries) on the associated model manifold of nonlinear systems if analogous parameterizations can be achieved, therefore extending these widely accepted model reduction techniques to nonlinear systems.1

[1]  J. Marsden,et al.  A subspace approach to balanced truncation for model reduction of nonlinear control systems , 2002 .

[2]  J. Hopfield,et al.  From molecular to modular cell biology , 1999, Nature.

[3]  L. Silverman,et al.  Model reduction via balanced state space representations , 1982 .

[4]  Nahum Shimkin,et al.  Persistency excitation in continuous-time systems , 1987 .

[5]  Dario Vretenar,et al.  "Sloppy" nuclear energy density functionals: Effective model reduction , 2016, 1606.08617.

[6]  Fernando Paganini,et al.  A Course in Robust Control Theory , 2000 .

[7]  D. Enns Model reduction with balanced realizations: An error bound and a frequency weighted generalization , 1984, The 23rd IEEE Conference on Decision and Control.

[8]  Anders Rantzer,et al.  Model comparison and simplification , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[9]  Quanyan Zhu,et al.  Game-Theoretic Methods for Robustness, Security, and Resilience of Cyberphysical Control Systems: Games-in-Games Principle for Optimal Cross-Layer Resilient Control Systems , 2015, IEEE Control Systems.

[10]  M. Batty Generative social science: Studies in agent-based computational modeling , 2008 .

[11]  Mark K. Transtrum,et al.  Manifold boundaries give "gray-box" approximations of complex models , 2016 .

[12]  Sean C. Warnick,et al.  Vulnerability analysis for distributed and coordinated destabilization attacks , 2014, 53rd IEEE Conference on Decision and Control.

[13]  H. Broer,et al.  Analysis of a slow–fast system near a cusp singularity , 2015, 1506.08679.

[14]  David Ward,et al.  Vulnerable links and secure architectures in the stabilization of networks of controlled dynamical systems , 2012, 2012 American Control Conference (ACC).

[15]  Karl Henrik Johansson,et al.  Secure Control Systems: A Quantitative Risk Management Approach , 2015, IEEE Control Systems.

[16]  Daniel Zappala,et al.  A case study of a systematic attack design method for critical infrastructure cyber-physical systems , 2016, 2016 American Control Conference (ACC).

[17]  Antoine M. van Oijen,et al.  Ever-fluctuating single enzyme molecules: Michaelis-Menten equation revisited , 2006, Nature chemical biology.

[18]  Sanjay Lall,et al.  Model reduction of complex systems in the linear-fractional framework , 1999, Proceedings of the 1999 IEEE International Symposium on Computer Aided Control System Design (Cat. No.99TH8404).

[19]  Martin Bücker,et al.  Automatic differentiation : applications, theory, and implementations , 2006 .

[20]  R. Albert,et al.  The large-scale organization of metabolic networks , 2000, Nature.

[21]  I. Takeuchi,et al.  First principles thermodynamical modeling of the binodal and spinodal curves in lead chalcogenides. , 2015, Physical chemistry chemical physics : PCCP.

[22]  K. Fernando,et al.  Singular perturbational model reduction in the frequency domain , 1982 .

[23]  Kemin Zhou,et al.  Structurally balanced controller order reduction with guaranteed closed loop performance , 1995 .

[24]  B. Anderson,et al.  Model reduction for control system design , 1984 .

[25]  Andrei Z. Broder,et al.  Graph structure in the Web , 2000, Comput. Networks.

[26]  Karen Willcox,et al.  A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems , 2015, SIAM Rev..

[27]  Athanasios C. Antoulas,et al.  Approximation of Large-Scale Dynamical Systems , 2005, Advances in Design and Control.

[28]  Mark K. Transtrum,et al.  Measurement-Directed Reduction of Dynamic Models in Power Systems , 2017, IEEE Transactions on Power Systems.

[29]  Hassan K. Khalil,et al.  Singular perturbation methods in control : analysis and design , 1986 .

[30]  K. Glover All optimal Hankel-norm approximations of linear multivariable systems and their L, ∞ -error bounds† , 1984 .

[31]  J. M. A. Scherpen,et al.  Balancing for nonlinear systems , 1993 .

[32]  Li Li,et al.  Structured coprime factor model reduction based on LMIs , 2005, Autom..

[33]  Mark K. Transtrum,et al.  Information topology identifies emergent model classes , 2014 .

[34]  K. Fernando,et al.  Singular perturbational model reduction of balanced systems , 1982 .

[35]  Peng Qiu,et al.  Bridging Mechanistic and Phenomenological Models of Complex Biological Systems , 2015, PLoS Comput. Biol..

[36]  Birgit Dietrich,et al.  Model Reduction For Control System Design , 2016 .

[37]  R. Bellman,et al.  On structural identifiability , 1970 .

[38]  Carolyn L. Beck,et al.  Model reduction of multidimensional and uncertain systems , 1994, IEEE Trans. Autom. Control..

[39]  Fuzhen Zhang The Schur complement and its applications , 2005 .

[40]  Louis B. Rall,et al.  Automatic Differentiation: Techniques and Applications , 1981, Lecture Notes in Computer Science.

[41]  Carolyn L. Beck Coprime factors reduction methods for linear parameter varying and uncertain systems , 2006, Syst. Control. Lett..

[42]  Mark K Transtrum,et al.  Why are nonlinear fits to data so challenging? , 2009, Physical review letters.

[43]  M. Spivak A comprehensive introduction to differential geometry , 1979 .

[44]  B. Moore Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[45]  M. Jackson,et al.  A Strategic Model of Social and Economic Networks , 1996 .

[46]  Mark K. Transtrum,et al.  Information Geometry Approach to Verification of Dynamic Models in Power Systems , 2018, IEEE Transactions on Power Systems.

[47]  Bryan C. Daniels,et al.  Perspective: Sloppiness and emergent theories in physics, biology, and beyond. , 2015, The Journal of chemical physics.

[48]  Sean C. Warnick,et al.  A unified view of Balanced Truncation and Singular Perturbation Approximations , 2015, 2015 American Control Conference (ACC).

[49]  Robert R. Bitmead,et al.  Persistence of excitation conditions and the convergence of adaptive schemes , 1984, IEEE Trans. Inf. Theory.

[50]  Tosio Kato Perturbation theory for linear operators , 1966 .

[51]  Mark A. Kramer,et al.  The simultaneous solution and sensitivity analysis of systems described by ordinary differential equations , 1988, TOMS.

[52]  Paul Van Dooren,et al.  Model Reduction of Interconnected Systems , 2008 .

[53]  Mark K Transtrum,et al.  Geometry of nonlinear least squares with applications to sloppy models and optimization. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  Rodolphe Sepulchre,et al.  Modeling the Modulation of Neuronal Bursting: A Singularity Theory Approach , 2014, SIAM J. Appl. Dyn. Syst..

[55]  Gaurav Venkataraman,et al.  Identifiability, reducibility, and adaptability in allosteric macromolecules , 2017, The Journal of general physiology.

[56]  Mark K Transtrum,et al.  Model reduction by manifold boundaries. , 2014, Physical review letters.

[57]  S. Strogatz Exploring complex networks , 2001, Nature.

[58]  B. Anderson,et al.  Singular perturbation approximation of balanced systems , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[59]  S. Shankar Sastry,et al.  Game-Theoretic Models of Electricity Theft Detection in Smart Utility Networks: Providing New Capabilities with Advanced Metering Infrastructure , 2015, IEEE Control Systems.

[60]  Sean C. Warnick,et al.  Meanings and Applications of Structure in Networks of Dynamic Systems , 2014, Principles of Cyber-Physical Systems.

[61]  K. Fernando,et al.  Singular perturbational approximations for discrete-time balanced systems , 1983 .

[62]  John B. Moore,et al.  Persistence of excitation in extended least squares , 1983 .

[63]  U. Bhalla,et al.  Emergent properties of networks of biological signaling pathways. , 1999, Science.

[64]  Petar V. Kokotovic,et al.  Singular perturbations and order reduction in control theory - An overview , 1975, Autom..

[65]  E. Gilbert Controllability and Observability in Multivariable Control Systems , 1963 .

[66]  Paré,et al.  Necessary and Sufficient Conditions for State-Space Network Realization , 2014 .

[67]  Jacquelien M. A. Scherpen,et al.  Stabilization of slow-fast systems at fold points , 2017, ArXiv.

[68]  Tohru Katayama,et al.  Subspace Methods for System Identification , 2005 .

[69]  Chin S. Hsu,et al.  Decomposition of Large Scale Systems - A Numerical Approach , 1983, 1983 American Control Conference.

[70]  R. M. Murray,et al.  Model reduction of interconnected linear systems , 2009 .

[71]  J. Scherpen H∞ Balancing for Nonlinear Systems , 1996 .

[72]  G. Briggs,et al.  A Note on the Kinetics of Enzyme Action. , 1925, The Biochemical journal.

[73]  Ann Cox,et al.  A science of system security , 2014, 53rd IEEE Conference on Decision and Control.