Wiener's Polynomial Chaos for the Analysis and Control of Nonlinear Dynamical Systems with Probabilistic Uncertainties [Historical Perspectives]

One purpose of the "Historical Perspectives" column is to look back at work done by pioneers in control and related fields that has been neglected for many years but was later revived in the control literature. This column discusses the topic of Norbert Wiener's most cited paper, which proposed polynomial chaos expansions (PCEs) as a method for probabilistic uncertainty quantification in nonlinear dynamical systems. PCEs were almost completely ignored until the turn of the new millennium, when they rather suddenly attracted a huge amount of interest in the noncontrol literature. Although the control engineering community has studied uncertain systems for decades, all but a handful of researchers in the systems and control community have ignored PCEs. The purpose of this column is to present a concise introduction to PCEs, provide an overview of the theory and applications of PCE methods in the control literature, and to consider the question of why PCEs have only recently appeared in the control literature.

[1]  N. Wiener.  The Homogeneous Chaos , 1938 .

[2]  W. T. Martin,et al.  The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals , 1947 .

[3]  M. Rosenblatt.  Remarks on a Multivariate Transformation , 1952 .

[4]  Donald J. Newman,et al.  Quantitative polynomial approximation on certain planar sets , 1969 .

[5]  R.R. Mohler,et al.  Stability and robustness of multivariable feedback systems , 1981, Proceedings of the IEEE.

[6]  John C. Doyle.  Analysis of Feedback Systems with Structured Uncertainty , 1982 .

[7]  David W.T. Rippin,et al.  Simulation of single- and multiproduct batch chemical plants for optimal design and operation☆ , 1983 .

[8]  L. Devroye.  Non-Uniform Random Variate Generation , 1986 .

[9]  李幼升,et al.  Ph , 1989 .

[10]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[11]  Robert F. Stengel,et al.  A monte carlo approach to the analysis of control system robustness , 1993, Autom..

[12]  G. Zames.  Input-output feedback stability and robustness, 1959-85 , 1996 .

[13]  Pramod P. Khargonekar,et al.  Randomized algorithms for robust control analysis and synthesis have polynomial complexity , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[14]  R. Tempo,et al.  Probabilistic robustness analysis: explicit bounds for the minimum number of samples , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[15]  Mathukumalli Vidyasagar,et al.  A Theory of Learning and Generalization , 1997 .

[16]  J Figueira,et al.  Stochastic Programming , 1998, J. Oper. Res. Soc..

[17]  R. Ghanem.  Probabilistic characterization of transport in heterogeneous media , 1998 .

[18]  Kemin Zhou,et al.  Order Statistics and Probabilistic Robust Control , 1998, 0805.1569.

[19]  S. Isukapalli.  UNCERTAINTY ANALYSIS OF TRANSPORT-TRANSFORMATION MODELS , 1999 .

[20]  Giuseppe Carlo Calafiore,et al.  Randomized algorithms for probabilistic robustness with real and complex structured uncertainty , 2000, IEEE Trans. Autom. Control..

[21]  T. Başar.  Feedback and Optimal Sensitivity: Model Reference Transformations, Multiplicative Seminorms, and Approximate Inverses , 2001 .

[22]  David L. Ma,et al.  Worst-case analysis of finite-time control policies , 2001, IEEE Trans. Control. Syst. Technol..

[23]  Dongbin Xiu,et al.  The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations , 2002, SIAM J. Sci. Comput..

[24]  Z. Nagy,et al.  Robust nonlinear model predictive control of batch processes , 2003 .

[25]  R. Walters.  Stochastic Fluid Mechanics via Polynomial Chaos , 2003 .

[26]  Dominique Bonvin,et al.  Dynamic optimization of batch processes: II. Role of measurements in handling uncertainty , 2003, Comput. Chem. Eng..

[27]  Richard D. Braatz,et al.  Open-loop and closed-loop robust optimal control of batch processes using distributional and worst-case analysis , 2004 .

[28]  Joseph A. C. Delaney.  Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[29]  Dongxiao Zhang,et al.  An efficient, high-order perturbation approach for flow in random porous media via Karhunen-Loève and polynomial expansions , 2004 .

[30]  S. Finette.  A stochastic representation of environmental uncertainty and its coupling to acoustic wave propagation in ocean waveguides , 2006 .

[31]  Antonello Monti,et al.  Indirect Measurements Via Polynomial Chaos Observer , 2007, Proceedings of the 2006 IEEE International Workshop on Advanced Methods for Uncertainty Estimation in Measurement (AMUEM 2006).

[32]  Franz S. Hover,et al.  Application of polynomial chaos in stability and control , 2006, Autom..

[33]  Wuan Luo.  Wiener Chaos Expansion and Numerical Solutions of Stochastic Partial Differential Equations , 2006 .

[34]  Richard D. Braatz,et al.  DISTRIBUTIONAL UNCERTAINTY ANALYSIS OF A BATCH CRYSTALLIZATION PROCESS USING POWER SERIES AND POLYNOMIAL CHAOS EXPANSIONS , 2006 .

[35]  N. Zabaras,et al.  Uncertainty propagation in finite deformations––A spectral stochastic Lagrangian approach , 2006 .

[36]  Z. Nagy,et al.  Distributional uncertainty analysis using power series and polynomial chaos expansions , 2007 .

[37]  S. Ghanmi,et al.  Robustness of mechanical systems against uncertainties , 2007 .

[38]  James Robert Fisher,et al.  Stability analysis and control of stochastic dynamic systems using polynomial chaos , 2008 .

[39]  Franz S. Hover.  Gradient dynamic optimization with Legendre chaos , 2008, Autom..

[40]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[41]  M. Eldred,et al.  Evaluation of Non-Intrusive Approaches for Wiener-Askey Generalized Polynomial Chaos. , 2008 .

[42]  J. Fisher,et al.  Stability analysis of stochastic systems using polynomial chaos , 2008, 2008 American Control Conference.

[43]  Olivier P. Le Maître,et al.  Polynomial chaos expansion for sensitivity analysis , 2009, Reliab. Eng. Syst. Saf..

[44]  Raktim Bhattacharya,et al.  Linear quadratic regulation of systems with stochastic parameter uncertainties , 2009, Autom..

[45]  Antonello Monti,et al.  Uncertainty and Worst-Case Analysis in Electrical Measurements Using Polynomial Chaos Theory , 2009, IEEE Transactions on Instrumentation and Measurement.

[46]  Antonello Monti,et al.  Dynamic Performance of a SCARA Robot Manipulator With Uncertainty Using Polynomial Chaos Theory , 2009, IEEE Transactions on Robotics.

[47]  Dongbin Xiu,et al.  A generalized polynomial chaos based ensemble Kalman filter with high accuracy , 2009, J. Comput. Phys..

[48]  Geoffrey T. Parks,et al.  Robust Aerodynamic Design Optimization Using Polynomial Chaos , 2009 .

[49]  Omar M. Knio,et al.  Spectral Methods for Uncertainty Quantification , 2010 .

[50]  Steffen Marburg,et al.  UNCERTAINTY QUANTIFICATION IN STOCHASTIC SYSTEMS USING POLYNOMIAL CHAOS EXPANSION , 2010 .

[51]  Lyes Nechak,et al.  Uncertainty propagation using polynomial chaos and centre manifold theories , 2010 .

[52]  Sean P. Kenny,et al.  On Controlling an Uncertain System With Polynomial Chaos and H2 Control Design , 2010 .

[53]  Adrian Sandu,et al.  A Polynomial Chaos-Based Kalman Filter Approach for Parameter Estimation of Mechanical Systems , 2010 .

[54]  D. Xiu.  Numerical Methods for Stochastic Computations: A Spectral Method Approach , 2010 .

[55]  Richard D. Braatz,et al.  Modeling and Simulation of Lithium-Ion Batteries from a Systems Engineering Perspective , 2010 .

[56]  Puneet Singla,et al.  State uncertainty propagation in the presence of parametric uncertainty and additive white noise , 2010, Proceedings of the 2010 American Control Conference.

[57]  Emmanuel D. Blanchard,et al.  Polynomial chaos-based parameter estimation methods applied to a vehicle system , 2010 .

[58]  Lyes Nechak,et al.  A polynomial chaos approach to the robust analysis of the dynamic behaviour of friction systems , 2011 .

[59]  Lorenzo Fagiano,et al.  On the guaranteed accuracy of Polynomial Chaos Expansions , 2011, IEEE Conference on Decision and Control and European Control Conference.

[60]  Raktim Bhattacharya,et al.  Optimal Trajectory Generation With Probabilistic System Uncertainty Using Polynomial Chaos , 2011 .

[61]  H. Elman,et al.  DESIGN UNDER UNCERTAINTY EMPLOYING STOCHASTIC EXPANSION METHODS , 2008 .

[62]  Hosam K. Fathy,et al.  Recursive maximum likelihood parameter estimation for state space systems using polynomial chaos theory , 2011, Autom..

[63]  Richard D. Braatz,et al.  Parameter Estimation and Capacity Fade Analysis of Lithium-Ion Batteries Using Reformulated Models , 2011 .

[64]  Tiziano Ghisu,et al.  Robust design optimization of gas turbine compression systems , 2011 .

[65]  Brian Christopher Roberts,et al.  Polynomial chaos analysis of micro air vehicles in turbulence , 2012 .

[66]  Lorenzo Fagiano,et al.  Nonlinear stochastic model predictive control via regularized polynomial chaos expansions , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[67]  Richard D. Braatz,et al.  Probabilistic analysis and control of uncertain dynamic systems: Generalized polynomial chaos expansion approaches , 2012, 2012 American Control Conference (ACC).

[68]  Lyes Nechak,et al.  Wiener–Haar Expansion for the Modeling and Prediction of the Dynamic Behavior of Self-Excited Nonlinear Uncertain Systems , 2012 .

[69]  Richard D. Braatz,et al.  Generalized polynomial chaos expansion approaches to approximate stochastic receding horizon control with applications to probabilistic collision checking and avoidance , 2012, 2012 IEEE International Conference on Control Applications.

[70]  Jacques Periaux,et al.  Uncertainty based robust optimization method for drag minimization problems in aerodynamics , 2012 .

[71]  Mehdi Ahmadian,et al.  Probabilistic control using H2 control design and polynomial chaos: Experimental design, analysis, and results☆ , 2012 .

[72]  Hector Budman,et al.  A Polynomial-Chaos based Algorithm for Robust optimization in the presence of Bayesian Uncertainty , 2012 .

[73]  Lorenzo Fagiano,et al.  Simulation of stochastic systems via polynomial chaos expansions and convex optimization , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[74]  Kwang Ki Kim.  Model-based robust and stochastic control, and statistical inference for uncertain dynamical systems , 2013 .

[75]  Richard D. Braatz,et al.  Generalised polynomial chaos expansion approaches to approximate stochastic model predictive control† , 2013, Int. J. Control.

[76]  Jean-Philippe Vial,et al.  Robust Optimization , 2021, ICORES.