Effective and scalable uncertainty evaluation for large-scale complex system applications

Effective uncertainty evaluation is a critical step toward real-time and robust decision-making for complex systems in uncertain environments. A Multivariate Probabilistic Collocation Method (M-PCM) was developed to effectively evaluate system uncertainty. The method smartly chooses a limited number of simulations to produce a low-order mapping, which precisely predicts the mean output of the original system mapping up to certain degrees. While the M-PCM significantly reduces the number of simulations, it does not scale with the number of uncertain parameters, making it difficult to use for large-scale applications that typically involve a large number of uncertain parameters. In this paper, we develop a method to break the curse of dimensionality. The method integrates M-PCM and Orthogonal Fractional Factorial Designs (OFFDs) to maximally reduce the number of simulations from 22m to 2⌈log2(m+1)⌉ for a system mapping of m parameters. The integrated M-PCM-OFFD predicts the correct mean of the original system mapping, and is the most robust to numerical errors among all possible designs of the same number of simulations. The analysis also provides new insightful formal interpretations on the optimality of OFFDs.

[1]  James J. Filliben,et al.  Predicting Macroscopic Dynamics in Large Distributed Systems: Part I , 2011 .

[2]  James J. Filliben,et al.  Predicting Macroscopic Dynamics in Large Distributed Systems | NIST , 2011 .

[3]  J. Demmel.  On condition numbers and the distance to the nearest ill-posed problem , 2015 .

[4]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[5]  Yu Lei,et al.  IPOG-IPOG-D: efficient test generation for multi-way combinatorial testing , 2008 .

[6]  John A. Sokolowski,et al.  Modeling and Simulation Fundamentals: Theoretical Underpinnings and Practical Domains , 2010 .

[7]  Yi Zhou,et al.  Performance Evaluation and Optimal Decision-making for Strategic Air Traffic Management under Weather Uncertainty , 2012, Infotech@Aerospace.

[8]  S. M. Lewis,et al.  Orthogonal Fractional Factorial Designs , 1986 .

[9]  Yan Wan,et al.  Stochastic analysis of Air-Traffic System and its corresponding application in parameters prediction , 2012, 2012 American Control Conference (ACC).

[10]  Yi Zhou,et al.  A Probabilistic Collocation Method Based Approach for Optimal Strategic Air Traffic Flow Management under Weather Uncertainties , 2013 .

[11]  Sidney Addelman,et al.  trans-Dimethanolbis(1,1,1-trifluoro-5,5-dimethylhexane-2,4-dionato)zinc(II) , 2008, Acta crystallographica. Section E, Structure reports online.

[12]  Tosio Kato.  Perturbation theory for linear operators , 1966 .

[13]  C. Nachtsheim.  Orthogonal Fractional Factorial Designs , 1985 .

[14]  James J. Filliben,et al.  NIST/SEMATECH e-Handbook of Statistical Methods; Chapter 1: Exploratory Data Analysis , 2003 .

[15]  Munther A. Dahleh,et al.  Lectures on Dynamic Systems and Control , 2004 .

[16]  Robert L. Mason,et al.  Fractional factorial design , 2009 .

[17]  Robert W. Mee.  A Comprehensive Guide to Factorial Two-Level Experimentation , 2009 .

[18]  James J. Filliben,et al.  Tall Building Response Parameters: Sensitivity Study Based on Orthogonal Factorial Experiment Design Technique , 2010 .

[19]  E. Yaz.  Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[20]  J. H. Wilkinson.  The algebraic eigenvalue problem , 1966 .

[21]  K. L. Mills,et al.  PREDICTING MACROSCOPIC DYNAMICS IN LARGE DISTRIBUTED SYSTEMS , 2011 .

[22]  S. Isukapalli.  UNCERTAINTY ANALYSIS OF TRANSPORT-TRANSFORMATION MODELS , 1999 .

[23]  Ilse C. F. Ipsen,et al.  Perturbation Theory for the Solution of Systems of Linear Equations , 1991 .