On Uncertainty Quantification for Systems of Computer Models

On Uncertainty Quantification for Systems of Computer Models by Ksenia N. Kyzyurova Department of Statistical Science Duke University Date: Approved: James O. Berger, Co-advisor Robert L. Wolpert, Co-advisor

[1]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[2]  Shelie A. Miller,et al.  Improving rural electricity system planning: An agent-based model for stakeholder engagement and decision making , 2017 .

[3]  James O. Berger,et al.  A Framework for Validation of Computer Models , 2007, Technometrics.

[4]  James O. Berger,et al.  Parallel partial Gaussian process emulation for computer models with massive output , 2016 .

[5]  James O. Berger,et al.  Using Statistical and Computer Models to Quantify Volcanic Hazards , 2009, Technometrics.

[6]  Barry L. Nelson,et al.  Shapley Effects for Global Sensitivity Analysis: Theory and Computation , 2016, SIAM/ASA J. Uncertain. Quantification.

[7]  Curtis B. Storlie,et al.  Hierarchical calibration and validation of computational fluid dynamics models for solid sorbent-based carbon capture , 2016 .

[8]  Rui Tuo,et al.  A Theoretical Framework for Calibration in Computer Models: Parametrization, Estimation and Convergence Properties , 2015, SIAM/ASA J. Uncertain. Quantification.

[9]  Jason L. Loeppky,et al.  Analysis Methods for Computer Experiments: How to Assess and What Counts? , 2016 .

[10]  David Makowski,et al.  Bayesian calibration of the nitrous oxide emission module of an agro-ecosystem model , 2009 .

[11]  Jeremy E. Oakley,et al.  Calibration of Stochastic Computer Simulators Using Likelihood Emulation , 2017, Technometrics.

[12]  W. J. Studden,et al.  Design and analysis of computer experiments when the output is highly correlated over the input space , 2002 .

[13]  D. Higdon,et al.  Computer Model Calibration Using High-Dimensional Output , 2008 .

[14]  C. F. Wu,et al.  Efficient Calibration for Imperfect Computer Models , 2015, 1507.07280.

[15]  Yongxiang Li,et al.  Pairwise Meta-Modeling of Multivariate Output Computer Models Using Nonseparable Covariance Function , 2016, Technometrics.

[16]  Ian Vernon,et al.  Galaxy formation : a Bayesian uncertainty analysis. , 2010 .

[17]  J. Oakley.  Eliciting Gaussian process priors for complex computer codes , 2002 .

[18]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Puneet Singla,et al.  Estimation and propagation of volcanic source parameter uncertainty in an ash transport and dispersal model: application to the Eyjafjallajokull plume of 14–16 April 2010 , 2012, Bulletin of Volcanology.

[20]  Sez Atamturktur,et al.  Nonparametric Functional Calibration of Computer Models , 2016, 1602.06202.

[21]  M. J. Bayarri,et al.  Computer model validation with functional output , 2007, 0711.3271.

[22]  Tony Pourmohamad,et al.  Multivariate Stochastic Process Models for Correlated Responses of Mixed Type , 2016 .

[23]  Caio L. N. Azevedo,et al.  Estimation methods for multivariate Tobit confirmatory factor analysis , 2014, Comput. Stat. Data Anal..

[24]  M. Genton,et al.  Short‐Term Wind Speed Forecasting for Power System Operations , 2012 .

[25]  T. Auton.  Applied Functional Data Analysis: Methods and Case Studies , 2004 .

[26]  J. Berger,et al.  Objective Bayesian Analysis of Spatially Correlated Data , 2001 .

[27]  Paul W. Goldberg,et al.  Regression with Input-dependent Noise: A Gaussian Process Treatment , 1997, NIPS.

[28]  T. Santner,et al.  Hip resurfacing increases bone strains associated with short‐term femoral neck fracture , 2009, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[29]  Hao Zhang,et al.  When Doesn't Cokriging Outperform Kriging? , 2015, 1507.08403.

[30]  A.A. Shah,et al.  Manifold learning for the emulation of spatial fields from computational models , 2016, J. Comput. Phys..

[31]  Hassan Maatouk,et al.  Gaussian Process Emulators for Computer Experiments with Inequality Constraints , 2016, Mathematical Geosciences.

[32]  Jack P. C. Kleijnen,et al.  Multivariate versus Univariate Kriging Metamodels for Multi-Response Simulation Models , 2014, Eur. J. Oper. Res..

[33]  Jeremy E. Oakley,et al.  Bayesian History Matching of Complex Infectious Disease Models Using Emulation: A Tutorial and a Case Study on HIV in Uganda , 2015, PLoS Comput. Biol..

[34]  Mengyang Gu Gu,et al.  Robust Uncertainty Quantification and Scalable Computation for Computer Models with Massive Output , 2016 .

[35]  G. Tapia,et al.  Bayesian Calibration and Uncertainty Quantification for a Physics-Based Precipitation Model of Nickel–Titanium Shape-Memory Alloys , 2017 .

[36]  S. Bennani,et al.  Comparison of Surrogate-Based Uncertainty Quantification Methods for Computationally Expensive Simulators , 2015, SIAM/ASA J. Uncertain. Quantification.

[37]  Holger Dette,et al.  Generalized Latin Hypercube Design for Computer Experiments , 2010, Technometrics.

[38]  Marc G. Genton,et al.  Cross-Covariance Functions for Multivariate Geostatistics , 2015, 1507.08017.

[39]  Chong-Yu Xu,et al.  Development and comparison in uncertainty assessment based Bayesian modularization method in hydrological modeling , 2013 .

[40]  Haotian Hang,et al.  Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics , 2004 .

[41]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[42]  Ismail Farajpour,et al.  Partitioned Analysis of Coupled Numerical Models Considering Imprecise Parameters and Inexact Models , 2014, J. Comput. Civ. Eng..

[43]  Puneet Singla,et al.  Computation of probabilistic hazard maps and source parameter estimation for volcanic ash transport and dispersion , 2014, J. Comput. Phys..

[44]  A. Gelfand,et al.  A Bayesian coregionalization approach for multivariate pollutant data , 2003 .

[45]  P. Powell.  Calculating Determinants of Block Matrices , 2011, 1112.4379.

[46]  James O. Berger,et al.  Modularization in Bayesian analysis, with emphasis on analysis of computer models , 2009 .

[47]  Ricardo A. Lebensohn,et al.  Experiment-based validation and uncertainty quantification of coupled multi-scale plasticity models , 2016 .

[48]  Brian J. Williams,et al.  Sensitivity analysis when model outputs are functions , 2006, Reliab. Eng. Syst. Saf..

[49]  Robert Jacob,et al.  Statistical emulation of climate model projections based on precomputed GCM runs , 2013 .

[50]  David Higdon,et al.  Cosmic calibration: Constraints from the matter power spectrum and the cosmic microwave background , 2007 .

[51]  Sez Atamturktur,et al.  Mitigating Error and Uncertainty in Partitioned Analysis: A Review of Verification, Calibration and Validation Methods for Coupled Simulations , 2017 .

[52]  Haavard Rue,et al.  Beyond the Valley of the Covariance Function , 2015, 1507.08383.

[53]  Agathe Girard,et al.  Propagation of uncertainty in Bayesian kernel models - application to multiple-step ahead forecasting , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[54]  Bertrand Iooss,et al.  Screening and metamodeling of computer experiments with functional outputs. Application to thermal-hydraulic computations , 2012, Reliab. Eng. Syst. Saf..

[55]  William C. Horrace,et al.  Some results on the multivariate truncated normal distribution , 2005 .

[56]  James O. Berger,et al.  RobustGaSP: Robust Gaussian Stochastic Process Emulation in R , 2018, R J..

[57]  James O. Berger,et al.  Pooling strength amongst limited datasets using hierarchical Bayesian analysis, with application to pyroclastic density current mobility metrics , 2016 .

[58]  E. R. Stefanescu,et al.  Temporal, probabilistic mapping of ash clouds using wind field stochastic variability and uncertain eruption source parameters: Example of the 14 April 2010 Eyjafjallajökull eruption , 2014 .

[59]  A. O'Hagan,et al.  Bayesian emulation of complex multi-output and dynamic computer models , 2010 .

[60]  Gareth M. James,et al.  Principal component models for sparse functional data , 1999 .

[61]  Yuqiong Liu,et al.  Linking science with environmental decision making: Experiences from an integrated modeling approach to supporting sustainable water resources management , 2008, Environ. Model. Softw..

[62]  Daniele Venturi,et al.  Multi-fidelity Gaussian process regression for prediction of random fields , 2017, J. Comput. Phys..

[63]  A. Damianou.  Uncertainty Propagation in Gaussian Process Pipelines , 2014 .

[64]  Yalchin Efendiev,et al.  Bayesian Uncertainty Quantification for Subsurface Inversion Using a Multiscale Hierarchical Model , 2014, Technometrics.

[65]  Agathe Girard,et al.  Gaussian Processes: Prediction at a Noisy Input and Application to Iterative Multiple-Step Ahead Forecasting of Time-Series , 2003, European Summer School on Multi-AgentControl.

[66]  Art B. Owen,et al.  On Shapley Value for Measuring Importance of Dependent Inputs , 2016, SIAM/ASA J. Uncertain. Quantification.

[67]  Leonard A. Smith,et al.  Towards improving the framework for probabilistic forecast evaluation , 2015, Climatic Change.

[68]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[69]  Robert B. Gramacy,et al.  Cases for the nugget in modeling computer experiments , 2010, Statistics and Computing.

[70]  James O. Berger,et al.  Automating Emulator Construction for Geophysical Hazard Maps , 2014, SIAM/ASA J. Uncertain. Quantification.

[71]  Antony M. Overstall,et al.  Multivariate emulation of computer simulators: model selection and diagnostics with application to a humanitarian relief model , 2015, Journal of the Royal Statistical Society. Series C, Applied statistics.

[72]  James O. Berger,et al.  Estimating Shape Constrained Functions Using Gaussian Processes , 2016, SIAM/ASA J. Uncertain. Quantification.

[73]  David B. Dunson,et al.  Bayesian monotone regression using Gaussian process projection , 2013, 1306.4041.

[74]  Gonzalo García-Donato,et al.  Calibration of computer models with multivariate output , 2012, Comput. Stat. Data Anal..

[75]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[76]  Jeremy E. Oakley,et al.  Multivariate Gaussian Process Emulators With Nonseparable Covariance Structures , 2013, Technometrics.

[77]  Kathleen V. Diegert,et al.  Error and uncertainty in modeling and simulation , 2002, Reliab. Eng. Syst. Saf..

[78]  Rui Paulo.  Default priors for Gaussian processes , 2005 .

[79]  Emanuele Borgonovo,et al.  Sensitivity analysis: A review of recent advances , 2016, Eur. J. Oper. Res..

[80]  Murali Haran,et al.  Computer Model Calibration with Multivariate Spatial Output : A Case Study , 2010 .

[81]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[82]  Qiqi Wang,et al.  Erratum: Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces , 2013, SIAM J. Sci. Comput..

[83]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[84]  Thomas J. Santner,et al.  Sequential design of computer experiments to minimize integrated response functions , 2000 .

[85]  Emre Ertin,et al.  Gaussian Process Models for Censored Sensor Readings , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.