A screening approach for non-parametric global sensitivity analysis

Global sensitivity analysis (GSA) can help practitioners focusing on the inputs whose uncertainties have an impact on the model output, which allows reducing the complexity of the model. Screening, as the qualitative method of GSA, is to identify and exclude non- or less-influential input variables in high-dimensional models. However, for non-parametric problems, there remains the challenging problem of finding an efficient screening procedure, as one needs to properly handle the non-parametric high-order interactions among input variables and keep the size of the screening experiment economically feasible. In this study, we design a novel screening approach based on analysis of variance decomposition of the model. This approach combines the virtues of run-size economy and model independence. The core idea is to choose a low-level complete orthogonal array to derive the sensitivity estimates for all input factors and their interactions with low cost, and then develop a statistical process to screen out the non-influential ones without assuming the effect-sparsity of the model. Simulation studies show that the proposed approach performs well in various settings.

[1]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[2]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[3]  Stefano Tarantola,et al.  A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output , 1999, Technometrics.

[4]  Art B. Owen,et al.  Quasi-regression with shrinkage , 2003, Math. Comput. Simul..

[5]  Hao Helen Zhang,et al.  Component selection and smoothing in multivariate nonparametric regression , 2006, math/0702659.

[6]  Dennis K. J. Lin,et al.  Data analysis in supersaturated designs , 2002 .

[7]  B. Jørgensen,et al.  The theory of linear models , 1995 .

[8]  Trent Gaugler,et al.  Testing for Interaction in Two‐Way Random and Mixed Effects Models: The Fully Nonparametric Approach , 2011, Biometrics.

[9]  Yincai Tang,et al.  Orthogonal arrays for estimating global sensitivity indices of non-parametric models based on ANOVA high-dimensional model representation , 2012 .

[10]  A. Dey,et al.  Orthogonal Resolution-IV Designs for Some Asymmetrical Factorials , 1983 .

[11]  W. Loh,et al.  Identification of active contrasts in unreplicated factorial experiments , 1992 .

[12]  Shu Yamada,et al.  Selection of Active Factors by Stepwise Regression in the Data Analysis of Supersaturated Design , 2004 .

[13]  Saltelli Andrea,et al.  Sensitivity Analysis for Nonlinear Mathematical Models. Numerical ExperienceSensitivity Analysis for Nonlinear Mathematical Models. Numerical Experience , 1995 .

[14]  I. Sobol,et al.  Sensitivity Measures, ANOVA-like Techniques and the Use of Bootstrap , 1997 .

[15]  Max D. Morris,et al.  Sampling plans based on balanced incomplete block designs for evaluating the importance of computer model inputs , 2006 .

[16]  Armin Iske,et al.  Hierarchical Nonlinear Approximation for Experimental Design and Statistical Data Fitting , 2007, SIAM J. Sci. Comput..

[17]  V. Roshan Joseph,et al.  Reliability improvement experiments with degradation data , 2006, IEEE Transactions on Reliability.

[18]  Hao Helen Zhang,et al.  Component selection and smoothing in smoothing spline analysis of variance models -- COSSO , 2003 .

[19]  Runchu Zhang,et al.  A method for screening active effects in supersaturated designs , 2007 .

[20]  Rolf E. Bargmann,et al.  Orthogonal Central Composite Designs of the Third Order in the Evaluation of Sensitivity and Plant Growth Simulation Models , 1985 .

[21]  Bertrand Iooss,et al.  An efficient methodology for modeling complex computer codes with Gaussian processes , 2008, Comput. Stat. Data Anal..

[22]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[23]  Dale Borowiak,et al.  The Theory of Linear Models , 1995 .

[24]  Frederick Kin Hing Phoa,et al.  Analysis of Supersaturated Designs via Dantzig Selector , 2009 .

[25]  R. Lenth Quick and easy analysis of unreplicated factorials , 1989 .

[26]  Yincai Tang,et al.  Design of Experiment in Global Sensitivity Analysis Based on ANOVA High-Dimensional Model Representation , 2010, Commun. Stat. Simul. Comput..

[27]  Bruno Sudret,et al.  Efficient computation of global sensitivity indices using sparse polynomial chaos expansions , 2010, Reliab. Eng. Syst. Saf..

[28]  L. Xue CONSISTENT VARIABLE SELECTION IN ADDITIVE MODELS , 2009 .

[29]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[30]  Daniel Busby,et al.  Smoothing spline analysis of variance approach for global sensitivity analysis of computer codes , 2013, Reliab. Eng. Syst. Saf..

[31]  C. F. Jeff Wu,et al.  Experiments: Planning, Analysis, and Parameter Design Optimization , 2000 .

[32]  I. Sobol,et al.  About the use of rank transformation in sensitivity analysis of model output , 1995 .

[33]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[34]  Narayanaswamy Balakrishnan,et al.  ANALYZING UNREPLICATED FACTORIAL EXPERIMENTS: A REVIEW WITH SOME NEW PROPOSALS , 1998 .

[35]  C. Daniel Use of Half-Normal Plots in Interpreting Factorial Two-Level Experiments , 1959 .