Global Sensitivity Analysis Based on Entropy: From Differential Entropy to Alternative Measures

Differential entropy can be negative, while discrete entropy is always non-negative. This article shows that negative entropy is a significant flaw when entropy is used as a sensitivity measure in global sensitivity analysis. Global sensitivity analysis based on differential entropy cannot have negative entropy, just as Sobol sensitivity analysis does not have negative variance. Entropy is similar to variance but does not have the same properties. An alternative sensitivity measure based on the approximation of the differential entropy using dome-shaped functionals with non-negative values is proposed in the article. Case studies have shown that new sensitivity measures lead to a rational structure of sensitivity indices with a significantly lower proportion of higher-order sensitivity indices compared to other types of distributional sensitivity analysis. In terms of the concept of sensitivity analysis, a decrease in variance to zero means a transition from the differential to discrete entropy. The form of this transition is an open question, which can be studied using other scientific disciplines. The search for new functionals for distributional sensitivity analysis is not closed, and other suitable sensitivity measures may be found.

[1]  Donghai Liu,et al.  The Linguistic Picture Fuzzy Set and Its Application in Multi-Criteria Decision-Making: An Illustration to the TOPSIS and TODIM Methods Based on Entropy Weight , 2020, Symmetry.

[2]  Till Francke,et al.  An effective strategy for combining variance- and distribution-based global sensitivity analysis , 2020, Environ. Model. Softw..

[3]  Hao Liu,et al.  Accurate Suitability Evaluation of Large-Scale Roof Greening Based on RS and GIS Methods , 2020, Sustainability.

[4]  Anna De Falco,et al.  Sensitivity analysis of frequency-based tie-rod axial load evaluation methods , 2021 .

[5]  Tong Liu,et al.  Thermodynamic Evaluation and Sensitivity Analysis of a Novel Compressed Air Energy Storage System Incorporated with a Coal-Fired Power Plant , 2020, Entropy.

[6]  Zhenzhou Lu,et al.  Global sensitivity analysis for fuzzy inputs based on the decomposition of fuzzy output entropy , 2017 .

[7]  Vladimir Rykov,et al.  On the reliability function of a double redundant system with general repair time distribution , 2019 .

[8]  The single-loop Kriging model combined with Bayes’ formula for time-dependent failure probability based global sensitivity , 2021 .

[9]  Ernur Karadoğan,et al.  Analysis of One-Dimensional Ivshin–Pence Shape Memory Alloy Constitutive Model for Sensitivity and Uncertainty , 2020, Materials.

[10]  Sergio Hernández,et al.  A Brief Review of Generalized Entropies , 2018, Entropy.

[11]  Irineo L. López-Cruz,et al.  Global Sensitivity Analysis and Calibration by Differential Evolution Algorithm of HORTSYST Crop Model for Fertigation Management , 2021, Water.

[12]  David Lehký,et al.  Neural network ensemble-based sensitivity analysis in structural engineering: Comparison of selected methods and the influence of statistical correlation , 2021 .

[13]  Sarfaraz Hashemkhani Zolfani,et al.  Application of Interval Fuzzy Logic in Selecting a Sustainable Supplier on the Example of Agricultural Production , 2021, Symmetry.

[14]  Francesca Pianosi,et al.  Distribution-based sensitivity analysis from a generic input-output sample , 2018, Environ. Model. Softw..

[15]  Anqi Wang,et al.  Practical Experience of Sensitivity Analysis: Comparing Six Methods, on Three Hydrological Models, with Three Performance Criteria , 2019, Water.

[16]  Edmundas Kazimieras Zavadskas,et al.  VASMA Weighting: Survey-Based Criteria Weighting Methodology that Combines ENTROPY and WASPAS-SVNS to Reflect the Psychometric Features of the VAS Scales , 2020, Symmetry.

[17]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[18]  Jianyu Zhao,et al.  Global Reliability Sensitivity Analysis Based on Maximum Entropy and 2-Layer Polynomial Chaos Expansion , 2018, Entropy.

[19]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.

[20]  Tiku T. Tanyimboh,et al.  Sensitivity analysis of entropy-constrained designs of water distribution systems , 2008 .

[21]  Zdeněk Kala.  From Probabilistic to Quantile-Oriented Sensitivity Analysis: New Indices of Design Quantiles , 2020, Symmetry.

[22]  Jurgita Antucheviciene,et al.  Solving Civil Engineering Problems by Means of Fuzzy and Stochastic MCDM Methods: Current State and Future Research , 2015 .

[23]  Vladimir Rykov,et al.  Investigations of the Potential Application of k-out-of-n Systems in Oil and Gas Industry Objects , 2020 .

[24]  K. S. Ravichandran,et al.  Hesitant Fuzzy SWARA-Complex Proportional Assessment Approach for Sustainable Supplier Selection (HF-SWARA-COPRAS) , 2020, Symmetry.

[25]  Ronald L. Iman,et al.  Risk methodology for geologic disposal of radioactive waste: small sample sensitivity analysis techniques for computer models, with an application to risk assessment , 1980 .

[26]  Vuk Bogdanović,et al.  A Novel CRITIC-Fuzzy FUCOM-DEA-Fuzzy MARCOS Model for Safety Evaluation of Road Sections Based on Geometric Parameters of Road , 2020, Symmetry.

[27]  Zdeněk Kala.  Global sensitivity analysis in stability problems of steel frame structures , 2016 .

[28]  S. M. Mousavi,et al.  A New Group Decision Model Based on Grey-Intuitionistic Fuzzy-ELECTRE and VIKOR for Contractor Assessment Problem , 2018 .

[29]  Emanuele Borgonovo,et al.  A new uncertainty importance measure , 2007, Reliab. Eng. Syst. Saf..

[30]  Dong Wang,et al.  Sensitivity analysis of the probability distribution of groundwater level series based on information entropy , 2012, Stochastic Environmental Research and Risk Assessment.

[31]  Mahesh D. Pandey,et al.  An Effective Approach for Reliability-Based Sensitivity Analysis with the Principle of Maximum Entropy and Fractional Moments , 2019, Entropy.

[32]  Agachai Sumalee,et al.  A cross-entropy method and probabilistic sensitivity analysis framework for calibrating microscopic traffic models , 2016 .

[33]  Zdenek Kala,et al.  Global Sensitivity Analysis of Quantiles: New Importance Measure Based on Superquantiles and Subquantiles , 2021, Symmetry.

[34]  Lu Zhenzhou,et al.  An entropy-based global sensitivity analysis for the structures with both fuzzy variables and random variables , 2013 .

[35]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[36]  Limao Zhang,et al.  BAYESIAN BELIEF NETWORK-BASED PROJECT COMPLEXITY MEASUREMENT CONSIDERING CAUSAL RELATIONSHIPS , 2020 .

[37]  Z. Kala.  Estimating probability of fatigue failure of steel structures , 2020 .

[38]  Zdeněk Kala,et al.  Global sensitivity analysis of reliability of structural bridge system , 2019, Engineering Structures.

[39]  Edmundas Kazimieras Zavadskas,et al.  Evaluation of Combined Heat and Power (CHP) Systems Using Fuzzy Shannon Entropy and Fuzzy TOPSIS , 2016 .

[40]  Pan Wang,et al.  Numerical Decomposition for the Reliability-Oriented Sensitivity With Dependent Variables Using Vine Copulas , 2020 .

[41]  Milan Holický,et al.  Design characteristics of structural steels based on statistical analysis of metallurgical products , 2004 .

[42]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[43]  Alfred Strauss,et al.  LIKELIHOOD OF IMPACT EVENTS IN TRANSPORT NETWORKS CONSIDERING ROAD CONDITIONS, TRAFFIC AND ROUTING ELEMENTS PROPERTIES , 2020, JOURNAL OF CIVIL ENGINEERING AND MANAGEMENT.

[44]  Huimin Li,et al.  MULTI-CRITERIA DECISION MAKING FOR IDENTIFICATION OF UNBALANCED BIDDING , 2019 .

[45]  Cosmin Safta,et al.  Sensitivity-Informed Bayesian Inference for Home PLC Network Models with Unknown Parameters , 2021, Energies.

[46]  Zdeněk Kala,et al.  Sensitivity assessment of steel members under compression , 2009 .

[47]  Gerta Köster,et al.  Dynamics of a Simulated Demonstration March: An Efficient Sensitivity Analysis , 2021, Sustainability.

[48]  Amir Mosavi,et al.  Assessing Machine Learning versus a Mathematical Model to Estimate the Transverse Shear Stress Distribution in a Rectangular Channel , 2021 .

[49]  Limit States of Structures and Global Sensitivity Analysis Based on Cramér-von Mises Distance , 2020, International Journal of Mechanics.

[50]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[51]  Fabrice Gamboa,et al.  Sensitivity Analysis Based on Cramér-von Mises Distance , 2015, SIAM/ASA J. Uncertain. Quantification.

[52]  Arunodaya Raj Mishra,et al.  Pythagorean Fuzzy SWARA–VIKOR Framework for Performance Evaluation of Solar Panel Selection , 2020 .

[53]  Glynn Harmon,et al.  The measurement of information , 1984, Inf. Process. Manag..

[54]  L. Míča,et al.  GLOBAL SENSITIVITY ANALYSIS FOR TRANSFORMATION OF HOEK-BROWN FAILURE CRITERION FOR ROCK MASS , 2018, Journal of Civil Engineering and Management.

[55]  Z. Kala.  Sensitivity Analysis in Probabilistic Structural Design: A Comparison of Selected Techniques , 2020, Sustainability.

[56]  Agus Sudjianto,et al.  Relative Entropy Based Method for Probabilistic Sensitivity Analysis in Engineering Design , 2006 .

[57]  Hao Lu,et al.  STUDY ON RISK CONTROL OF WATER INRUSH IN TUNNEL CONSTRUCTION PERIOD CONSIDERING UNCERTAINTY , 2019, JOURNAL OF CIVIL ENGINEERING AND MANAGEMENT.

[58]  Z. Kala.  Quantile-based versus Sobol sensitivity analysis in limit state design , 2020 .

[59]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[60]  M J Thomsom,et al.  An alternative. , 1970, The American journal of psychiatry.

[61]  Zdeněk Kala,et al.  Material and geometrical characteristics of structural steels based on statistical analysis of metallurgical products , 2009 .

[62]  Z. Kala,et al.  Imperfection sensitivity analysis of steel columns at ultimate limit state , 2018, Archives of Civil and Mechanical Engineering.

[63]  Zdeněk Kala.  QUANTILE-ORIENTED GLOBAL SENSITIVITY ANALYSIS OF DESIGN RESISTANCE , 2019, JOURNAL OF CIVIL ENGINEERING AND MANAGEMENT.

[64]  Francesca Pianosi,et al.  A simple and efficient method for global sensitivity analysis based on cumulative distribution functions , 2015, Environ. Model. Softw..

[65]  Jan Valeš,et al.  Sensitivity assessment and lateral-torsional buckling design of I-beams using solid finite elements , 2017 .

[66]  Matteo Poggiali,et al.  Uncertainty Quantification of Film Cooling Performance of an Industrial Gas Turbine Vane , 2019, Entropy.

[67]  Wenrui Hao,et al.  Efficient sampling methods for global reliability sensitivity analysis , 2012, Comput. Phys. Commun..

[68]  Emanuele Borgonovo,et al.  Sampling strategies in density-based sensitivity analysis , 2012, Environ. Model. Softw..

[69]  Lihai Zhang,et al.  A Coupled Macroscopic and Mesoscopic Creep Model of Soft Marine Soil Using a Directional Probability Entropy Approach , 2021, Journal of Marine Science and Engineering.

[70]  V. Maume-Deschamps,et al.  Estimation of quantile oriented sensitivity indices , 2017, 1702.00925.

[71]  Marcin Jan Schroeder,et al.  An Alternative to Entropy in the Measurement of Information , 2004, Entropy.

[72]  Lu Wang,et al.  Quantile based global sensitivity measures , 2019, Reliab. Eng. Syst. Saf..

[73]  Azad Yazdani,et al.  Entropy-based sensitivity analysis of global seismic demand of concrete structures , 2017 .

[74]  Emanuele Borgonovo,et al.  Sensitivity analysis: A review of recent advances , 2016, Eur. J. Oper. Res..

[75]  Edmundas Kazimieras Zavadskas,et al.  Multi-criteria evaluation of green suppliers using an extended WASPAS method with interval type-2 fuzzy sets , 2016 .

[76]  Emanuele Borgonovo,et al.  Making the most out of a hydrological model data set: Sensitivity analyses to open the model black‐box , 2017 .

[77]  P. Koteš,et al.  Sensitivity of dose-response function for carbon steel under various conditions in Slovakia , 2019, Transportation Research Procedia.