A review of contemporary methods for the presentation of scientific uncertainty.

Graphic methods for displaying uncertainty are often the most concise and informative way to communicate abstract concepts. Presentation methods currently in use for the display and interpretation of scientific uncertainty are reviewed. Numerous subjective and objective uncertainty display methods are presented, including qualitative assessments, node and arrow diagrams, standard statistical methods, box-and-whisker plots,robustness and opportunity functions, contribution indexes, probability density functions, cumulative distribution functions, and graphical likelihood functions.

[1]  J. Ledolter.  The Statistical Sleuth , 2003 .

[2]  S. Monni,et al.  Uncertainty in Agricultural CH4 AND N2O Emissions from Finland – Possibilities to Increase Accuracy in Emission Estimates , 2007 .

[3]  David R. Schwartz,et al.  Optional Stopping Performance under Graphic and Numeric CRT Formatting , 1984 .

[4]  L. Escuder-Gilabert,et al.  A diagnostic tool for determining the quality of accuracy validation. Assessing the method for determination of nitrate in drinking water , 2007, Analytical and bioanalytical chemistry.

[5]  Thibault Sterckeman,et al.  Mapping of anthropogenic trace elements inputs in agricultural topsoil from Northern France using enrichment factors , 2010 .

[6]  H. Niu,et al.  A potential dating technique using 228Th/228Ra ratio for tracing the chronosequence of elemental concentrations in plants. , 2007, Applied radiation and isotopes : including data, instrumentation and methods for use in agriculture, industry and medicine.

[7]  C. McHorney,et al.  Frequency or Probability? A Qualitative Study of Risk Communication Formats Used in Health Care , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  É. Counil,et al.  Handling of contamination variability in exposure assessment: a case study with ochratoxin A. , 2005, Food and chemical toxicology : an international journal published for the British Industrial Biological Research Association.

[9]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[10]  A. Romney.  Culture Consensus as a Statistical Model , 1999 .

[11]  A. Kay,et al.  Uncertainty analysis for estimating flood frequencies for ungauged catchments using rainfall-runoff models , 2007 .

[12]  D. Hamby.  A review of techniques for parameter sensitivity analysis of environmental models , 1994, Environmental monitoring and assessment.

[13]  D. M. Hamby,et al.  AGE-SPECIFIC UNCERTAINITY OF THE 131I INGESTION DOSE CONVERSION FACTOR , 2003, Health physics.

[14]  Jerome R. Ravetz,et al.  Uncertainty and Quality in Science for Policy , 1990 .

[15]  Helen M. Regan,et al.  Analysis and Portrayal of Uncertainty in a Food-Web Exposure Model , 2002 .

[16]  Scott Ferson,et al.  Logistic sensitivity and bounds for extinction risks , 1996 .

[17]  Marc B Neumann,et al.  Uncertainty in prediction of disinfection performance. , 2007, Water research.

[18]  R. K. Dixon,et al.  Mitigation and Adaptation Strategies for Global Change , 1998 .

[19]  A. Hope,et al.  Predicting streamflow response to fire-induced landcover change: implications of parameter uncertainty in the MIKE SHE model. , 2007, Journal of environmental management.

[20]  Peter A. Vanrolleghem,et al.  Evaluation of uncertainty propagation into river water quality predictions to guide future monitoring campaigns , 2007, Environ. Model. Softw..

[21]  Roy O. Freedle,et al.  Artificial Intelligence and the Future of Testing , 1990 .

[22]  J E Smith,et al.  Identifying Influences on Model Uncertainty: An Application Using a Forest Carbon Budget Model , 2001, Environmental management.

[23]  R. Clough,et al.  Uncertainty contributions to single and double isotope dilution mass spectrometry with HPLC-CV-MC-ICP-MS for the determination of methylmercury in fish tissue , 2005 .

[24]  K. Lindenschmidt,et al.  Structural uncertainty in a river water quality modelling system , 2007 .

[25]  D. W. Braudaway.  Uncertainty specification for Data Acquisition Devices (DAQ) , 2003, Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No.03CH37412).

[26]  Lee L. Gremillion,et al.  The Effects of Color Enhanced Information Presentations , 1981, ICIS.

[27]  Pete Smith,et al.  The role of measurement uncertainties for the simulation of grassland net ecosystem exchange (NEE) in Europe , 2007 .

[28]  J. A. Wardekker,et al.  Uncertainty communication in environmental assessments: views from the Dutch science-policy interface , 2008 .

[29]  Brian Neil Klawiter.  An Investigation into the Potential for Geochemical / Geoarchaeological Provenance of Prairie du Chien Cherts , 2000 .

[30]  D. M. Hamby,et al.  Uncertainty of the Iodine-131 Ingestion Dose Conversion Factor , 1999 .

[31]  정철우.  미국 Pacific Northwest National Laboratory 소개 , 2013 .

[32]  Eric R. Stone,et al.  Effects of numerical and graphical displays on professed risk-taking behavior. , 1997 .

[33]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[34]  Eric J. Johnson,et al.  Information displays and preference reversals , 1988 .

[35]  M. Granger Morgan,et al.  Graphical Communication of Uncertain Quantities to Nontechnical People , 1987 .

[36]  Susan S. Kirschenbaum,et al.  Effects of Graphic and Verbal Probability Information on Command Decision Making , 1994 .

[37]  Jeff Gill,et al.  Bayesian Methods : A Social and Behavioral Sciences Approach , 2002 .

[38]  Jon Craig Helton,et al.  Conceptual and computational basis for the quantification of margins and uncertainty. , 2009 .

[39]  Peter M. Atkinson,et al.  Flood inundation model updating using an ensemble Kalman filter and spatially distributed measurements , 2007 .

[40]  J. P. van der Sluijs,et al.  Towards a synthesis of qualitative and quantitative uncertainty assessment: applications of the numeral, unit, spread, assessment, pedigree (NUSAP) system , 2003 .

[41]  Amirhossein Mokhtari,et al.  Consumer‐Phase Salmonella enterica serovar Enteritidis Risk Assessment for Egg‐Containing Food Products , 2006, Risk analysis : an official publication of the Society for Risk Analysis.

[42]  Izak Benbasat,et al.  An Investigation of the Effectiveness of Color and Graphical Information Presentation Under Varying Time Constraints , 1986, MIS Q..

[43]  Izak Benbasat,et al.  The Influence of Color and Graphical Information Presentation in a Managerial Decision Simulation , 1986, Hum. Comput. Interact..

[44]  Marc B Neumann,et al.  Sources of parameter uncertainty in predicting treatment performance: the case of preozonation in drinking water engineering. , 2007, Environmental science & technology.

[45]  S. Lewandowsky,et al.  Discriminating strata in scatterplots , 1989 .

[46]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[47]  J. Peters,et al.  Uncertainty propagation in vegetation distribution models based on ensemble classifiers. , 2009 .

[48]  Yeou-Koung Tung,et al.  Hydrosystems Engineering Uncertainty Analysis , 2005 .

[49]  J. Nichols,et al.  Occupancy estimation and modeling with multiple states and state uncertainty. , 2007, Ecology.

[50]  E. M. Hartwell.  Boston , 1906 .

[51]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[52]  Lesley F. Wright,et al.  Information Gap Decision Theory: Decisions under Severe Uncertainty , 2004 .

[53]  M G Myriam Hunink,et al.  Decision making in the face of uncertainty and resource constraints: examples from trauma imaging. , 2005, Radiology.

[54]  W. Rodi.  Error Analysis in the Joint Event Location/Seismic Calibration Inverse Problem , 2006 .

[55]  Christopher D. Wickens,et al.  Workload and Reliability of Predictor Displays in Aircraft Traffic Avoidance , 2000 .

[56]  Bruno Mary,et al.  Uncertainty assessment of soil water content spatial patterns using geostatistical simulations: An empirical comparison of a simulation accounting for single attribute and a simulation accounting for secondary information , 2007 .

[57]  Joseph A. C. Delaney.  Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[58]  John Doherty,et al.  Parameter estimation and uncertainty analysis for a watershed model , 2007, Environ. Model. Softw..

[59]  Jay D. Johnson,et al.  A sampling-based computational strategy for the representation of epistemic uncertainty in model predictions with evidence theory , 2007 .

[60]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[61]  R. Dawes.  Behavioral decision making and judgment. , 1998 .

[62]  J. D. Whyatt,et al.  Regional scale modelling of particulate matter in the UK, source attribution and an assessment of uncertainties , 2007 .

[63]  D. M. Hamby,et al.  Relative sensitivities of existing and novel model parameters in atmospheric tritium dose estimates , 1991 .

[64]  Ian Spence,et al.  Using color to code quantity in spatial displays. , 1999 .

[65]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[66]  A. Tversky,et al.  Rational choice and the framing of decisions , 1990 .

[67]  THE GAUSSIAN ATMOSPHERIC TRANSPORT MODEL AND ITS SENSITIVITY TO THE JOINT FREQUENCY DISTRIBUTION AND PARAMETRIC VARIABILITY , 2002, Health physics.

[68]  B. Napier,et al.  Soil-to-Plant Concentration Ratios for Assessing Food Chain Pathways in Biosphere Models , 2007 .

[69]  R. Robb,et al.  Dosimetry accuracy as a function of seed localization uncertainty in permanent prostate brachytherapy: increased seed number correlates with less variability in prostate dosimetry , 2007, Physics in medicine and biology.

[70]  D. Vose.  Risk Analysis: A Quantitative Guide , 2000 .

[71]  Hugh P Possingham,et al.  Theory for Designing Nature Reserves for Single Species , 2004, The American Naturalist.

[72]  J. Hendry,et al.  Radiobiology for the Radiologist , 1979, British Journal of Cancer.

[73]  S. Funtowicz,et al.  Combining Quantitative and Qualitative Measures of Uncertainty in Model‐Based Environmental Assessment: The NUSAP System , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[74]  Sandia Report,et al.  Illustration of Sampling-Based Approaches to the Calculation of Expected Dose in Performance Assessments for the Proposed High Level Radioactive Waste Repository at Yucca Mountain, Nevada , 2007 .

[75]  D. Hamby.  A probabilistic estimation of atmospheric tritium dose. , 1993, Health physics.

[76]  Jennifer Seed,et al.  Framework for use of toxicity screening tools in context-based decision-making. , 2007, Food and chemical toxicology : an international journal published for the British Industrial Biological Research Association.

[77]  Kaihong Wang,et al.  Vibration Analysis of Cracked Composite Bending-torsion Beams for Damage Diagnosis , 2004 .

[78]  D. Hamby,et al.  Uncertainty in particulate deposition for 1 microm AMAD particles in an adult lung model. , 2001, Radiation protection dosimetry.

[79]  J. Ham,et al.  Estimating the Microbial Risk of E. coli in Reclaimed Wastewater Irrigation on Paddy Field , 2007, Environmental monitoring and assessment.

[80]  Hugh P Possingham,et al.  Accounting for uncertainty in marine reserve design. , 2006, Ecology letters.

[81]  Hwong-wen Ma,et al.  Assessment of water quality management with a systematic qualitative uncertainty analysis. , 2007, The Science of the total environment.

[82]  D. Hamby,et al.  The Creation of an Historical Meteorological Database for Environmental Dose Assessment , 2003, Environmental monitoring and assessment.

[83]  S M Rappaport,et al.  Exposure reconstruction for reducing uncertainty in risk assessment: example using MTBE biomarkers and a simple pharmacokinetic model , 2007, Biomarkers : biochemical indicators of exposure, response, and susceptibility to chemicals.

[84]  Paul Slovic,et al.  Graphic Representation of Judgmental Information , 1986, SGCH.

[85]  Jon C. Helton,et al.  Multiple predictor smoothing methods for sensitivity analysis , 2005, Proceedings of the Winter Simulation Conference, 2005..

[86]  Yakov Ben-Haim,et al.  Uncertainty, probability and information-gaps , 2004, Reliab. Eng. Syst. Saf..

[87]  A Ralph Henderson,et al.  The bootstrap: a technique for data-driven statistics. Using computer-intensive analyses to explore experimental data. , 2005, Clinica chimica acta; international journal of clinical chemistry.

[88]  Matthias C. M. Troffaes,et al.  Robust detection of exotic infectious diseases in animal herds: A comparative study of three decision methodologies under severe uncertainty , 2011, Int. J. Approx. Reason..