Identifying Uncertainty in Environmental Risk Assessments: The Development of a Novel Typology and Its Implications for Risk Characterization

ABSTRACT Environmental risk analysts need to draw from a clear typology of uncertainties when qualifying risk estimates and/or significance statements about risk. However, categorizations of uncertainty within existing typologies are largely overlapping, contradictory, and subjective, and many typologies are not designed with environmental risk assessments (ERAs) in mind. In an attempt to rectify these issues, this research provides a new categorization of uncertainties based, for the first time, on the appraisal of a large subset of ERAs, namely 171 peer-reviewed environmental weight-of-evidence assessments. Using this dataset, a defensible typology consisting of seven types of uncertainty (data, language, system, extrapolation, variability, model, and decision) and 20 related sub-types is developed. Relationships between uncertainties and the techniques used to manage them are also identified and statistically evaluated. A highly preferred uncertainty management option is to take no action when faced with uncertainty, although where techniques are applied they are commensurate with the uncertainty in question. Key observations are applied in the form of guidance for dealing with uncertainty, demonstrated through ERAs of genetically modified higher plants in the European Union. The presented typology and accompanying guidance will have positive implications for the identification, prioritization, and management of uncertainty during risk characterization.

[1]  P. Mineau,et al.  A Review of Interspecies Toxicity Extrapolation in Birds and Mammals and a Proposal for Long-term Toxicity Data , 2005, Ecotoxicology.

[2]  B. R. Gurjar,et al.  Potential Health Risks Due to Toxic Contamination in the Ambient Environment of Certain Indian States , 2003, Environmental monitoring and assessment.

[3]  Jan Rotmans,et al.  Uncertainty in Integrated Assessment Modelling , 2002 .

[4]  J. Ranke Persistence of antifouling agents in the marine biosphere. , 2002, Environmental science & technology.

[5]  L. Maxim,et al.  Interspecies comparisons of the toxicity of asbestos and synthetic vitreous fibers: a weight-of-the-evidence approach. , 2001, Regulatory toxicology and pharmacology : RTP.

[6]  Mustafa M. Aral,et al.  Risk tolerance measure for decision-making in fuzzy analysis: a health risk assessment perspective , 2007 .

[7]  Hwong-wen Ma,et al.  Assessment of water quality management with a systematic qualitative uncertainty analysis. , 2007, The Science of the total environment.

[8]  Robin Chowdhury,et al.  Role of slope reliability analysis in landslide risk management , 2003 .

[9]  D. Proctor,et al.  Assessment of Human Health and Ecological Risks Posed by the Uses of Steel-Industry Slags in the Environment , 2002 .

[10]  W. Dey,et al.  The 316(b) assessment process: evolution towards a risk-based approach , 2000 .

[11]  G Echevarria,et al.  Effect of pH on the sorption of uranium in soils. , 2001, Journal of environmental radioactivity.

[12]  Wayne G. Landis,et al.  Regional Ecological Risk Assessment of a Near Shore Marine Environment: Cherry Point, WA , 2004 .

[13]  Zhenyao Shen,et al.  Eutrophication Risk Assessment , 2013 .

[14]  Hwong-Wen Ma Stochastic multimedia risk assessment for a site with contaminated groundwater , 2002 .

[15]  D. Richards,et al.  Understanding uncertainty , 2012, Evidence-Based Dentistry.

[16]  Guohe Huang,et al.  Characterizing Uncertainties Associated with Contaminant Transport Modeling through a Coupled Fuzzy-Stochastic Approach , 2009 .

[17]  Claus Rinner,et al.  Dealing with Uncertainties , 2015 .

[18]  Mark A. J. Huijbregts,et al.  Framework for modelling data uncertainty in life cycle inventories , 2001 .

[19]  L. Herborg,et al.  A qualitative biological risk assessment for vase tunicate Ciona intestinalis in Canadian waters: using expert knowledge , 2008 .

[20]  D. Benford,et al.  Risk assessment of dietary exposure to methylmercury in fish in the UK , 2007, Human & experimental toxicology.

[21]  Jerzy Bartnicki,et al.  A framework for error analysis of a long-range transport model with emphasis on parameter uncertainty , 1987 .

[22]  S. Holm,et al.  Chloroform mode of action: implications for cancer risk assessment. , 1997, Regulatory toxicology and pharmacology : RTP.

[23]  G. Huang,et al.  Health risks from arsenic-contaminated soil in Flin Flon-Creighton, Canada: integrating geostatistical simulation and dose-response model. , 2009, Environmental pollution.

[24]  M. Barron,et al.  Retrospective and Current Risks of Mercury to Panthers in the Florida Everglades , 2004, Ecotoxicology.

[25]  T. C. M. De Nijs,et al.  Dutch risk assessment system for new chemicals : DRANC , 1993 .

[26]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[27]  Tomas Öberg,et al.  Comparing Deterministic and Probabilistic Risk Assessments. A case study at a closed steel mill in southern Sweden (7 pp) , 2006 .

[28]  A. Stirling,et al.  Opening Up the Politics of Knowledge and Power in Bioscience , 2012, PLoS biology.

[29]  Craig A. Stow,et al.  Eutrophication risk assessment using Bayesian calibration of process-based models : application to a mesotrophic lake , 2007 .

[30]  M. E. Stephens,et al.  Deriving parameter probability density functions , 1993 .

[31]  Julie E Goodman,et al.  An Updated Weight of the Evidence Evaluation of Reproductive and Developmental Effects of Low Doses of Bisphenol A , 2006, Critical reviews in toxicology.

[32]  D. M. Rasmuson,et al.  Uncertainties in Nuclear Probabilistic Risk Analyses , 1984 .

[33]  Igor Linkov,et al.  Sources of uncertainty in model predictions: lessons learned from the IAEA Forest and Fruit Working Group model intercomparisons. , 2005, Journal of environmental radioactivity.

[34]  M. Youngb,et al.  Effects of fire on fish populations : landscape perspectives on persistence of native fishes and nonnative fish invasions , 2003 .

[35]  Didier Dubois,et al.  Joint propagation of variability and imprecision in assessing the risk of groundwater contamination. , 2007, Journal of contaminant hydrology.

[36]  Katherine E Kapo,et al.  A Geographic Information Systems–based, weights‐of‐evidence approach for diagnosing aquatic ecosystem impairment , 2006, Environmental toxicology and chemistry.

[37]  Joseph Fiksel Quantitative risk analysis for toxic chemicals in the environment , 1985 .

[38]  W. Landis,et al.  A Regional Retrospective Assessment of the Potential Stressors Causing the Decline of the Cherry Point Pacific Herring Run , 2004 .

[39]  P. Howe,et al.  Do estuaries pose a toxic contamination risk for wading birds? , 2009, Ecotoxicology.

[40]  Dale Hattis,et al.  Uncertainties in Risk Assessment , 1993 .

[41]  Jon C. Helton,et al.  Quantification of margins and uncertainties: Example analyses from reactor safety and radioactive waste disposal involving the separation of aleatory and epistemic uncertainty , 2011, Reliab. Eng. Syst. Saf..

[42]  S. Gayler,et al.  Modelling the Environmental Fate of the Herbicide Glyphosate in Soil Lysimeters , 2008 .

[43]  A. Fargašová Ecological Risk Assessment Framework , 2016 .

[44]  Vikas Kumar,et al.  Partitioning total variance in risk assessment: Application to a municipal solid waste incinerator , 2009, Environ. Model. Softw..

[45]  Elizabeth J. Kelly,et al.  Separating Variability and Uncertainty in Environmental Risk Assessment—Making Choices , 2000 .

[46]  J. Fuhrer Ozone risk for crops and pastures in present and future climates , 2009, Naturwissenschaften.

[47]  William Ernst,et al.  The Aquatic Environment and Textile Mill Effluents — An Ecological Risk Assessment , 2003 .

[48]  W. Walker,et al.  Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support , 2003 .

[49]  Keith Beven,et al.  Flood frequency estimation by continuous simulation of subcatchment rainfalls and discharges with the aim of improving dam safety assessment in a large basin in the Czech Republic , 2004 .

[50]  S. Samuels THE UNCERTAINTY FACTOR , 1981, Annals of the New York Academy of Sciences.

[51]  Andres J. Ramirez,et al.  A taxonomy of uncertainty for dynamically adaptive systems , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[52]  M. Kandlikar,et al.  Health risk assessment for nanoparticles: A case for using expert judgment , 2006 .

[53]  G. Leaves Guidelines for Environmental Risk Assessment and Management , 2011 .

[54]  Martina Bocci,et al.  The assessment of sediment screening risk in Venice Lagoon and other coastal areas using international sediment quality guidelines , 2007 .

[55]  Tahir Husain,et al.  GreenPro-I: a risk-based life cycle assessment and decision-making methodology for process plant design , 2002, Environ. Model. Softw..

[56]  Alex J Sutton,et al.  Interspecies extrapolation in environmental exposure standard setting: A Bayesian synthesis approach. , 2009, Regulatory toxicology and pharmacology : RTP.

[57]  Xu Zhang,et al.  Sensitivity of key factors and uncertainties in health risk assessment of benzene pollutant. , 2007, Journal of environmental sciences.

[58]  Michael Dourson,et al.  Data considerations for regulation of water contaminants. , 2006, Toxicology.

[59]  Yves Laberge,et al.  Simulating nature: a philosophical study of computer-simulation uncertainties and their role in climate science and policy advice , 2013 .

[60]  S. Faucheux,et al.  Decision-making under environmental uncertainty , 1995 .

[62]  James E. Campbell,et al.  Application of generic risk assessment software to radioactive waste disposal , 1990 .

[63]  J. Ham,et al.  Estimating the Microbial Risk of E. coli in Reclaimed Wastewater Irrigation on Paddy Field , 2007, Environmental monitoring and assessment.

[64]  M. E. Meek,et al.  Approach to health risk determination for metals and their compounds under the Canadian Environmental Protection Act. , 1995, Regulatory toxicology and pharmacology : RTP.

[65]  A. Havelaar,et al.  Assessment of the risk of infection associated with Coxsackie B viruses in drinking water , 2002 .

[66]  Jon C. Helton,et al.  Treatment of Uncertainty in Performance Assessments for Complex Systems , 1994 .

[67]  Alessio Ishizaka,et al.  Multi-criteria decision analysis , 2013 .

[68]  Robert V. O'Neill,et al.  A Regional Approach to Projecting Land-Use Change and Resulting Ecological Vulnerability , 2004, Environmental monitoring and assessment.

[69]  Frank Stagnitti,et al.  Quantitative Microbial Risk Assessment Models for Consumption of Raw Vegetables Irrigated with Reclaimed Water , 2006, Applied and Environmental Microbiology.

[70]  Paul Amyotte,et al.  Subsea Release of Oil from a Riser: An Ecological Risk Assessment , 2008, Risk analysis : an official publication of the Society for Risk Analysis.

[71]  Christina Kluge,et al.  Data Reduction And Error Analysis For The Physical Sciences , 2016 .

[72]  Peter A. Vanrolleghem,et al.  Uncertainty in the environmental modelling process - A framework and guidance , 2007, Environ. Model. Softw..

[73]  Elizabeth A. Casman,et al.  Elicitation of Expert Judgments of Uncertainty in the Risk Assessment of Herbicide‐Tolerant Oilseed Crops , 2004, Risk analysis : an official publication of the Society for Risk Analysis.

[74]  Carl D. Shapiro,et al.  Adaptive management: The U.S. Department of the Interior technical guide , 2009 .

[75]  W. Landis,et al.  Developing A Regional Ecological Risk Assessment: A Case Study of a Tasmanian Agricultural Catchment , 2001 .

[76]  A. Petersen Simulating Nature: A Philosophical Study of Computer-Simulation Uncertainties and Their Role in Climate Science and Policy Advice, Second Edition , 2007 .

[77]  F. O. Hoffman,et al.  Propagation of uncertainty in risk assessments: the need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability. , 1994, Risk analysis : an official publication of the Society for Risk Analysis.

[78]  Juraj Hromkovic Design and Analysis of Randomized Algorithms - Introduction to Design Paradigms , 2005, Texts in Theoretical Computer Science. An EATCS Series.

[79]  Fu‐Chun Wu,et al.  Second-order Monte Carlo uncertainty/variability analysis using correlated model parameters: application to salmonid embryo survival risk assessment , 2004 .

[80]  Valery E. Forbes,et al.  Applying Weight-of-Evidence in Retrospective Ecological Risk Assessment When Quantitative Data Are Limited , 2002 .

[81]  C Pahl-Wostl,et al.  Integrated management of natural resources: dealing with ambiguous issues, multiple actors and diverging frames. , 2005, Water science and technology : a journal of the International Association on Water Pollution Research.

[82]  R. Scholz,et al.  Possibilities and limitations of modeling environmental exposure to engineered nanomaterials by probabilistic material flow analysis , 2010, Environmental toxicology and chemistry.

[83]  Mark E. Borsuk,et al.  Assessing the decline of brown trout (Salmo trutta) in Swiss rivers using a Bayesian probability network , 2006 .

[84]  Hwong-Wen Ma,et al.  Combining the cost of reducing uncertainty with the selection of risk assessment models for remediation decision of site contamination. , 2007, Journal of hazardous materials.

[85]  Willy P Aspinall,et al.  Evidence-based volcanology: application to eruption crises , 2003 .

[86]  R Fairman,et al.  Environmental Risk Assessment: Approaches, Experiences and Information Sources , 1998 .

[87]  M. Crane,et al.  Estimation of demographic toxicity through the double bootstrap. , 2003, Water research.

[88]  K. Krishnan,et al.  Derivation of Biomonitoring Equivalents for cyfluthrin. , 2009, Regulatory toxicology and pharmacology : RTP.

[89]  Dtl Shek,et al.  Future research challenges , 2016 .

[90]  Roy Brouwer,et al.  Integrated modelling of risk and uncertainty underlying the cost and effectiveness of water quality measures , 2008, Environ. Model. Softw..

[91]  B. Merz,et al.  Flood risk curves and uncertainty bounds , 2009 .

[92]  P. John Risk assessment models and uncertainty estimation of groundwater contamination from point sources , 2016 .

[93]  B. Fischhoff,et al.  Assessing uncertainty in physical constants , 1986 .

[94]  P H Abelson,et al.  Health risk assessment. , 1993, Regulatory toxicology and pharmacology : RTP.

[95]  P. Keur,et al.  Identification of Major Sources of Uncertainty in Current IWRM Practice. Illustrated for the Rhine Basin , 2008 .

[96]  J L Chandler,et al.  Environmental risk assessment. , 1986, Bioessays.

[97]  William Leiss Assessing and managing risks , 1992 .

[98]  M. B. Beck,et al.  Water quality modeling: A review of the analysis of uncertainty , 1987 .

[99]  Antonio Marcomini,et al.  A spatial risk assessment methodology to support the remediation of contaminated land. , 2008, Environment international.

[100]  H Scherm,et al.  Simulating uncertainty in climate-pest models with fuzzy numbers. , 2000, Environmental pollution.

[101]  Rikke Bagger Jørgensen,et al.  The variability of processes involved in transgene dispersal—case studies from Brassica and related genera , 2009, Environmental science and pollution research international.

[102]  Lawrence K. Duffy,et al.  Multi-generation health risks of persistent organic pollution in the far north: use of the precautionary approach in the Stockholm Convention , 2003 .

[103]  Jerome R. Ravetz,et al.  Uncertainty and Quality in Science for Policy , 1990 .

[104]  Georgia Destouni,et al.  Propagation of water pollution uncertainty and risk from the subsurface to the surface water system of a catchment , 2009 .

[105]  Lawrence D. Lemke,et al.  Partitioned multiobjective risk modeling of carcinogenic compounds in groundwater , 2009 .

[106]  Augusto Cesar,et al.  Integrative ecotoxicological assessment of sediment in Portmán Bay (southeast Spain). , 2009, Ecotoxicology and environmental safety.

[107]  D. Macdonald,et al.  Applications of Numerical Sediment Quality Targets for Assessing Sediment Quality Conditions in a US Great Lakes Area of Concern , 2003, Environmental management.

[108]  Vincent Kanade,et al.  Clustering Algorithms , 2021, Wireless RF Energy Transfer in the Massive IoT Era.

[109]  Gordon H. Huang,et al.  An integrated fuzzy-stochastic modeling approach for risk assessment of groundwater contamination. , 2007, Journal of environmental management.

[110]  Hamdi El-Ghonemy,et al.  Treatment of uncertainty and developing conceptual models for environmental risk assessments and radioactive waste disposal safety cases. , 2005, Environment international.

[111]  V. Adriaenssens,et al.  Uncertainty in ecological status assessments of lakes and rivers using diatoms , 2009, Hydrobiologia.

[112]  P. Swuste,et al.  Evaluating the Control Banding Nanotool: a qualitative risk assessment method for controlling nanoparticle exposures , 2009 .

[113]  Glenn W Suter,et al.  Why and how to combine evidence in environmental assessments: weighing evidence and building cases. , 2011, The Science of the total environment.

[114]  M. Huijbregts,et al.  Spatial variability and uncertainty in ecological risk assessment: a case study on the potential risk of cadmium for the little owl in a Dutch river flood plain. , 2005, Environmental science & technology.

[115]  Thomas Braunbeck,et al.  A fuzzy logic-classification of sediments based on data from in vitro biotests , 2009 .

[116]  Ivan Valiela,et al.  Assessing Uncertainty in Estimates of Nitrogen Loading to Estuaries for Research, Planning, and Risk Assessment , 2000 .

[117]  Peter M Chapman,et al.  Determining when contamination is pollution - weight of evidence determinations for sediments and effluents. , 2007, Environment international.

[118]  K. P. Phillips,et al.  Assessing and Managing Risks Arising from Exposure to Endocrine-Active Chemicals , 2008, Journal of toxicology and environmental health. Part B, Critical reviews.

[119]  Erik Lebret,et al.  Dealing with uncertainties in environmental burden of disease assessment , 2009, Environmental health : a global access science source.

[120]  Curtis J. Richardson,et al.  Integrating Bioassessment and Ecological Risk Assessment: An Approach to Developing Numerical Water-Quality Criteria , 2003, Environmental management.

[121]  Masahiro Doi,et al.  Challenging the current strategy of radiological protection of the environment: arguments for an ecosystem approach. , 2009, Journal of environmental radioactivity.

[122]  S. Dyer,et al.  Occurrence and weight-of-evidence risk assessment of alkyl sulfates, alkyl ethoxysulfates, and linear alkylbenzene sulfonates (LAS) in river water and sediments. , 2006, The Science of the total environment.

[123]  Jon C. Helton,et al.  Quantification of Margins and Uncertainties , 2011, Reliab. Eng. Syst. Saf..

[124]  V Berding,et al.  Aquatic fate assessment of the polycyclic musk fragrance HHCB. Scenario and variability analysis in accordance with the EU risk assessment guidelines. , 2000, Chemosphere.

[125]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[126]  Wellesley Site,et al.  What is an Ecological Risk Assessment ? , 2004 .

[127]  M. E. Meek,et al.  1,3-Butadiene: Exposure Estimation, Hazard Characterization, and Exposure-Response Analysis , 2003, Journal of toxicology and environmental health. Part B, Critical reviews.

[128]  Alexander B. Sideridis,et al.  Assessing Wildfire Destruction Danger: a Decision Support System Incorporating Uncertainty , 2005 .

[129]  D Copplestone,et al.  Addressing uncertainties in the ERICA Integrated Approach. , 2008, Journal of environmental radioactivity.

[130]  Holger R. Maier,et al.  Future research challenges for incorporation of uncertainty in environmental and ecological decision-making , 2008 .

[131]  Bruce C. Larson,et al.  A fuzzy set approach to the problem of sustainability , 1999 .

[132]  Guohe Huang,et al.  A Fuzzy-Set Approach for Addressing Uncertainties in Risk Assessment of Hydrocarbon-Contaminated Site , 2006 .

[133]  E. Talbott,et al.  An updated weight of evidence approach to the aquatic hazard assessment of Bisphenol A and the derivation a new predicted no effect concentration (Pnec) using a non-parametric methodology. , 2011, The Science of the total environment.

[134]  T. Madarász,et al.  Risk assessment of groundwater pollution using sensitivity analysis and a worst-case scenario analysis , 2006 .

[135]  Tom Beer,et al.  Ecological Risk Assessment and Quantitative Consequence Analysis , 2006 .

[136]  Christel Prudhomme,et al.  Uncertainty and climate change impact on the flood regime of small UK catchments , 2003 .

[137]  J. Ravetz,et al.  RIVM / MNP Guidance for Uncertainty Assessment and Communication : Tool Catalogue for Uncertainty Assessment , 2004 .

[138]  L. Parrella,et al.  Managing Uncertainty in Risk-Based Corrective Action Design: Global Sensitivity Analysis of Contaminant Fate and Exposure Models Used in the Dose Assessment , 2009 .

[139]  Gary L Diamond,et al.  Application of a Probabilistic Risk Assessment Methodology to a Lead Smelter Site , 1999 .

[140]  J. Rose,et al.  Quantitative Microbial Risk Assessment , 1999 .

[141]  Rinus Plasmeijer,et al.  Eco-SpaCE: an object-oriented, spatially explicit model to assess the risk of multiple environmental stressors on terrestrial vertebrate populations. , 2010, The Science of the total environment.

[142]  Igor Linkov,et al.  Multi-criteria decision analysis and environmental risk assessment for nanomaterials , 2007 .

[143]  B. Wynne Uncertainty and environmental learning: reconceiving science and policy in the preventive paradigm. , 1992 .

[144]  Dagmar Haase,et al.  A multicriteria approach for flood risk mapping exemplified at the Mulde river, Germany , 2009 .

[145]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[146]  Guohe Huang,et al.  An integrated fuzzy-stochastic modeling approach for assessing health-impact risk from air pollution , 2008 .

[147]  Helen M. Regan,et al.  A TAXONOMY AND TREATMENT OF UNCERTAINTY FOR ECOLOGY AND CONSERVATION BIOLOGY , 2002 .

[148]  James D. Brown Knowledge, uncertainty and physical geography: towards the development of methodologies for questioning belief , 2004 .

[149]  Holger R. Maier,et al.  Uncertainty in Environmental Decision Making: Issues, Challenges and Future Directions , 2008 .

[150]  Hwong‐wen Ma,et al.  The Health Risk assessment of Pb and Cr leached from fly ash monolith landfill. , 2009, Journal of hazardous materials.

[151]  C. Liao,et al.  Predictive risk thresholds for survival protection of farmed abalone, Haliotis diversicolor supertexta, exposed to waterborne zinc , 2005, Environmental toxicology.

[152]  Frank Batzias,et al.  A novel system for environmental monitoring through a cooperative/synergistic scheme between bioindicators and biosensors. , 2007, Journal of environmental management.

[153]  Silvia Torresan,et al.  Development of a site-specific ecological risk assessment for contaminated sites: part I. A multi-criteria based system for the selection of ecotoxicological tests and ecological observations. , 2007, The Science of the total environment.

[154]  S. Hacon,et al.  Mercury exposure through fish consumption in the urban area of Alta Floresta in the Amazon Basin , 1997 .

[155]  Anthony J. Jakeman,et al.  Integrated assessment of water resources: Australian experiences , 2006 .

[156]  T. A. DelValls,et al.  A weight of evidence approach to assess sediment quality in the Guadalquivir estuary , 2007 .

[157]  Mads Troldborg,et al.  Risk assessment models and uncertainty estimation of groundwater contamination from point sources , 2010 .

[158]  J. Culp,et al.  A research strategy for using stream microcosms in ecotoxicology: Integrating experiments at different levels of biological organization with field data , 2000 .

[159]  Asit P. Basu,et al.  Probabilistic Risk Analysis , 2002 .

[160]  Richard Wilson Risk analysis , 1986, Nature.

[161]  Igor Linkov,et al.  Weight-of-evidence evaluation in environmental assessment: review of qualitative and quantitative approaches. , 2009, The Science of the total environment.

[162]  Igor Linkov,et al.  Multi-Criteria Decision Analysis: Environmental Applications and Case Studies , 2011 .

[163]  R. Benson,et al.  Health effect levels for risk assessment of childhood exposure to arsenic. , 2004, Regulatory toxicology and pharmacology : RTP.

[164]  Andrew Stirling,et al.  Risk at a turning point , 1998 .

[165]  Dongrui Wu,et al.  Fuzzy experts on recreational vessels, a risk modelling approach for marine invasions , 2010 .

[166]  Blair G. Mc Donald,et al.  Improving the Use of Toxicity Reference Values in Wildlife Food Chain Modeling and Ecological Risk Assessment , 2003 .

[167]  Daniel A. Rodriguez,et al.  Tradeoffs in incremental changes towards pedestrian-friendly environments: Physical activity and pollution exposure , 2009 .

[168]  UniKL Bis Integrated Case Study , 2016 .