Sensitivity to weighting in life cycle impact assessment (LCIA)

Weighting in life cycle assessment (LCA) incorporates stakeholder preferences in the decision-making process of comparative LCAs. Research efforts on this topic are concerned with deriving weights according to different principles, but few studies have evaluated the relationship between normalization and weights and their effect on single scores. We evaluate the sensitivity of aggregation methods to weights in different life cycle impact assessment (LCIA) methods to provide insight on the receptiveness of single score results to value systems. Sensitivity to weights in two LCIA methods is assessed by exploring weight spaces stochastically and evaluating the rank of alternatives via the Rank Acceptability Index (RAI). We assess two aggregation methods: a weighted sum based on externally normalized scores and a method of internal normalization based on outranking across CML-IA and ReCipE midpoint impact assessment. The RAI represents the likelihood that an alternative occupies a certain rank given all possible weight spaces, and it can be used to compare the sensitivity of final ranks to weight values in each aggregation method and LCIA. Evaluation is based on a case study of a comparative LCA of five PV technologies whose inventory is readily available in Ecoinvent. Influence of weights in single scores depend on the scaling/normalization step more than the value of the weight itself. In each LCIA, aggregated results from a weighted sum with external normalization references show a higher weight insensitivity in RAI than outranking-based aggregation because in the former, results are driven by a few dominant impact categories due to the normalization procedure. Differences in sensitivity are caused by the notable variety (up two orders of magnitude) in the scales of normalized values for the weighted sum with external normalization and intrinsic properties of the methods including compensation and a lack of accounting for mutual differences. Contrary to the belief that the choice of weights is decisive in aggregation of LCIA results, in this case study, it is shown that the normalization step has the greatest influence in the results. This point holds for EU and World references in ReCiPe and CML-IA alike. Aggregation consisting of outranking generates rank orderings with a more balanced contribution of impact categories and sensitivity to weights’ values as opposed to weighted sum approaches that rely on external normalization references. Practitioners aiming to include stakeholder values in single scores for LCIA should be aware of how the weights are treated in the aggregation method as to ensure proper representation of values.

[1]  Gregory M Peters,et al.  Aggregating sustainability indicators: beyond the weighted sum. , 2012, Journal of environmental management.

[2]  Thomas P. Seager,et al.  Letter to the Editor on “Weighting and Aggregation in Life Cycle Assessment: Do Present Aggregated Single Scores Provide Correct Decision Support?” , 2017 .

[3]  S. Greco,et al.  On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness , 2019 .

[4]  Mark Carty,et al.  Reducing bias through process inventory dataset normalization , 2010 .

[5]  Luis C. Dias,et al.  Integrating life-cycle assessment and multi-criteria decision analysis to compare alternative biodiesel chains , 2016, Ann. Oper. Res..

[6]  Hans-Jürgen Dr. Klüppel,et al.  The Revision of ISO Standards 14040-3 - ISO 14040: Environmental management – Life cycle assessment – Principles and framework - ISO 14044: Environmental management – Life cycle assessment – Requirements and guidelines , 2005 .

[7]  Koji Tokimatsu,et al.  Development of weighting factors for G20 countries—explore the difference in environmental awareness between developed and emerging countries , 2018, The International Journal of Life Cycle Assessment.

[8]  Rana Pant,et al.  A distance-to-target weighting method for Europe 2020 , 2016, The International Journal of Life Cycle Assessment.

[9]  Thomas P. Seager,et al.  Novel Method of Sensitivity Analysis Improves the Prioritization of Research in Anticipatory Life Cycle Assessment of Emerging Technologies. , 2018, Environmental science & technology.

[10]  Virginia H. Dale,et al.  Normalization in sustainability assessment: Methods and implications , 2016 .

[11]  Nathan Pollesch,et al.  Applications of aggregation theory to sustainability assessment , 2015 .

[12]  Stefanie Hellweg,et al.  LCIA framework and cross-cutting issues guidance within the UNEP-SETAC Life Cycle Initiative. , 2017, Journal of cleaner production.

[13]  Luis C. Dias,et al.  Robust multi-criteria weighting in comparative LCA and S-LCA: A case study of sugarcane production in Brazil , 2019, Journal of Cleaner Production.

[14]  Magnus Bengtsson,et al.  Weighting in LCA – approaches and applications , 2000 .

[15]  Pekka Leskinen,et al.  Impact of normalisation, elicitation technique and background information on panel weighting results in life cycle assessment , 2014, The International Journal of Life Cycle Assessment.

[16]  Pascal Lesage,et al.  The application of the pedigree approach to the distributions foreseen in ecoinvent v3 , 2016, The International Journal of Life Cycle Assessment.

[17]  Reinout Heijungs,et al.  Bias in normalization: Causes, consequences, detection and remedies , 2007 .

[18]  Jane C. Bare,et al.  Life cycle assessment capacity roadmap (section 1): decision-making support using LCA , 2016, The International Journal of Life Cycle Assessment.

[19]  Ana Krstić,et al.  Figueira, J., Greco, S., Ehrgott, M.: Multicriteria Decision Analysis: State of the art Surveys, Springer-Verlag, New York, NY, 2016 , 2018 .

[20]  G. Norris The requirement for congruence in normalization , 2001 .

[21]  Thomas P. Seager,et al.  Energy management under policy and technology uncertainty , 2012 .

[22]  S. Greco,et al.  Stochastic multi-attribute acceptability analysis (SMAA): an application to the ranking of Italian regions , 2018 .

[23]  Marco Cinelli,et al.  Analysis of the potentials of multi criteria decision analysis methods to conduct sustainability assessment , 2014 .

[24]  Massimo Pizzol,et al.  Normalisation and weighting in life cycle assessment: quo vadis? , 2017, The International Journal of Life Cycle Assessment.

[25]  T. Seager,et al.  Stochastic multi-attribute analysis (SMAA) as an interpretation method for comparative life-cycle assessment (LCA) , 2014, The International Journal of Life Cycle Assessment.

[26]  B. Weidema,et al.  Monetary valuation in Life Cycle Assessment: a review , 2015 .

[27]  Laan van Westenenk,et al.  Improvement of LCA characterization factors and LCA practice for metals , 2004 .

[28]  Thomas P. Seager,et al.  Interpretation of comparative LCAs: external normalization and a method of mutual differences , 2017, The International Journal of Life Cycle Assessment.

[29]  Yohay Carmel,et al.  Uses and Misuses of Multicriteria Decision Analysis (MCDA) in Environmental Decision Making , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[30]  Ralph L. Keeney,et al.  Common Mistakes in Making Value Trade-Offs , 2002, Oper. Res..

[31]  Reinout Heijungs,et al.  Implementation of stochastic multi attribute analysis (SMAA) in comparative environmental assessments , 2018, Environ. Model. Softw..

[32]  Thomas P Seager,et al.  Environmental decision-making using life cycle impact assessment and stochastic multiattribute decision analysis: a case study on alternative transportation fuels. , 2009, Environmental science & technology.

[33]  Love Ekenberg,et al.  State-of-the-Art Prescriptive Criteria Weight Elicitation , 2012, Adv. Decis. Sci..

[34]  Petra Zapp,et al.  Life Cycle Sustainability Assessment of rare earth permanent magnets , 2016 .

[35]  José Rui Figueira,et al.  The SMAA-PROMETHEE method , 2014, Eur. J. Oper. Res..

[36]  Martin Rogers,et al.  Choosing realistic values of indifference, preference and veto thresholds for use with environmental criteria within ELECTRE , 1998, Eur. J. Oper. Res..

[37]  C. Ingrao,et al.  Criteria Interaction Modelling In The Framework Of Lca Analysis , 2013 .

[38]  Luis C. Dias,et al.  Applying Multi-Criteria Decision Analysis to the Life-Cycle Assessment of vehicles , 2015 .

[39]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[40]  Bo Pedersen Weidema,et al.  Commission Recommendation on the use ofcommon methods to measure and communicate the life cycle environmental performanceof products and organisations , 2013 .

[41]  Tong Wang,et al.  A Novel Method , 2020, ArXiv.

[42]  Jo Dewulf,et al.  Multi criteria sustainability assessment of biogas production in Kenya , 2012 .

[43]  Ian F. C. Smith,et al.  A multi-criteria decision framework to support measurement-system design for bridge load testing , 2019, Adv. Eng. Informatics.

[44]  Taehoon Hong,et al.  New Internet search volume-based weighting method for integrating various environmental impacts , 2016 .

[45]  Pradip P. Kalbar,et al.  Life cycle based dynamic assessment coupled with multiple criteria decision analysis: A case study of determining an optimal building insulation level , 2017 .

[46]  J. Figueira,et al.  A note on the paper, “Ranking irregularities when evaluating alternatives by using some ELECTRE methods”, by Wang and Triantaphyllou, Omega (2008) , 2009 .

[47]  Göran Finnveden,et al.  Weighting and valuation in selected environmental systems analysis tools - suggestions for further developments , 2011 .

[48]  Edgar G. Hertwich,et al.  A Theoretical Foundation for Life‐Cycle Assessment , 2000 .

[49]  Reza Baradaran Kazemzadeh,et al.  PROMETHEE: A comprehensive literature review on methodologies and applications , 2010, Eur. J. Oper. Res..

[50]  David J. Weiss,et al.  SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement , 2008 .

[51]  Mekki Terbeche,et al.  An Allocation Scheme for Estimating the Reliability of a Parallel-Series System , 2012, Adv. Decis. Sci..

[52]  Thomas P. Seager,et al.  Integration of MCDA Tools in Valuation of Comparative Life Cycle Assessment , 2012 .

[53]  Mary Ann Curran,et al.  Life Cycle Assessment Handbook: A Guide for Environmentally Sustainable Products , 2012 .

[54]  Tommi Tervonen,et al.  Implementing stochastic multicriteria acceptability analysis , 2007, Eur. J. Oper. Res..

[55]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[56]  Serenella Sala,et al.  Hotspots analysis and critical interpretation of food life cycle assessment studies for selecting eco-innovation options and for policy support , 2017 .

[57]  David W. Macdonald,et al.  Exploring a safe operating approach to weighting in life cycle impact assessment – a case study of organic, conventional and integrated farming systems , 2012 .

[58]  Guilherme Marcelo Zanghelini,et al.  How Multi-Criteria Decision Analysis (MCDA) is aiding Life Cycle Assessment (LCA) in results interpretation , 2018 .

[59]  Zoran Obradovic,et al.  A robust data scaling algorithm to improve classification accuracies in biomedical data , 2016, BMC Bioinformatics.

[60]  Tommi Tervonen,et al.  A stochastic multicriteria model for evidence‐based decision making in drug benefit‐risk analysis , 2011, Statistics in medicine.

[61]  Gjalt Huppes,et al.  Weighting environmental effects: Analytic survey with operational evaluation methods and a meta-method , 2012, The International Journal of Life Cycle Assessment.

[62]  Sangwon Suh,et al.  The Importance of Normalization References in Interpreting Life Cycle Assessment Results , 2013 .

[63]  Giuseppe Munda,et al.  Multiple Criteria Decision Analysis and Sustainable Development , 2005 .

[64]  Sheizaf Rafaeli,et al.  A Conceptual Framework for Visualizing Composite Indicators , 2019 .

[65]  Jeroen B. Guinee,et al.  Handbook on life cycle assessment operational guide to the ISO standards , 2002 .

[66]  Pradip P. Kalbar,et al.  Weighting and Aggregation in Life Cycle Assessment: Do Present Aggregated Single Scores Provide Correct Decision Support? , 2017 .

[67]  B. Roy Méthodologie multicritère d'aide à la décision , 1985 .

[68]  Matthias Ehrgott,et al.  Multiple Criteria Decision Analysis , 2016 .

[69]  Thomas P. Seager,et al.  Normalization in Comparative Life Cycle Assessment to Support Environmental Decision Making , 2017 .

[70]  G. W. Fischer Range Sensitivity of Attribute Weights in Multiattribute Value Models , 1995 .