Uses and Misuses of Multicriteria Decision Analysis (MCDA) in Environmental Decision Making

We focus on a class of multicriteria methods that are commonly used in environmental decision making--those that employ the weighted linear average algorithm (and this includes the popular analytic hierarchy process (AHP)). While we do not doubt the potential benefits of using formal decision methods of this type, we draw attention to the consequences of not using them well. In particular, we highlight a property of these methods that should not be overlooked when they are applied in environmental and wider decision-making contexts: the final decision or ranking of options is dependent on the choice of performance scoring scales for the criteria when the criteria weights are held constant. We compare this "sensitivity" to a well-known criticism of the AHP, and we go on to describe the more general lesson when it comes to using weighted linear average methods--a lesson concerning the relationship between criteria weights and performance scoring scales.

[1]  K. D. Rothley,et al.  DESIGNING BIORESERVE NETWORKS TO SATISFY MULTIPLE, CONFLICTING DEMANDS , 1999 .

[2]  M. Angelidis,et al.  A Rapid Decision-Making Method for the Evaluationof Pollution-Sensitive Coastal Areas in the Mediterranean Sea , 2005, Environmental management.

[3]  A. Ausseil,et al.  Rapid Mapping and Prioritisation of Wetland Sites in the Manawatu–Wanganui Region, New Zealand , 2007, Environmental management.

[4]  J. Duke,et al.  Identifying public preferences for land preservation using the analytic hierarchy process , 2002 .

[5]  M. Qureshi,et al.  A decision support process to compare riparian revegetation options in Scheu Creek catchment in north Queensland. , 2001, Journal of environmental management.

[6]  D. Rossiter.  Multiobjective Decision Support for Environmental Management , 1995 .

[7]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Luis A. Bojórquez-Tapia,et al.  Environmental conflicts and nature reserves: redesigning Sierra San Pedro Mártir National Park, Mexico , 2004 .

[9]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[10]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[11]  G. Herath.  Incorporating community objectives in improved wetland management: the use of the analytic hierarchy process. , 2004, Journal of environmental management.

[12]  Igor Linkov,et al.  Application of Multicriteria Decision Analysis Tools to Two Contaminated Sediment Case Studies , 2007, Integrated environmental assessment and management.

[13]  Stephen M. Redpath,et al.  Using Decision Modeling with Stakeholders to Reduce Human–Wildlife Conflict: a Raptor–Grouse Case Study , 2004 .

[14]  Helen M. Regan,et al.  Comprehensive criteria for biodiversity evaluation in conservation planning , 2007, Biodiversity and Conservation.

[15]  Wenjun Li,et al.  Designing the buffer zone of a nature reserve: a case study in Yancheng Biosphere Reserve, China , 1999 .

[16]  T. Saaty.  RANK GENERATION, PRESERVATION, AND REVERSAL IN THE ANALYTIC HIERARCHY DECISION PROCESS , 1987 .

[17]  E. Choo,et al.  Interpretation of criteria weights in multicriteria decision making , 1999 .

[18]  J. Dyer.  Remarks on the analytic hierarchy process , 1990 .

[19]  F. H. Barron,et al.  SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement , 1994 .

[20]  Patrick Meire,et al.  Multicriteria techniques in ecological evaluation: an example using the Analytical Hierarchy Process , 1989 .

[21]  Daniel L. Schmoldt,et al.  Developing inventory and monitoring programs based on multiple objectives , 1994 .

[22]  Sean Pascoe,et al.  Management Objective Importance in Fisheries: An Evaluation Using the Analytic Hierarchy Process (AHP) , 2004, Environmental management.

[23]  R. Sadiq,et al.  Evaluation of Generic Types of Drilling Fluid Using a Risk-Based Analytic Hierarchy Process , 2003, Environmental management.

[24]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[25]  David J. Weiss,et al.  SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement , 2008 .

[26]  Ron Janssen,et al.  Decision support for integrated wetland management , 2005, Environ. Model. Softw..

[27]  Ferdinando Villa,et al.  Zoning Marine Protected Areas through Spatial Multiple‐Criteria Analysis: the Case of the Asinara Island National Marine Reserve of Italy , 2002 .

[28]  E Ferguson,et al.  From comparative risk assessment to multi-criteria decision analysis and adaptive management: recent developments and applications. , 2006, Environment international.

[29]  Risto Lahdelma,et al.  Comparing multicriteria methods in the context of environmental problems , 1998 .

[30]  Alexander Moffett,et al.  Incorporating multiple criteria into the design of conservation area networks: a minireview with recommendations , 2006 .

[31]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[32]  David L. Debertin,et al.  Choosing between Alternative Farming Systems: An Application of the Analytic Hierarchy Process , 1996 .

[33]  V. Belton.  A comparison of the analytic hierarchy process and a simple multi-attribute value function , 1986 .

[34]  R Lahdelma,et al.  Using Multicriteria Methods in Environmental Planning and Management , 2000, Environmental management.