Interactive Visualization for Group Decision Analysis

Identifying the best solutions to large infrastructure decisions is a context-dependent multi-dimensional multi-stakeholder challenge in which competing objectives must be identified and trade-offs made. Our aim is to identify and explore features in an interactive visualization tool to help make group decision analysis more participatory, transparent, and comprehensible. We extended the interactive visualization tool ValueCharts to create Group ValueCharts. The new tool was introduced in two real-world scenarios in which stakeholders were in the midst of wrestling with decisions about infrastructure investment. We modeled the alternatives under consideration, for both scenarios, using prescribed criteria identified by domain experts. Participants in both groups were given instructions on how to use the tool to represent their preferences. Preferences for all participants were then displayed and discussed. The discussions were audio-recorded and the participants were surveyed to evaluate usability. The results indicate that participants felt the tool improved group interaction and information exchange and made the discussion more participatory. They expressed that visualizing individual preferences improved the ability to analyze decision outcomes based on everyone’s preferences. Additionally, the participants strongly concurred that the tool revealed disagreements and agreements and helped identify sticking points. These results suggest that a group decision tool that allows group members to input their individual preferences and then collectively probe into any differences makes the process of decision-making more participatory, transparent, and comprehensible and increases the quality and quantity of information exchange.

[1]  Claes Andersson,et al.  Societal systems – Complex or worse? , 2014 .

[2]  Erin Baker,et al.  Development of a Green Building Decision Support Tool: A Collaborative Process , 2009, Decis. Anal..

[3]  Susan G. Straus,et al.  ExpertLens: A System for Eliciting Opinions from a Large Pool of Non-Collocated Experts with Diverse Knowledge , 2011 .

[4]  J. Harris,et al.  Tackling Wicked Problems: Through the Transdisciplinary Imagination , 2010 .

[5]  Jay F. Nunamaker,et al.  GDSS Parameters and Benefits , 2008 .

[6]  Love Ekenberg,et al.  State-of-the-Art Prescriptive Criteria Weight Elicitation , 2012, Adv. Decis. Sci..

[7]  Pierre Dragicevic,et al.  Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[8]  Catholijn M. Jonker,et al.  Designing interfaces for explicit preference elicitation: a user-centered investigation of preference representation and elicitation process , 2011, User Modeling and User-Adapted Interaction.

[9]  Simon French,et al.  Comparison study of multi-attribute decision analytic software , 2005 .

[10]  Peter Reichert,et al.  Constructing, evaluating and visualizing value and utility functions for decision support , 2013, Environ. Model. Softw..

[11]  Raimo P. Hämäläinen,et al.  Participatory multicriteria decision analysis with Web-HIPRE: a case of lake regulation policy , 2004, Environ. Model. Softw..

[12]  Igor Linkov,et al.  Multi-criteria decision analysis in environmental sciences: ten years of applications and trends. , 2011, The Science of the total environment.

[13]  Theodor J. Stewart,et al.  Multiple Criteria Decision Analysis , 2001 .

[14]  Mark E. Borsuk,et al.  Concepts of decision support for river rehabilitation , 2007, Environ. Model. Softw..

[15]  D. Schweiger,et al.  Group Approaches for Improving Strategic Decision Making: A Comparative Analysis of Dialectical Inquiry, Devil's Advocacy, and Consensus , 1986 .

[16]  Luis C. Dias,et al.  Dealing with imprecise information in group multicriteria decisions: a methodology and a GDSS architecture , 2005, Eur. J. Oper. Res..

[17]  Yi Peng,et al.  A Group Decision Making Model for Integrating Heterogeneous Information , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Giuseppe Carenini,et al.  A Decision Support System for the Design and Evaluation of Sustainable Wastewater Solutions , 2014, IEEE Transactions on Computers.

[19]  Martin S. Schilling,et al.  How Effective Are Decision Analyses? Assessing Decision Process and Group Alignment Effects , 2007, Decis. Anal..

[20]  I. Linkov,et al.  Multicriteria Decision Analysis: A Comprehensive Decision Approach for Management of Contaminated Sediments , 2006, Risk analysis : an official publication of the Society for Risk Analysis.

[21]  Yang Chen,et al.  Pairwise comparison matrix in multiple criteria decision making , 2016 .

[22]  F. Woudenberg An Evaluation of Delphi , 1991 .

[23]  Gang Kou,et al.  Enhancing data consistency in decision matrix: Adapting Hadamard model to mitigate judgment contradiction , 2014, Eur. J. Oper. Res..

[24]  Steven Woloshin,et al.  Making sense of risk information on the web , 2003, BMJ : British Medical Journal.

[25]  N. Schuwirth,et al.  Methodological aspects of multi-criteria decision analysis for policy support: A case study on pharmaceutical removal from hospital wastewater , 2012, Eur. J. Oper. Res..

[26]  M. B. Beck,et al.  A New Planning and Design Paradigm to Achieve Sustainable Resource Recovery from Wastewater. , 2009, Environmental science & technology.

[27]  I. Lipkus Numeric, Verbal, and Visual Formats of Conveying Health Risks: Suggested Best Practices and Future Recommendations , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[28]  Pierre Dragicevic,et al.  Fair Statistical Communication in HCI , 2016 .

[29]  Raimo P. Hämäläinen,et al.  Multicriteria Decision Analysis in Group Decision Processes , 2010, Handbook of Group Decision and Negotiation.

[30]  Gang Kou,et al.  A group consensus model for evaluating real estate investment alternatives , 2016, Financial Innovation.

[31]  Ben Shneiderman,et al.  Querying event sequences by exact match or similarity search: Design and empirical evaluation , 2012, Interact. Comput..

[32]  Chih-Hung Wang,et al.  A multiattribute GDSS for aiding problem-solving , 2004 .

[33]  Mike Pearson,et al.  Visualizing Uncertainty About the Future , 2022 .

[34]  Hanspeter Pfister,et al.  LineUp: Visual Analysis of Multi-Attribute Rankings , 2013, IEEE Transactions on Visualization and Computer Graphics.

[35]  F. H. Barron,et al.  SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement , 1994 .