Evaluating the impact of visualization of wildfire hazard upon decision-making under uncertainty

ABSTRACT The paper investigates whether the methods chosen for representing uncertain geographic information aid or impair decision-making in the context of wildfire hazard. Through a series of three human subject experiments, utilizing 180 subjects and employing increasingly difficult tasks, this research evaluates the effect of five different visualizations and a text-based representation on decision-making under uncertainty. Our quantitative experiments focus specifically on the task of decision-making under uncertainty, rather than the task of reading levels of uncertainty from the map. To guard against the potential for generosity and risk seeking in decision-making under uncertainty, the experimental design uses performance-based incentives. The experiments showed that the choice of representation makes little difference to performance in cases where subjects are allowed the time and focus to consider their decisions. However, with the increasing difficulty of time pressure, subjects performed best using a spectral color hue-based representation, rather than more carefully designed cartographic representations. Text-based and simplified boundary encodings were among the worst performers. The results have implications for the performance of decision-making under uncertainty using static maps, especially in the stressful environments surrounding an emergency.

[1]  Alan M. MacEachren,et al.  Visualizing Georeferenced Data: Representing Reliability of Health Statistics , 1998 .

[2]  M. Monmonier How to Lie with Maps , 1991 .

[3]  Ann M. Bisantz,et al.  Comparing Uncertainty Visualizations for a Dynamic Decision-Making Task , 2011 .

[4]  R. Hertwig,et al.  Experimental practices in economics: A methodological challenge for psychologists? , 2001, Behavioral and Brain Sciences.

[5]  David Howard,et al.  Interface Design for Geographic Visualization: Tools for Representing Reliability , 1996 .

[6]  Adrienne Grêt-Regamey,et al.  Visualization of uncertainty in natural hazards assessments using an interactive cartographic information system , 2011 .

[7]  Keith C. Clarke,et al.  Testing Popular Visualization Techniques for Representing Model Uncertainty , 2003 .

[8]  Daniel C. Cliburn,et al.  Design and evaluation of a decision support system in a water balance application , 2002, Comput. Graph..

[9]  Susan Bell Trickett,et al.  Visualizing Uncertainty , 2014, Hum. Factors.

[10]  Lawrence G. Shattuck,et al.  Tactical Decision Making under Conditions of Uncertainty: An Empirical Study , 2009 .

[11]  Lucy Bastin,et al.  Evaluating the Perception of Uncertainty in Alternative Visualization Strategies , 2000, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[12]  D. Collett,et al.  Modelling Binary Data , 1991 .

[13]  Ferjan Ormeling,et al.  Visualization of Data Quality , 1994 .

[14]  Susan S. Kirschenbaum,et al.  Effects of Graphic and Verbal Probability Information on Command Decision Making , 1994 .

[15]  G. Loewenstein,et al.  A Bias in the Prediction of Tastes , 1995 .

[16]  Beverley J. Evans,et al.  Dynamic display of spatial data-reliability: does it benefit the map user? , 1997 .

[17]  Rajeev Sharma,et al.  Human-GIS interaction issues in crisis response , 2006 .

[18]  Richard T. Stone,et al.  Visual Representations of Meta-Information , 2009 .

[19]  P. Fisher Visualizing Uncertainty in Soil Maps by Animation , 1993 .

[20]  Jeffrey D Myers,et al.  The Influence of Uncertain Map Features on Risk Beliefs and Perceived Ambiguity for Maps of Modeled Cancer Risk from Air Pollution , 2013, Risk analysis : an official publication of the Society for Risk Analysis.

[21]  S. Hope,et al.  Testing the effects of positional uncertainty on spatial decision‐making , 2007, Int. J. Geogr. Inf. Sci..

[22]  Göran Falkman,et al.  Effects of visualizing uncertainty on decision-making in a target identification scenario , 2014, Comput. Graph..

[23]  M. St John,et al.  Tactical Decision-Making Under Uncertainty: Experiments I and II , 2000 .

[24]  John Krygier,et al.  Sound and Geographic Visualization , 1994 .

[25]  Myke Gluck,et al.  Focus groups for design improvement in dynamic cartography , 1994 .

[26]  Robin P. Cubitt,et al.  Dynamic Choice and the Common Ratio Effect: An Experimental Investigation , 1998 .

[27]  P. Fisher Hearing the Reliability In Classified Remotely Sensed Images , 1994 .

[28]  Alan M. MacEachren,et al.  How to Assess Visual Communication of Uncertainty? A Systematic Review of Geospatial Uncertainty Visualisation User Studies , 2014 .

[29]  Colin Ware,et al.  Visual Thinking for Design , 2008 .

[30]  QuispelAnnemarie,et al.  Would you prefer pie or cupcakes? Preferences for data visualization designs of professionals and laypeople in graphic design , 2014 .

[31]  Alan M. MacEachren,et al.  Visualization in modern cartography , 1994 .

[32]  Alan M. MacEachren,et al.  VISUALIZING UNCERTAIN INFORMATION , 1992 .

[33]  Guillaume Caumon,et al.  Adjacent versus coincident representations of geospatial uncertainty: Which promote better decisions? , 2011, Comput. Geosci..

[34]  Cynthia A. Brewer,et al.  Evaluation of Methods for Classifying Epidemiological Data on Choropleth Maps in Series , 2002 .

[35]  Arko Lucieer,et al.  Interactive and visual fuzzy classification of remotely sensed imagery for exploration of uncertainty , 2004, Int. J. Geogr. Inf. Sci..

[36]  David R. Cox The analysis of binary data , 1970 .

[37]  Alex Pang,et al.  Visualizing Uncertainty in Geo-spatial Data , 2001 .

[38]  David Borland,et al.  Rainbow Color Map (Still) Considered Harmful , 2007, IEEE Computer Graphics and Applications.

[39]  Matthew McGranaghan A Cartographic View of Spatial Data Quality , 1993 .

[40]  V. Smith,et al.  Monetary rewards and decision cost in experimental economics , 2000 .

[41]  Donald H. House,et al.  Visualizing Uncertainty in Predicted Hurricane Tracks , 2013 .

[42]  Robert M. Edsall,et al.  The Influence of Uncertainty Visualization on Decision Making: An Empirical Evaluation , 2006 .

[43]  Charles A. Holt,et al.  Risk Aversion and Incentive Effects , 2002 .

[44]  Kevin G. Tolhurst,et al.  Phoenix: Development and Application of a Bushfire Risk Management Tool , 2008 .

[45]  Mark Gahegan,et al.  Visual Semiotics & Uncertainty Visualization: An Empirical Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[46]  Nick Bearman,et al.  Using sound to represent uncertainty in UKCP09 data with Google Maps API , 2013 .

[47]  Kevin D. Ash,et al.  Tornado warning trade-offs: evaluating choices for visually communicating risk , 2014 .

[48]  Ann M. Bisantz,et al.  Utilizing Graphical Formats to Convey Uncertainty in a Decision Making Task , 2000 .

[49]  Bang Wong,et al.  Points of view: Heat maps , 2012, Nature Methods.

[50]  A. B. Markman,et al.  Choice output and choice processing: An analogy to similarity , 2001, Behavioral and Brain Sciences.

[51]  Gary J. Hunter,et al.  Testing the Effects of Thematic Uncertainty on Spatial Decision-making , 2007 .

[52]  Robin P. Cubitt,et al.  Experimental Economics: Rethinking the Rules , 2009 .

[53]  Ann M. Bisantz,et al.  Displaying Uncertainty: Investigating the Effects of Display Format and Specificity , 2005, Hum. Factors.

[54]  B. Buttenfield,et al.  Guidelines for the Display of Attribute Certainty , 2000 .

[55]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[56]  Sergey Fomin,et al.  Using Virtual Environment Systems During the Emergency Prevention, Preparedness, Response and Recovery Phases , 2008 .

[57]  B. Buttenfield Representing Data Quality , 1993 .

[58]  Patrick J. Bartlein,et al.  The end of the rainbow? Color schemes for improved data graphics , 2004 .

[59]  Edward Gibson,et al.  The Nature of Working Memory in Linguistic, Arithmetic and Spatial Integration Processes. , 2007 .

[60]  Siyka Zlatanova,et al.  Geospatial Information Technology for Emergency Response , 2009 .

[61]  R. Hertwig,et al.  Economists' and psychologists' experimental practices : How they differ, why they differ, and how they could converge , 2003 .

[62]  Suresh K. Lodha,et al.  LISTEN: sounding uncertainty visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[63]  V. Smith Papers in experimental economics , 1991 .

[64]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .

[65]  Anthony D. Andre,et al.  Displaying Uncertainty in Advanced Navigation Systems , 1998 .