Assessing the effectiveness of different visualizations for judgments of positional uncertainty

Many techniques have been proposed for visualizing uncertainty in geospatial data. Previous empirical research on the effectiveness of visualizations of geospatial uncertainty has focused primarily on user intuitions rather than objective measures of performance when reasoning under uncertainty. Framed in the context of Google’s blue dot, we examined the effectiveness of four alternative visualizations for representing positional uncertainty when reasoning about self-location data. Our task presents a mobile mapping scenario in which GPS satellite location readings produce location estimates with varying levels of uncertainty. Given a known location and two smartphone estimates of that known location, participants were asked to judge which smartphone produces the better location reading, taking uncertainty into account. We produced visualizations that vary by glyph type (uniform blue circle with border vs. Gaussian fade) and visibility of a centroid dot (visible vs. not visible) to produce the four visualization formats. Participants viewing the uniform blue circle are most likely to respond in accordance with the actual probability density of points sampled from bivariate normal distributions and additionally respond most rapidly. Participants reported a number of simple heuristics on which they based their judgments, and consistency with these heuristics was highly predictive of their judgments.

[1]  Alan M. MacEachren,et al.  How to Assess Visual Communication of Uncertainty? A Systematic Review of Geospatial Uncertainty Visualisation User Studies , 2014 .

[2]  Paul A. Zandbergen,et al.  Comparison of WiFi positioning on two mobile devices , 2012, J. Locat. Based Serv..

[3]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[4]  P. Todd,et al.  Environments That Make Us Smart , 2007 .

[5]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[6]  Chris Cornelis,et al.  Rough Sets and Intelligent Systems Paradigms , 2014, Lecture Notes in Computer Science.

[7]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[8]  Nahum D. Gershon Visualization of an Imperfect World , 1998, IEEE Computer Graphics and Applications.

[9]  Igor Drecki,et al.  Visualisation of Uncertainty in Geographical Data , 2002 .

[10]  Alan M. MacEachren,et al.  VISUALIZING UNCERTAIN INFORMATION , 1992 .

[11]  M. Ehlers,et al.  A framework for the modelling of uncertainty between remote sensing and geographic information systems , 2000 .

[12]  A. K. Bregt,et al.  Spatial Data Quality , 2008, Encyclopedia of GIS.

[13]  Michael Peter Kennedy The Global Positioning System and GIS , 1996 .

[14]  Hu Li,et al.  A 3D Fingerprinting Positioning Method Based on Cellular Networks , 2014, Int. J. Distributed Sens. Networks.

[15]  B. Buttenfield,et al.  Guidelines for the Display of Attribute Certainty , 2000 .

[16]  Jihyuk Choi,et al.  Secure Location Verification Using Simultaneous Multilateration , 2012, IEEE Transactions on Wireless Communications.

[17]  Alex T. Pang,et al.  Glyphs for Visualizing Uncertainty in Vector Fields , 1996, IEEE Trans. Vis. Comput. Graph..

[18]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[19]  Yunlong Teng,et al.  A closed-form formula to calculate geometric dilution of precision (GDOP) for multi-GNSS constellations , 2016, GPS Solutions.

[20]  Lucy Bastin,et al.  Evaluating the Perception of Uncertainty in Alternative Visualization Strategies , 2000, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[21]  Katherine McCoy,et al.  Information and Persuasion: Rivals or Partners? , 2000, Design Issues.

[22]  Qi Huang,et al.  Mathematical minimum of Geometric Dilution of Precision (GDOP) for dual-GNSS constellations , 2016 .

[23]  Harvey S. Smallman,et al.  Naïve Realism: Limits of Realism as a Display Principle , 2005 .

[24]  G. Gigerenzer Gut Feelings: The Intelligence of the Unconscious , 2007 .

[25]  Paul A. Zandbergen,et al.  Accuracy of iPhone Locations: A Comparison of Assisted GPS, WiFi and Cellular Positioning , 2009 .

[26]  David Howard,et al.  Interface Design for Geographic Visualization: Tools for Representing Reliability , 1996 .

[27]  H. Smallman,et al.  Choosing and using geospatial displays: effects of design on performance and metacognition. , 2012, Journal of experimental psychology. Applied.

[28]  M. Wing,et al.  Consumer-Grade Global Positioning System (GPS) Accuracy and Reliability , 2005 .

[29]  Ulrich Bareth Privacy-aware and energy-efficient geofencing through reverse cellular positioning , 2012, 2012 8th International Wireless Communications and Mobile Computing Conference (IWCMC).

[30]  A. Bröder,et al.  Take the best versus simultaneous feature matching: probabilistic inferences from memory and effects of representation format. , 2003, Journal of experimental psychology. General.

[31]  Artur Janowski,et al.  Mobile Indicators in GIS and GPS Positioning Accuracy in Cities , 2014, RSEISP.

[32]  Penny Rheingans,et al.  Point-based probabilistic surfaces to show surface uncertainty , 2004, IEEE Transactions on Visualization and Computer Graphics.

[33]  Mark Gahegan,et al.  Visualizing Geospatial Information Uncertainty: What We Know and What We Need to Know , 2005 .

[34]  Lucy Bastin,et al.  Visualizing uncertainty in multi-spectral remotely sensed imagery , 2002 .

[35]  Sarah H. Creem-Regehr,et al.  The influence of different graphical displays on nonexpert decision making under uncertainty. , 2015, Journal of experimental psychology. Applied.

[36]  Mark Gahegan,et al.  Visual Semiotics & Uncertainty Visualization: An Empirical Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[37]  Mark Gahegan,et al.  A typology for visualizing uncertainty , 2005, IS&T/SPIE Electronic Imaging.