Visualization approaches for understanding uncertainty in flow diagrams

Abstract Business Intelligence applications often handle data sets that contain uncertain values. In this contribution, we focus on product costing, which deals with the average costs of product components – that vary significantly based on many factors such as inflation, exchange rates, and commodity prices. After experts estimate the uncertainty information for single items, decision makers need to quickly ascertain the cost uncertainties within the hierarchical data structure of the complete product. We propose that only a holistic visualization containing both data and uncertainty can provide this kind of quick overview. Such a visualization must be able to visualize tree data structures associated with value attributes. After conducting interviews with product costing experts, we focused on Flow diagrams, which fulfill this basic requirement. However, they need to be extended in order to directly incorporate uncertainty information. We investigated three visualization techniques applicable to the ribbons of Flow diagrams to convey uncertainty information: Color-code, Gradient, and Margin. Moreover, we designed five visual approaches to show the uncertainty on nodes of Flow diagrams that we evaluated with visualization experts. The approaches add different geometries to the nodes such as triangles, blocks, or forks. The preferred solutions for the nodes was adding forks or filled blocks. With regards to the ribbons, we contribute a user study involving the solution of different product costing tasks using the three different visualizations. Although Gradient was considered an intuitive choice to show uncertainty, it yielded the highest error rates. In contrast, Color-code and Margin were superior depending on the performed task. Based on these findings and the subjective feedback, we designed an integrated approach that combines elements from all three distinct techniques and applied it to Sankey diagrams and Parallel sets.

[1]  Alan M. MacEachren,et al.  VISUALIZING UNCERTAIN INFORMATION , 1992 .

[2]  Silvia Miksch,et al.  Visual Encodings of Temporal Uncertainty: A Comparative User Study , 2016, IEEE Transactions on Visualization and Computer Graphics.

[3]  Bongshin Lee,et al.  Revealing Uncertainty for Information Visualization , 2010, Inf. Vis..

[4]  Chris R. Johnson,et al.  A Next Step: Visualizing Errors and Uncertainty , 2003, IEEE Computer Graphics and Applications.

[5]  Alan M. MacEachren,et al.  Visualizing Georeferenced Data: Representing Reliability of Health Statistics , 1998 .

[6]  Rainer Groh,et al.  Mirroring Sankey Diagrams for Visual Comparison Tasks , 2018, VISIGRAPP.

[7]  Alex T. Pang,et al.  Glyphs for Visualizing Uncertainty in Vector Fields , 1996, IEEE Trans. Vis. Comput. Graph..

[8]  Penny Rheingans,et al.  NIH-NSF visualization research challenges report summary , 2006, IEEE Computer Graphics and Applications.

[9]  Holger Eichelberger,et al.  Nice class diagrams admit good design? , 2003, SoftVis '03.

[10]  M. Sheelagh T. Carpendale,et al.  Visualization of Uncertainty in Lattices to Support Decision-Making , 2007, EuroVis.

[11]  Lucy Bastin,et al.  Evaluating the Perception of Uncertainty in Alternative Visualization Strategies , 2000, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[12]  Danny Holten,et al.  Hierarchical Edge Bundles: Visualization of Adjacency Relations in Hierarchical Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[13]  William Meckling,et al.  Predictability of the Costs, Time, and Success of Development , 1962 .

[14]  R. Kosara,et al.  Parallel sets: visual analysis of categorical data , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[15]  Matthew O. Ward,et al.  Exploratory Visualization of Multivariate Data with Variable Quality , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[16]  Mark Gahegan,et al.  A typology for visualizing uncertainty , 2005, IS&T/SPIE Electronic Imaging.

[17]  Penny Rheingans,et al.  Procedural annotation of uncertain information , 2000 .

[18]  Michael Gleicher,et al.  Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error , 2014, IEEE Transactions on Visualization and Computer Graphics.

[19]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[20]  P. Riehmann,et al.  Interactive Sankey diagrams , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[21]  Ross Brown,et al.  A Spreadsheet Approach to Facilitate Visualization of Uncertainty in Information , 2008, IEEE Transactions on Visualization and Computer Graphics.

[22]  Hans-Jörg Schulz,et al.  On Establishing Visualization Requirements: A Case Study in Product Costing , 2017, EuroVis.

[23]  Michael F. Goodchild,et al.  Visualizing spatial data uncertainty using animation , 1997 .

[24]  Suresh K. Lodha,et al.  VERITY VISUALIZATION: VISUAL MAPPINGS , 1995 .

[25]  Barry N. Taylor,et al.  Guidelines for Evaluating and Expressing the Uncertainty of Nist Measurement Results , 2017 .

[26]  Mary Czerwinski,et al.  CandidTree: visualizing structural uncertainty in similar hierarchies , 2007 .

[27]  Jock D. Mackinlay,et al.  Visualizing data with bounded uncertainty , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[28]  Keith C. Clarke,et al.  Testing Popular Visualization Techniques for Representing Model Uncertainty , 2003 .

[29]  Limor Nadav-Greenberg,et al.  Uncertainty Forecasts Improve Decision Making Among Nonexperts , 2009 .

[30]  Alex T. Pang,et al.  UFLOW: visualizing uncertainty in fluid flow , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[31]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[32]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs: State‐of‐the‐Art and Future Research Challenges , 2011, Eurographics.

[33]  Nahum D. Gershon Visualization of an Imperfect World , 1998, IEEE Computer Graphics and Applications.

[34]  Rainer Groh,et al.  Visualizing uncertainty in flow diagrams: a case study in product costing , 2017, VINCI.

[35]  Tobias Isenberg,et al.  Evaluating Sketchiness as a Visual Variable for the Depiction of Qualitative Uncertainty , 2012, IEEE Transactions on Visualization and Computer Graphics.

[36]  Heidrun Schumann,et al.  The Visualization of Uncertain Data: Methods and Problems , 2006, SimVis.

[37]  Ross Brown Animated visual vibrations as an uncertainty visualisation technique , 2004, GRAPHITE '04.

[38]  Lisa Singh,et al.  Visualizing node attribute uncertainty in graphs , 2011, Electronic Imaging.

[39]  Helwig Hauser,et al.  Parallel Sets: interactive exploration and visual analysis of categorical data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[40]  Mark Gahegan,et al.  Visualizing Geospatial Information Uncertainty: What We Know and What We Need to Know , 2005 .

[41]  Alexander Toet,et al.  The Perception of Visual UncertaintyRepresentation by Non-Experts , 2014, IEEE Transactions on Visualization and Computer Graphics.