Guidance in the human-machine analytics process

In this paper, we list the goals for and the pros and cons of guidance, and we discuss the role that it can play not only in key low-level visualization tasks but also the more sophisticated model-generation tasks of visual analytics. Recent advances in artificial intelligence, particularly in machine learning, have led to high hopes regarding the possibilities of using automatic techniques to perform some of the tasks that are currently done manually using visualization by data analysts. However, visual analytics remains a complex activity, combining many different subtasks. Some of these tasks are relatively low-level, and it is clear how automation could play a role—for example, classification and clustering of data. Other tasks are much more abstract and require significant human creativity, for example, linking insights gleaned from a variety of disparate and heterogeneous data artifacts to build support for decision making. In this paper, we outline the potential applications of guidance, as well as the inputs to guidance. We discuss challenges in implementing guidance, including the inputs to guidance systems and how to provide guidance to users. We propose potential methods for evaluating the quality of guidance at different phases in the analytic process and introduce the potential negative effects of guidance as a source of bias in analytic decision making.

[1]  Ulrik Brandes,et al.  Quality Metrics for Information Visualization , 2018, Comput. Graph. Forum.

[2]  Alan J. Dix,et al.  A Taxonomy of Clutter Reduction for Information Visualisation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[3]  Marcus A. Magnor,et al.  Automated Analytical Methods to Support Visual Exploration of High-Dimensional Data , 2011, IEEE Transactions on Visualization and Computer Graphics.

[4]  Silvia Miksch,et al.  The Role of Explicit Knowledge: A Conceptual Model of Knowledge-Assisted Visual Analytics , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[5]  Jonathan C. Roberts,et al.  Storyboarding for visual analytics , 2015, Inf. Vis..

[6]  Min Chen,et al.  An Information-theoretic Framework for Visualization , 2010, IEEE Transactions on Visualization and Computer Graphics.

[7]  Hanspeter Pfister,et al.  Commercial Visual Analytics Systems–Advances in the Big Data Analytics Field , 2019, IEEE Transactions on Visualization and Computer Graphics.

[8]  Daniel A. Keim,et al.  Knowledge Generation Model for Visual Analytics , 2014, IEEE Transactions on Visualization and Computer Graphics.

[9]  Cristina Conati,et al.  When to Adapt: Detecting User's Confusion During Visualization Processing , 2013, UMAP Workshops.

[10]  Tim Dwyer,et al.  Network Visualization as a Higher-Order Visual Analysis Tool , 2016, IEEE Computer Graphics and Applications.

[11]  N. Karssemeijer,et al.  An automatic method to discriminate malignant masses from normal tissue in digital mammograms1 , 2000, Physics in medicine and biology.

[12]  Chris North,et al.  A comparison of benchmark task and insight evaluation methods for information visualization , 2011, Inf. Vis..

[13]  Prateek Panwar,et al.  Detecting Negative Emotion for Mixed Initiative Visual Analytics , 2018, CHI Extended Abstracts.

[14]  V. Rajesh,et al.  Brain tumour detection using mean shift clustering and GLCM features with edge adaptive total variation denoising technique , 2018 .

[15]  Yujie Liu,et al.  Evaluating exploratory visualization systems: A user study on how clustering-based visualization systems support information seeking from large document collections , 2013, Inf. Vis..

[16]  Mark S. Hancock,et al.  Metatation: Annotation as Implicit Interaction to Bridge Close and Distant Reading , 2017, ACM Trans. Comput. Hum. Interact..

[17]  Klaus Mueller,et al.  Learning Visualizations by Analogy: Promoting Visual Literacy through Visualization Morphing , 2015, IEEE Transactions on Visualization and Computer Graphics.

[18]  Robert Harper,et al.  Stories in GeoTime , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[19]  Cristina Conati,et al.  Eye Tracking to Understand User Differences in Visualization Processing with Highlighting Interventions , 2014, UMAP.

[20]  John T. Stasko,et al.  Lightweight task/application performance using single versus multiple monitors: a comparative study , 2008, Graphics Interface.

[21]  Randall P. White TOWARD A DEEPER UNDERSTANDING OF THE ROLE OF TRUSTED LEADERSHIP ADVISOR, AND KNOWING IF YOU ARE READY FOR IT , 2017 .

[22]  Jeffrey Heer,et al.  Multi-Scale Banking to 45 Degrees , 2006, IEEE Transactions on Visualization and Computer Graphics.

[23]  Alexander Lex,et al.  From Visual Exploration to Storytelling and Back Again , 2016, bioRxiv.

[24]  Silvia Miksch,et al.  Characterizing Guidance in Visual Analytics , 2017, IEEE Transactions on Visualization and Computer Graphics.

[25]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[26]  Alex Endert,et al.  Warning, Bias May Occur: A Proposed Approach to Detecting Cognitive Bias in Interactive Visual Analytics , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[27]  Matthias Klapperstück,et al.  ContextuWall: Multi-site collaboration using display walls , 2017, J. Vis. Lang. Comput..

[28]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[29]  Chris North,et al.  Immersive Human-Centered Computational Analytics , 2018, Immersive Analytics.

[30]  Rafael Veras,et al.  Optimizing Hierarchical Visualizations with the Minimum Description Length Principle , 2017, IEEE Transactions on Visualization and Computer Graphics.

[31]  Scott Barlowe,et al.  Click2Annotate: Automated Insight Externalization with rich semantics , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[32]  Kazjon Grace,et al.  Surprise Me If You Can: Serendipity in Health Information , 2018, CHI.

[33]  Jun Wang,et al.  Visual Causality Analysis Made Practical , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[34]  Christopher G. Healey,et al.  Interest Driven Navigation in Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[35]  Jean-Daniel Fekete,et al.  Suggested Interactivity: Seeking Perceived Affordances for Information Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[36]  Jian Zhao,et al.  Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[37]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[38]  Derek Bridge,et al.  Diversity, Serendipity, Novelty, and Coverage , 2016, ACM Trans. Interact. Intell. Syst..

[39]  Michelle X. Zhou,et al.  Characterizing Users' Visual Analytic Activity for Insight Provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[40]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[41]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[42]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[43]  Jarke J. van Wijk,et al.  Views on Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[44]  Enrico Bertini,et al.  Quality Metrics in High-Dimensional Data Visualization: An Overview and Systematization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[45]  Tamara Munzner,et al.  A Nested Model for Visualization Design and Validation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[46]  Jason Dykes,et al.  An Extensible Framework for Provenance in Human Terrain Visual Analytics , 2013, IEEE Transactions on Visualization and Computer Graphics.

[47]  Jonathan C. Roberts,et al.  Multisensory Immersive Analytics , 2018, Immersive Analytics.

[48]  KaminskasMarius,et al.  Diversity, Serendipity, Novelty, and Coverage , 2016 .

[49]  Alex Endert,et al.  Augmenting Visualizations with Interactive Data Facts to Facilitate Interpretation and Communication , 2019, IEEE Transactions on Visualization and Computer Graphics.

[50]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[51]  Alex Endert,et al.  Finding Waldo: Learning about Users from their Interactions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[52]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[53]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[54]  Mouzhi Ge,et al.  Beyond accuracy: evaluating recommender systems by coverage and serendipity , 2010, RecSys '10.

[55]  Alexander W. Skaburskis,et al.  The Sandbox for analysis: concepts and methods , 2006, CHI.

[56]  Daniel A. Keim,et al.  Viewing Visual Analytics as Model Building , 2018, Comput. Graph. Forum.

[57]  Ross T. Smith,et al.  Situated Analytics , 2018, Immersive Analytics.

[58]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[59]  T. J. Jankun-Kelly,et al.  Analytic Provenance for Sensemaking: A Research Agenda , 2015, IEEE Computer Graphics and Applications.

[60]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[61]  M. Sheelagh T. Carpendale,et al.  Critical InfoVis: exploring the politics of visualization , 2013, CHI Extended Abstracts.

[62]  Kang Zhang,et al.  Teaching Information Aesthetics as a Research Class in China , 2015, IEEE Computer Graphics and Applications.

[63]  Kanit Wongsuphasawat,et al.  Voyager 2: Augmenting Visual Analysis with Partial View Specifications , 2017, CHI.

[64]  Fatih Korkmaz,et al.  Feedback-driven interactive exploration of large multidimensional data supported by visual classifier , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[65]  David H. Laidlaw,et al.  Colorgorical: Creating discriminable and preferable color palettes for information visualization , 2017, IEEE Transactions on Visualization and Computer Graphics.

[66]  Jeffrey Heer,et al.  Scented Widgets: Improving Navigation Cues with Embedded Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[67]  Jarke J. van Wijk,et al.  Evaluation: A Challenge for Visual Analytics , 2013, Computer.