The Effects of Mixed-Initiative Visualization Systems on Exploratory Data Analysis

The primary purpose of information visualization is to act as a window between a user and the data. Historically, this has been accomplished via a single-agent framework: the only decision-maker in the relationship between visualization system and analyst is the analyst herself. Yet this framework arose not from first principles, but a necessity. Before this decade, computers were limited in their decision-making capabilities, especially in the face of large, complex datasets and visualization systems. This paper aims to present the design and evaluation of a mixed-initiative system that aids the user in handling large, complex datasets and dense visualization systems. We demonstrate this system with a between-groups, two-by-two study measuring the effects of this mixed-initiative system on user interactions and system usability. We find little to no evidence that the adaptive system designed here has a statistically significant impact on user interactions or system usability. We discuss the implications of this lack of evidence and examine how the data suggests a promising avenue for further research.

[1]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[2]  Daniel A. Keim,et al.  Visual analytics: how much visualization and how much analytics? , 2010, SKDD.

[3]  Antonios Liapis,et al.  Mixed-initiative content creation , 2016 .

[4]  Ganesh S. Oak.  Information Visualization Introduction , 2022 .

[5]  Nicholas Gibbins,et al.  Towards a Theory of Analytical Behaviour: A Model of Decision-Making in Visual Analytics , 2019, HICSS.

[6]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[7]  Yingcai Wu,et al.  A Survey of Visual Analytics Techniques and Applications: State-of-the-Art Research and Future Challenges , 2013, Journal of Computer Science and Technology.

[8]  Cheng Deng,et al.  HindSight: Encouraging Exploration through Direct Encoding of Personal Interaction History , 2017, IEEE Transactions on Visualization and Computer Graphics.

[9]  Carl Gutwin,et al.  Target assistance for subtly balancing competitive play , 2011, CHI.

[10]  Ross Maciejewski,et al.  The State‐of‐the‐Art in Predictive Visual Analytics , 2017, Comput. Graph. Forum.

[11]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[12]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[13]  Antonios Liapis,et al.  Mixed-Initiative Creative Interfaces , 2017, CHI Extended Abstracts.

[14]  James J. Thomas,et al.  Defining Insight for Visual Analytics , 2009, IEEE Computer Graphics and Applications.

[15]  Dafna Shahaf,et al.  SOLVENT: A Mixed Initiative System for Finding Analogies between Research Papers , 2018, Proc. ACM Hum. Comput. Interact..

[16]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[17]  Jeffrey Heer,et al.  The Effects of Interactive Latency on Exploratory Visual Analysis , 2014, IEEE Transactions on Visualization and Computer Graphics.

[18]  Wenqiang Cui,et al.  Visual Analytics: A Comprehensive Overview , 2019, IEEE Access.

[19]  Michael Stonebraker,et al.  Beagle : Automated Extraction and Interpretation of Visualizations from the Web , 2017 .

[20]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[21]  Chris North,et al.  An insight-based methodology for evaluating bioinformatics visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[22]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[23]  Matthew Lease,et al.  Believe it or not: Designing a Human-AI Partnership for Mixed-Initiative Fact-Checking , 2018, UIST.

[24]  Robert E. Roth,et al.  An Empirically-Derived Taxonomy of Interaction Primitives for Interactive Cartography and Geovisualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[25]  Daniel A. Keim,et al.  Visual Analytics: Definition, Process, and Challenges , 2008, Information Visualization.

[26]  David Frohlich,et al.  MIXED INITIATIVE INTERACTION , 1991 .

[27]  Min Chen,et al.  VIS4ML: An Ontology for Visual Analytics Assisted Machine Learning , 2019, IEEE Transactions on Visualization and Computer Graphics.

[28]  Xiaojin Zhu,et al.  The Label Complexity of Mixed-Initiative Classifier Training , 2016, ICML.

[29]  Chris North,et al.  An Insight-Based Longitudinal Study of Visual Analytics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[30]  Björn Hartmann,et al.  Writing Reusable Code Feedback at Scale with Mixed-Initiative Program Synthesis , 2017, L@S.

[31]  Alex Endert,et al.  The State of the Art in Integrating Machine Learning into Visual Analytics , 2017, Comput. Graph. Forum.

[32]  YanYilin,et al.  A Survey on Deep Learning , 2018 .

[33]  Jarke J. van Wijk,et al.  The value of visualization , 2005, VIS 05. IEEE Visualization, 2005..

[34]  Denis Lalanne,et al.  Surveying the complementary role of automatic data analysis and visualization in knowledge discovery , 2009, VAKD '09.

[35]  Alex Endert,et al.  Podium: Ranking Data Using Mixed-Initiative Visual Analytics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[36]  Arjan Kuijper,et al.  Interaction Taxonomy for Tracking of User Actions in Visual Analytics Applications , 2014, Handbook of Human Centric Visualization.

[37]  Ben Shneiderman,et al.  Interactive Dynamics for Visual Analysis , 2012 .

[38]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[39]  Daniela D'Aloisi.  Mixed-Initiative Aspects in an Agent-Based System , 1997 .

[40]  Roman Garnett,et al.  Follow The Clicks: Learning and Anticipating Mouse Interactions During Exploratory Data Analysis , 2019, Comput. Graph. Forum.

[41]  Leilani Battle,et al.  Characterizing Exploratory Visual Analysis: A Literature Review and Evaluation of Analytic Provenance in Tableau , 2019, Comput. Graph. Forum.

[42]  Michelle X. Zhou,et al.  Characterizing Users' Visual Analytic Activity for Insight Provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[43]  Andrew Sears,et al.  Human-Computer Interaction: Design Issues, Solutions, and Applications , 2009 .

[44]  Mikkel Rønne Jakobsen,et al.  Interactive Visualizations on Large and Small Displays: The Interrelation of Display Size, Information Space, and Scale , 2013, IEEE Transactions on Visualization and Computer Graphics.

[45]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[46]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[47]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[48]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.