The Role of Explicit Knowledge: A Conceptual Model of Knowledge-Assisted Visual Analytics

Visual Analytics (VA) aims to combine the strengths of humans and computers for effective data analysis. In this endeavor, humans’ tacit knowledge from prior experience is an important asset that can be leveraged by both human and computer to improve the analytic process. While VA environments are starting to include features to formalize, store, and utilize such knowledge, the mechanisms and degree in which these environments integrate explicit knowledge varies widely. Additionally, this important class of VA environments has never been elaborated on by existing work on VA theory. This paper proposes a conceptual model of Knowledge-assisted VA conceptually grounded on the visualization model by van Wijk. We apply the model to describe various examples of knowledge-assisted VA from the literature and elaborate on three of them in finer detail. Moreover, we illustrate the utilization of the model to compare different design alternatives and to evaluate existing approaches with respect to their use of knowledge. Finally, the model can inspire designers to generate novel VA environments using explicit knowledge effectively.

[1]  Christopher Andrews,et al.  The human is the loop: new directions for visual analytics , 2014, Journal of Intelligent Information Systems.

[2]  Daniel A. Keim,et al.  Visual analytics: how much visualization and how much analytics? , 2010, SKDD.

[3]  Min Chen,et al.  An Analysis of Machine- and Human-Analytics in Classification , 2017, IEEE Transactions on Visualization and Computer Graphics.

[4]  Jarke J. van Wijk,et al.  The value of visualization , 2005, VIS 05. IEEE Visualization, 2005..

[5]  Denis Lalanne,et al.  Surveying the complementary role of automatic data analysis and visualization in knowledge discovery , 2009, VAKD '09.

[6]  Daniel A. Keim,et al.  Knowledge Generation Model for Visual Analytics , 2014, IEEE Transactions on Visualization and Computer Graphics.

[7]  David Gotz,et al.  Progressive Visual Analytics: User-Driven Visual Exploration of In-Progress Analytics , 2014, IEEE Transactions on Visualization and Computer Graphics.

[8]  M. Zeleny Management support systems: Towards integrated knowledge management , 1987 .

[9]  Michel Beaudouin-Lafon,et al.  Designing interaction, not interfaces , 2004, AVI.

[10]  Marielle Mokhtari,et al.  Visual tools for dynamic analysis of complex situations , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[11]  Jennifer E. Rowley,et al.  The wisdom hierarchy: representations of the DIKW hierarchy , 2007, J. Inf. Sci..

[12]  Klaus Mueller,et al.  KAV-DB : Towards a Framework for the Capture and Retrieval of Visualization Knowledge over the Web , 2010 .

[13]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[14]  Silvia Miksch,et al.  Qualizon graphs: space-efficient time-series visualization with qualitative abstractions , 2014, AVI.

[15]  Klaus Mueller,et al.  A high-dimensional feature clustering approach to support knowledge-assisted visualization , 2009, Comput. Graph..

[16]  Alex Endert,et al.  Finding Waldo: Learning about Users from their Interactions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[17]  Silvia Miksch,et al.  Gnaeus: Utilizing Clinical Guidelines for Knowledge-assisted Visualisation of EHR Cohorts , 2015, EuroVA@EuroVis.

[18]  R. Ackoff From Data to Wisdom , 2014 .

[19]  Alex Endert,et al.  Visualization by Demonstration: An Interaction Paradigm for Visual Data Exploration , 2017, IEEE Transactions on Visualization and Computer Graphics.

[20]  Shen-En Chen,et al.  An Interactive Visual Analytics System for Bridge Management , 2010, Comput. Graph. Forum.

[21]  Heidi Lam,et al.  A Framework of Interaction Costs in Information Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[22]  Silvia Miksch,et al.  Visual Analysis of Compliance with Clinical Guidelines , 2013, i-Know '13.

[23]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[24]  John Riedl,et al.  An operator interaction framework for visualization systems , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[25]  Min Chen,et al.  Ontologies in Biological Data Visualization , 2014, IEEE Computer Graphics and Applications.

[26]  Jarke J. van Wijk,et al.  VisPad: Integrating Visualization, Navigation and Synthesis , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[27]  William Ribarsky,et al.  Building and Applying a Human Cognition Model for Visual Analytics , 2009, Inf. Vis..

[28]  Alex Endert,et al.  Semantic Interaction for Visual Analytics: Toward Coupling Cognition and Computation , 2014, IEEE Computer Graphics and Applications.

[29]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[30]  Amin Hammad,et al.  Knowledge-assisted BIM-based visual analytics for failure root cause detection in facilities management , 2014 .

[31]  Alex Endert,et al.  Toward Theoretical Techniques for Measuring the Use of Human Effort in Visual Analytic Systems , 2017, IEEE Transactions on Visualization and Computer Graphics.

[32]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[33]  William Ribarsky,et al.  Defining and applying knowledge conversion processes to a visual analytics system , 2009, Comput. Graph..

[34]  Yuval Shahar,et al.  A Framework for Knowledge-Based Temporal Abstraction , 1997, Artif. Intell..

[35]  Silvia Miksch,et al.  Characterizing Guidance in Visual Analytics , 2017, IEEE Transactions on Visualization and Computer Graphics.

[36]  Gilles Venturini,et al.  VizAssist: an interactive user assistant for visual data mining , 2016, The Visual Computer.

[37]  William Ribarsky,et al.  The Human-Computer System: Towards an Operational Model for Problem Solving , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[38]  Daniel A. Keim,et al.  Mastering the Information Age - Solving Problems with Visual Analytics , 2010 .

[39]  Wolfgang Aigner,et al.  A knowledge-assisted visual malware analysis system: Design, validation, and reflection of KAMAS , 2016, Comput. Secur..

[40]  Markus Wagner,et al.  KAVAGait: Knowledge-Assisted Visual Analytics for Clinical Gait Analysis , 2017, IEEE Transactions on Visualization and Computer Graphics.

[41]  Min Chen,et al.  Data, Information, and Knowledge in Visualization , 2009, IEEE Computer Graphics and Applications.

[42]  Ebad Banissi,et al.  Knowledge Visualization Currents , 2013, Springer London.

[43]  Min Chen,et al.  From Web Data to Visualization via Ontology Mapping , 2008, Comput. Graph. Forum.

[44]  Edward Swing Prajna: Adding Automated Reasoning to the Visual- Analysis Process , 2010, IEEE Computer Graphics and Applications.

[45]  Chaomei Chen,et al.  Top 10 Unsolved Information Visualization Problems , 2005, IEEE Computer Graphics and Applications.

[46]  Stefan Bruckner,et al.  Smart super views — A knowledge-assisted interface for medical visualization , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[47]  Katharina Kaiser,et al.  CareCruiser: Exploring and visualizing plans, events, and effects interactively , 2011, 2011 IEEE Pacific Visualization Symposium.

[48]  Blaz Zupan,et al.  Knowledge-based data analysis and interpretation , 2006, Artif. Intell. Medicine.

[49]  Wolfgang Aigner,et al.  Comparative Evaluation of an Interactive Time‐Series Visualization that Combines Quantitative Data with Qualitative Abstractions , 2012, Comput. Graph. Forum.

[50]  Silvia Miksch,et al.  A Nested Workflow Model for Visual Analytics Design and Validation , 2016, BELIV '16.

[51]  Yuval Shahar,et al.  Intelligent visualization and exploration of time-oriented data of multiple patients , 2010, Artif. Intell. Medicine.

[52]  Min Chen,et al.  What May Visualization Processes Optimize? , 2015, IEEE Transactions on Visualization and Computer Graphics.

[53]  Yao Sun,et al.  RuleBender: integrated modeling, simulation and visualization for rule-based intracellular biochemistry , 2012, BMC Bioinformatics.

[54]  Min Chen,et al.  Empirically Measuring Soft Knowledge in Visualization , 2017, Comput. Graph. Forum.

[55]  Jesus J. Caban,et al.  A Grammar-based Approach for Modeling User Interactions and Generating Suggestions During the Data Exploration Process , 2017, IEEE Transactions on Visualization and Computer Graphics.

[56]  Ed Huai-hsin Chi Expressiveness of the data flow and data state models in visualization systems , 2002, AVI '02.

[57]  Silvia Miksch,et al.  Towards a Concept how the Structure of Time can Support the Visual Analytics Process , 2011, EuroVA@EuroVis.

[58]  Jock D. Mackinlay,et al.  The structure of the information visualization design space , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[59]  Silvana Quaglini,et al.  Graphical Representation of Life Paths to Better Convey Results of Decision Models to Patients , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[60]  Min Chen,et al.  Knowledge-Assisted Ranking: A Visual Analytic Application for Sports Event Data , 2016, IEEE Computer Graphics and Applications.

[61]  Bernard Kamsu-Foguem,et al.  User-centered visual analysis using a hybrid reasoning architecture for intensive care units , 2012, Decis. Support Syst..

[62]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[63]  Petra Perner Intelligent data analysis in medicine - Recent advances , 2006, Artif. Intell. Medicine.

[64]  Bertjan Broeksema,et al.  Decision Exploration Lab: A Visual Analytics Solution for Decision Management , 2013, IEEE Transactions on Visualization and Computer Graphics.

[65]  David J. Hand Intelligent Data Analysis: Issues and Opportunities , 1998, Intell. Data Anal..

[66]  Xiaohua Hu,et al.  A Visualization Model of Interactive Knowledge Discovery Systems and Its Implementations , 2003, Inf. Vis..

[67]  Silvia Miksch,et al.  Connecting time-oriented data and information to a coherent interactive visualization , 2004, CHI.

[68]  Ed H. Chi,et al.  A taxonomy of visualization techniques using the data state reference model , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[69]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[70]  Anastasia Bezerianos,et al.  Evolutionary Visual Exploration: Evaluation With Expert Users , 2013, Comput. Graph. Forum.

[71]  James Davey,et al.  Visual Analysis of Expert Systems for Smart Grid Monitoring , 2013, EuroVA@EuroVis.

[72]  Michael Thompson,et al.  A visual analytics approach to understanding care process variation and conformance , 2015, VAHC '15.

[73]  Hans Hagen,et al.  Collaborative visualization: Definition, challenges, and research agenda , 2011, Inf. Vis..

[74]  Michael Workman,et al.  An exploratory study of cognitive load in diagnosing patient conditions. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[75]  Worthy N. Martin,et al.  Human-computer interaction using eye-gaze input , 1989, IEEE Trans. Syst. Man Cybern..

[76]  Daniel A. Keim,et al.  Visual Analytics: Scope and Challenges , 2008, Visual Data Mining.

[77]  Silvia Miksch,et al.  CareVis: Integrated visualization of computerized protocols and temporal patient data , 2006, Artif. Intell. Medicine.

[78]  Guy Melançon,et al.  Studying propagation dynamics in networks through rule-based modeling , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).