Sense-making strategies in explorative intelligence analysis of network evolutions

ABSTRACT Visualising how social networks evolve is important in intelligence analysis in order to detect and monitor issues, such as emerging crime patterns or rapidly growing groups of offenders. It remains an open research question how this type of information should be presented for visual exploration. To get a sense of how users work with different types of visualisations, we evaluate a matrix and a node-link diagram in a controlled thinking aloud study. We describe the sense-making strategies that users adopted during explorative and realistic tasks. Thereby, we focus on the user behaviour in switching between the two visualisations and propose a set of nine strategies. Based on a qualitative and quantitative content analysis we show which visualisation supports which strategy better. We find that the two visualisations clearly support intelligence tasks and that for some tasks the combined use is more advantageous than the use of an individual visualisation.

[1]  Atta Badii,et al.  The Automatic Identification and Prioritisation of Criminal Networks from Police Crime Data , 2008, EuroISI.

[2]  Michael Burch,et al.  The State of the Art in Visualizing Dynamic Graphs , 2014, EuroVis.

[3]  Ken Wakita,et al.  Interactive high-dimensional visualization of social graphs , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[4]  Guy Melançon,et al.  AniMatrix: A Matrix-Based Visualization of Software Evolution , 2014, 2014 Second IEEE Working Conference on Software Visualization.

[5]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[6]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[7]  Chris North,et al.  An insight-based methodology for evaluating bioinformatics visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[8]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[9]  P. John Clarkson,et al.  Matrices or Node-Link Diagrams: Which Visual Representation is Better for Visualising Connectivity Models? , 2006, Inf. Vis..

[10]  Gary Klein,et al.  Making Sense of Sensemaking 2: A Macrocognitive Model , 2006, IEEE Intelligent Systems.

[11]  Jean-Daniel Fekete,et al.  MatLink: Enhanced Matrix Visualization for Analyzing Social Networks , 2007, INTERACT.

[12]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[13]  Philippe Castagliola,et al.  A Comparison of the Readability of Graphs Using Node-Link and Matrix-Based Representations , 2004, IEEE Symposium on Information Visualization.

[14]  Jean-Daniel Fekete,et al.  Small MultiPiles: Piling Time to Explore Temporal Patterns in Dynamic Networks , 2015, Comput. Graph. Forum.

[15]  Gary Klein Seeing What Others Don't: The Remarkable Ways We Gain Insights , 2013 .

[16]  Margit Pohl,et al.  Using lag-sequential analysis for understanding interaction sequences in visualizations , 2016, Int. J. Hum. Comput. Stud..

[17]  Gary Klein,et al.  Making Sense of Sensemaking 1: Alternative Perspectives , 2006, IEEE Intelligent Systems.

[18]  Kwan-Liu Ma,et al.  Temporal Multivariate Networks , 2013, Multivariate Network Visualization.

[19]  Peter J. Passmore,et al.  Exploring the Challenges of Implementing Guidelines for the Design of Visual Analytics Systems , 2015 .

[20]  Lucy T. Nowell,et al.  Change blindness in information visualization: a case study , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[21]  Garry Robins,et al.  Social psychology and social networks: Individuals and social systems , 2008 .

[22]  Jean-Daniel Fekete,et al.  MatrixExplorer: a Dual-Representation System to Explore Social Networks , 2006, IEEE Transactions on Visualization and Computer Graphics.

[23]  Niklas Elmqvist,et al.  TimeMatrix: Analyzing Temporal Social Networks Using Interactive Matrix-Based Visualizations , 2010, Int. J. Hum. Comput. Interact..

[24]  Margit Pohl,et al.  Pep Up Your Time Machine: Recommendations for the Design of Information Visualizations of Time-Dependent Data , 2014, Handbook of Human Centric Visualization.

[25]  Richards J. Heuer,et al.  Structured Analytic Techniques for Intelligence Analysis , 2014 .

[26]  Matthew O. Ward,et al.  Information Visualization - Towards Multivariate Network Visualization (Dagstuhl Seminar 13201) , 2013, Dagstuhl Reports.

[27]  Xi Chen,et al.  Visual Analysis of Temporal Trends in Social Networks Using Edge Color Coding and Metric Timelines , 2011, 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing.

[28]  Hai-Ning Liang,et al.  Designing interfaces that support formation of cognitive maps of transitional processes: an empirical study , 2005, Interact. Comput..

[29]  Yoshihisa Kashima,et al.  Social psychology and social networks , 2008 .

[30]  Johanna Haider,et al.  Design for Intelligence Analysis of Complex Systems: Evolution of Criminal Networks , 2016, 2016 European Intelligence and Security Informatics Conference (EISIC).

[31]  Bin Zhu,et al.  Visualizing social network concepts , 2010, Decis. Support Syst..

[32]  Tobias Isenberg,et al.  Weighted graph comparison techniques for brain connectivity analysis , 2013, CHI.

[33]  Margit Pohl,et al.  How Analysts Think: Sense-making Strategies in the Analysis of Temporal Evolution and Criminal Network Structures and Activities , 2017 .

[34]  Valerie F. Reyna,et al.  Educating Intuition , 2015, Current directions in psychological science.

[35]  Hsinchun Chen,et al.  Criminal network analysis and visualization , 2005, CACM.

[36]  Michael E. Papka,et al.  Evaluating user behavior and strategy during visual exploration , 2014, BELIV.

[37]  Jean-Daniel Fekete,et al.  NodeTrix: a Hybrid Visualization of Social Networks , 2007, IEEE Transactions on Visualization and Computer Graphics.

[38]  Michael Burch,et al.  Edge-stacked Timelines for Visualizing Dynamic Weighted Digraphs , 2015, IVAPP.

[39]  Kamran Sedig,et al.  Transactions on Human-computer Interaction Thci Design for Complex Cognitive Activities with Visual Representations: a Pattern-based Approach Sedig and Parsons Interaction Design for Complex Cognitive Activities with Visualizations , 2022 .

[40]  Hai-Ning Liang,et al.  Supporting Sensemaking of Complex Objects with Visualizations: Visibility and Complementarity of Interactions , 2016, Informatics.

[41]  Chris Hankin,et al.  Using Machine Learning to Infer Reasoning Provenance From User Interaction Log Data , 2017 .

[42]  Margrit Schreier,et al.  Qualitative Content Analysis in Practice , 2012 .

[43]  Jennifer K. Phillips,et al.  A Data–Frame Theory of Sensemaking , 2007 .

[44]  Min Chen,et al.  Analyzing high-dimensional multivaríate network links with integrated anomaly detection, highlighting and exploration , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).