Using lag-sequential analysis for understanding interaction sequences in visualizations

The investigation of how users make sense of the data provided by information systems is very important for human computer interaction. In this context, understanding the interaction processes of users plays an important role. The analysis of interaction sequences, for example, can provide a deeper understanding about how users solve problems. In this paper we present an analysis of sequences of interactions within a visualization system and compare the results to previous research. We used log file analysis and thinking aloud as methods. There is some indication based on log file analysis that there are interaction patterns which can be generalized. Thinking aloud indicates that some cognitive processes occur together with a higher probability than others. Graphical abstractDisplay Omitted HighlightsWe describe research concerning interaction patterns within visualizations systems.Our results contribute to the understanding of cognitive processes of users.Certain reoccurring patterns can be observed across fairly different visualizations.Analysis was performed using transitional probabilities and lag sequential analysis.Data on interaction sequences was collected using thinking aloud and log-files.

[1]  Bongshin Lee,et al.  GraphTrail: analyzing large multivariate, heterogeneous networks while supporting exploration history , 2012, CHI.

[2]  Juliana Freire,et al.  VisComplete: Automating Suggestions for Visualization Pipelines , 2008, IEEE Transactions on Visualization and Computer Graphics.

[3]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[4]  Heather Richter Lipford,et al.  Helping users recall their reasoning process , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[5]  T. J. Jankun-Kelly Using Visualization Process Graphs to Improve Visualization Exploration , 2008, IPAW.

[6]  James D. Herbsleb,et al.  Characterizing the Sequential Structure of Interactive Behaviors Through Statistical and Grammatical Techniques , 1994, Hum. Comput. Interact..

[7]  Ryen W. White,et al.  Exploratory Search , 2008 .

[8]  Analyst's Workspace: An embodied sensemaking environment for large, high-resolution displays , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[9]  Silvia Miksch,et al.  Visually Exploring Multivariate Trends in Patient Cohorts Using Animated Scatter Plots , 2011, HCI.

[10]  Michelle X. Zhou,et al.  Characterizing Users' Visual Analytic Activity for Insight Provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[11]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[12]  Steven K. Feiner,et al.  Visual task characterization for automated visual discourse synthesis , 1998, CHI.

[13]  J. Harding Qualitative Data Analysis from Start to Finish , 2013 .

[14]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[15]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[16]  L. Del Piccolo,et al.  Event-based categorical sequential analyses of the medical interview: a review , 2003, Epidemiologia e Psichiatria Sociale.

[17]  Margrit Schreier,et al.  Qualitative Content Analysis in Practice , 2012 .

[18]  J. Gregory Trafton,et al.  Turning pictures into numbers: extracting and generating information from complex visualizations , 2000, Int. J. Hum. Comput. Stud..

[19]  Cláudio T. Silva,et al.  Querying and Creating Visualizations by Analogy , 2007, IEEE Transactions on Visualization and Computer Graphics.

[20]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[21]  Donna L. Cuomo Understanding the applicability of sequential data analysis techniques for analysing usability data , 1994, Behav. Inf. Technol..

[22]  Kang Zhang,et al.  Teaching Information Aesthetics as a Research Class in China , 2015, IEEE Computer Graphics and Applications.

[23]  Clay Spinuzzi,et al.  Context and consciousness: Activity theory and human-computer interaction , 1997 .

[24]  Jean Scholtz,et al.  Glass Box: An Instrumented Infrastructure for Supporting Human Interaction with Information , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[25]  Michael Gertz,et al.  A Model and Framework for Visualization Exploration , 2007, IEEE Transactions on Visualization and Computer Graphics.

[26]  David R. Karger,et al.  End-users publishing structured information on the web: an observational study of what, why, and how , 2014, CHI.

[27]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[28]  Chris North,et al.  Analytic provenance: process+interaction+insight , 2011, CHI Extended Abstracts.

[29]  David H. Laidlaw,et al.  A Case Study Using Visualization Interaction Logs and Insight Metrics to Understand How Analysts Arrive at Insights , 2016, IEEE Transactions on Visualization and Computer Graphics.

[30]  Margit Pohl,et al.  Methodologies for the analysis of usage patterns in information visualization , 2012, BELIV '12.

[31]  Jennifer J McComas,et al.  Calculating contingencies in natural environments: issues in the application of sequential analysis. , 2009, Journal of applied behavior analysis.

[32]  Chris North,et al.  Information Visualization , 2008, Lecture Notes in Computer Science.

[33]  T.L.J. Ferris,et al.  Interaction Design for Complex Problem Solving: Developing Useful and Usable Software , 2004, IEEE Transactions on Professional Communication.

[34]  David Kirsh,et al.  Thinking with external representations , 2010, AI & SOCIETY.

[35]  T. J. Jankun-Kelly,et al.  Analytic Provenance for Sensemaking: A Research Agenda , 2015, IEEE Computer Graphics and Applications.

[36]  John T. Stasko,et al.  How Can Visual Analytics Assist Investigative Analysis? Design Implications from an Evaluation , 2011, IEEE Transactions on Visualization and Computer Graphics.

[37]  S. Elo,et al.  Qualitative Content Analysis , 2014 .

[38]  P. Mayring Qualitative Content Analysis , 2000 .

[39]  Margit Pohl,et al.  The User Puzzle—Explaining the Interaction with Visual Analytics Systems , 2012, IEEE Transactions on Visualization and Computer Graphics.

[40]  Penelope M. Sanderson,et al.  Exploratory Sequential Data Analysis: Foundations , 1994, Hum. Comput. Interact..

[41]  Bruce E. Wampoid The Intensive Examination of Social Interaction , 2015 .

[42]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[43]  Jason Dykes,et al.  An Extensible Framework for Provenance in Human Terrain Visual Analytics , 2013, IEEE Transactions on Visualization and Computer Graphics.

[44]  Alex Endert,et al.  Finding Waldo: Learning about Users from their Interactions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[45]  Liang Gou,et al.  SocialNetSense: Supporting sensemaking of social and structural features in networks with interactive visualization , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[46]  Cheryl Z. Qian,et al.  Capturing and supporting the analysis process , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[47]  Petra Isenberg,et al.  Pairgrams: Understanding Collaborative Analysis Behavior with Visualization , 2011 .

[48]  Yingcai Wu,et al.  A Survey of Visual Analytics Techniques and Applications: State-of-the-Art Research and Future Challenges , 2013, Journal of Computer Science and Technology.

[49]  Susan Bell Trickett,et al.  Toward a Comprehensive Model of Graph Comprehension: Making the Case for Spatial Cognition , 2006, Diagrams.

[50]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[51]  Susan N. Friel,et al.  Making sense of graphs: Critical factors influencing comprehension and instructional implications. , 2001 .

[52]  J. Davis,et al.  Elementary Survey Analysis , 1972 .

[53]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[54]  William Ribarsky,et al.  Visual analytics for complex concepts using a human cognition model , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[55]  Gregory K. W. K. Chung,et al.  An Exploratory Study to Examine the Feasibility of Measuring Problem-Solving Processes Using a Click-Through Interface , 2003 .

[56]  Samuel Finestone Elementany Survey Analysis. Prentice-Hall Methods of Social Science Series. James A. Davis. Englewood Cliffs, N. J: Prentice-Hall, 195 Pages, $3.95. Paperbound , 1972 .

[57]  Milad Shokouhi,et al.  Behavioral dynamics on the web: Learning, modeling, and prediction , 2013, TOIS.

[58]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[59]  Sherry Y. Chen,et al.  A Study of Users’ Reactions to a Mixed Online Discussion Model: A Lag Sequential Analysis Approach , 2015, Int. J. Hum. Comput. Interact..

[60]  Randolph G. Bias,et al.  Research Methods for Human-Computer Interaction , 2010, J. Assoc. Inf. Sci. Technol..

[61]  William Ribarsky,et al.  Recovering Reasoning Processes from User Interactions , 2009, IEEE Computer Graphics and Applications.

[62]  HorvitzEric,et al.  Behavioral dynamics on the web , 2013 .

[63]  PohlMargit,et al.  The User Puzzle—Explaining the Interaction with Visual Analytics Systems , 2012 .

[64]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[65]  Monika Richter,et al.  Cognition In The Wild , 2016 .

[66]  Clayton Lewis,et al.  A problem-oriented classification of visualization techniques , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[67]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[68]  Dennis P. Groth,et al.  Provenance and Annotation for Visual Exploration Systems , 2006, IEEE Transactions on Visualization and Computer Graphics.

[69]  Johan F. Hoorn,et al.  Distributed cognition , 2005, Cognition, Technology & Work.

[70]  David F. Redmiles,et al.  Extracting usability information from user interface events , 2000, CSUR.

[71]  FisherCarolanne,et al.  Exploratory sequential data analysis , 1993 .

[72]  Silvia Miksch,et al.  Analysing Interactivity in Information Visualisation , 2012, KI - Künstliche Intelligenz.

[73]  Raj M Ratwani,et al.  Thinking graphically: Connecting vision and cognition during graph comprehension. , 2008, Journal of experimental psychology. Applied.

[74]  Philip Smith Roger Bakeman John M. Gottman , 1987, Animal Behaviour.

[75]  John T. Stasko,et al.  Distributed Cognition as a Theoretical Framework for Information Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[76]  Sunny Consolvo,et al.  User Study Techniques in the Design and Evaluation of a Ubicomp Environment , 2002, UbiComp.

[77]  Cláudio T. Silva,et al.  VisTrails: enabling interactive multiple-view visualizations , 2005, VIS 05. IEEE Visualization, 2005..