Science of Analytical Reasoning

There has been progress in the science of analytical reasoning and in meeting the recommendations for future research that were laid out when the field of visual analytics was established. Researchers have also developed a group of visual analytics tools and methods that embody visual analytics principles and attack important and challenging real-world problems. However, these efforts are only the beginning and much study remains to be done. This article examines the state of the art in visual analytics methods and reasoning and gives examples of current tools and capabilities. It shows that the science of visual analytics needs interdisciplinary efforts, indicates some of the disciplines that should be involved and presents an approach to how they might work together. Finally, the article describes some gaps, opportunities and future directions in developing new theories and models that can be enacted in methods and design principles and applied to significant and complex practical problems and data.

[1]  Jacques Bertin,et al.  Graphics and graphic information-processing , 1981 .

[2]  Howard Greisdorf,et al.  Exploring Science: The Cognition and Development of Discovery Processes , 2003, J. Documentation.

[3]  Vimla L. Patel,et al.  Diagnostic Reasoning and Medical Expertise , 1994 .

[4]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[5]  P. Langley,et al.  Computational Models of Scientific Discovery and Theory Formation , 1990 .

[6]  William Ribarsky,et al.  Defining Insight for Visual Analytics , 2009, IEEE Computer Graphics and Applications.

[7]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[8]  Emilie M. Roth,et al.  CAN WE EVER ESCAPE FROM DATA OVERLOAD , 2002 .

[9]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[10]  William Ribarsky,et al.  WireVis: Visualization of Categorical, Time-Varying Data From Financial Transactions , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[11]  Emilie M. Roth,et al.  Predicting Vulnerabilities in Computer-Supported Inferential Analysis under Data Overload , 2001, Cognition, Technology & Work.

[12]  Petra Isenberg,et al.  Collaborative Brushing and Linking for Co‐located Visual Analytics of Document Collections , 2009, Comput. Graph. Forum.

[13]  Jesper W. Schneider,et al.  Mapping scientific frontiers: The quest for knowledge visualization , 2004, J. Assoc. Inf. Sci. Technol..

[14]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[15]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[16]  S. Woolf The meaning of translational research and why it matters. , 2008, JAMA.

[17]  Mark Gahegan,et al.  Visualization for constructing and sharing geo-scientific concepts , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Paul J. Feltovich,et al.  Common Ground and Coordination in Joint Activity , 2005 .

[19]  Starr Roxanne Hiltz,et al.  Distributed group support: a preliminary analysis of the effects of the use of voting tools and sequential procedures , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[20]  William Ribarsky,et al.  Recovering Reasoning Process From User Interactions , 2009 .

[21]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[22]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[23]  John W. Bodnar,et al.  Warning Analysis for the Information Age: Rethinking the Intelligence Process , 2003 .

[24]  H. P Nii,et al.  Blackboard Systems , 1986 .

[25]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[26]  Frederico T. Fonseca,et al.  Using Ontologies for Integrated Geographic Information Systems , 2002, Trans. GIS.

[27]  Sara Jones,et al.  Animated Diagrams: An Investigation into the Cognitive Effects of Using Animation to Illustrate Dynamic Processes , 2000, Diagrams.

[28]  Donald A. Norman,et al.  Things that make us smart , 1979 .

[29]  David F. Channell Pasteur's Quadrant: Basic Science and Technological Innovation , 1999 .

[30]  Alan M. MacEachren,et al.  How Maps Work - Representation, Visualization, and Design , 1995 .

[31]  D. Schum The Evidential Foundations of Probabilistic Reasoning , 1994 .

[32]  J. Boyd,et al.  A Discourse on Winning and Losing , 1987 .

[33]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[34]  Jean Scholtz,et al.  Evaluating Visual Analytics at the 2007 VAST Symposium Contest , 2008, IEEE Computer Graphics and Applications.

[35]  James C Spohrer,et al.  Converging Technologies for Enhancing Human Performance: Science and Business Perspectives , 2004, Annals of the New York Academy of Sciences.

[36]  Gerd Kortuem,et al.  "Where are you pointing at?" A study of remote collaboration in a wearable videoconference system , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[37]  Thomas W. Malone,et al.  Coordination Theory and Collaboration Technology , 2001 .

[38]  Z. Pylyshyn Seeing and Visualizing: It's Not What You Think , 2003 .

[39]  Jennifer K. Phillips,et al.  A Data–Frame Theory of Sensemaking , 2007 .

[40]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[41]  Susanne Grabowski,et al.  Human-computer interaction viewed as pseudo-communication , 2001, Knowl. Based Syst..

[42]  Jarke J. van Wijk,et al.  The value of visualization , 2005, VIS 05. IEEE Visualization, 2005..

[43]  Kevin Crowley,et al.  Being Interdisciplinary: Trading Zones in Cognitive Science , 2005 .

[44]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[45]  J. L. Adams Conceptual Blockbusting : A Guide to Better Ideas , 1974 .

[46]  Daniel D. Suthers,et al.  An Empirical Study of the Effects of Representational Guidance on Collaborative Learning. , 2003 .

[47]  James D. Hollan,et al.  Beyond being there , 1992, CHI.

[48]  Steven F. Roth,et al.  Visualizing common ground , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[49]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[50]  B. C. Griffith,et al.  The Structure of Scientific Literatures I: Identifying and Graphing Specialties , 1974 .

[51]  Vimla L. Patel,et al.  Cognitive Aspects of Clinical Performance During Patient Workup: The Role of Medical Expertise , 1997, Advances in health sciences education : theory and practice.

[52]  Penny Rheingans Color, change, and control of quantitative data display , 1992, Proceedings Visualization '92.

[53]  Ashok K. Goel,et al.  Making Sense of VAST Data , 2007, 2007 IEEE Intelligence and Security Informatics.

[54]  Harold Garfinkel,et al.  On Formal Structures of Practical Actions , 2005 .

[55]  E. Schegloff,et al.  Opening up Closings , 1973 .

[56]  Anita Raja,et al.  A Blackboard-based Approach Towards Predictive Analytics , 2009, AAAI Spring Symposium: Technosocial Predictive Analytics.

[57]  Jiajie Zhang External Representations in Complex Information Processing Tasks , 1999 .

[58]  Jin-Tan Yang,et al.  Visualizing Argumentation -Software Tools for Collaborative and Educational Sense-Making , 2003, J. Educ. Technol. Soc..

[59]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[60]  William Ribarsky,et al.  Visual analytics for complex concepts using a human cognition model , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[61]  James D. Myers,et al.  Collaboratories: Doing Science on the Internet , 1996, Computer.

[62]  Richard May,et al.  Supporting Knowledge Transfer through Decomposable Reasoning Artifacts , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[63]  Ramon Prudencio S. Toledo Visualizing Argumentation: Software Tools for Collaborative and Educational Sense-Making , 2005, Inf. Vis..

[64]  Timothy D. Wilson,et al.  Thinking too much: introspection can reduce the quality of preferences and decisions. , 1991, Journal of personality and social psychology.

[65]  John T. Stasko,et al.  Jigsaw: Supporting Investigative Analysis through Interactive Visualization , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[66]  Jock D. Mackinlay,et al.  The information visualizer, an information workspace , 1991, CHI.

[67]  A. MacEachren,et al.  Research Challenges in Geovisualization , 2001, KN - Journal of Cartography and Geographic Information.

[68]  Robert Johansen,et al.  Groupware: Computer Support for Business Teams , 1988 .

[69]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[70]  Jay P. Trimble,et al.  The use patterns of large, interactive display surfaces: Case studies of media design and use for blueboard and MERboard , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[71]  William W. Gaver The affordances of media spaces for collaboration , 1992, CSCW '92.

[72]  Lyndsey Franklin,et al.  The Scalable Reasoning System: Lightweight visualization for distributed analytics , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[73]  Alan M. MacEachren,et al.  Developing a conceptual framework for visually-enabled geocollaboration , 2004, Int. J. Geogr. Inf. Sci..

[74]  Nigel Shadbolt,et al.  Cognitive cockpit engineering: Coupling functional state assessment, task knowledge management and decision support for context sensitive aiding , 2001 .

[75]  Brian Fisher,et al.  Science and Smart Graphics , 2009 .

[76]  William Ribarsky,et al.  Recovering Reasoning Processes from User Interactions , 2009, IEEE Computer Graphics and Applications.

[77]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[78]  Judith S. Olson,et al.  i2i trust in e-commerce , 2000, CACM.

[79]  Robert Harper,et al.  Stories in GeoTime , 2007 .

[80]  Ashok K. Goel,et al.  Playing Detective: Using AI for Sensemaking in Investigative Analysis , 2009 .

[81]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[82]  J. J. van Wijk The value of visualization , 2005 .

[83]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[84]  Misha Pavel,et al.  Context Shifts: Extending the Meanings of Physical Objects With Language , 2001, Hum. Comput. Interact..

[85]  David S. Ebert,et al.  Data Transformations and Representations for Computation and Visualization , 2009, Inf. Vis..

[86]  T. Rickards Sense making in organizations , 1997 .

[87]  Gregory D. Abowd,et al.  Classroom 2000: a system for capturing and accessing multimedia classroom experiences , 1998, CHI Conference Summary.

[88]  Andrew G. Walker The Reality of Ethnomethodology , 1977 .

[89]  Terry Winograd,et al.  Understanding computers and cognition , 1986 .

[90]  Mary Lou Maher,et al.  A model for synchronous collaborative design using CAD and database management , 1997 .

[91]  Marilyn Jager Adams,et al.  Situation Awareness and the Cognitive Management of Complex Systems , 1995, Hum. Factors.

[92]  J Zhang,et al.  Distributed representation as a principle for the analysis of cockpit information displays. , 1997, The International journal of aviation psychology.

[93]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[94]  Michael D. McNeese,et al.  Distributed Cognition in Shared Information Spaces , 2002 .

[95]  Shashi Shekhar,et al.  Contraflow Transportation Network Reconfiguration for Evacuation Route Planning , 2008, IEEE Transactions on Knowledge and Data Engineering.

[96]  Michael D. McNeese,et al.  Advancing Socio-Technical Systems Design Via the Living Laboratory , 2000 .

[97]  D. Corkill Blackboard Systems , 1991 .

[98]  Telecommunications Board,et al.  National Collaboratories: Applying Information Technology for Scientific Research , 1993 .

[99]  L. Suchman Representing practice in cognitive science , 1988 .