An Exploratory Study on Visual Exploration of Model Simulations by Multiple Types of Experts

Experts in different domains rely increasingly on simulation models of complex processes to reach insights, make decisions, and plan future projects. These models are often used to study possible trade-offs, as experts try to optimise multiple conflicting objectives in a single investigation. Understanding all the model intricacies, however, is challenging for a single domain expert. We propose a simple approach to support multiple experts when exploring complex model results. First, we reduce the model exploration space, then present the results on a shared interactive surface, in the form of a scatterplot matrix and linked views. To explore how multiple experts analyse trade-offs using this setup, we carried out an observational study focusing on the link between expertise and insight generation during the analysis process. Our results reveal the different exploration strategies and multi-storyline approaches that domain experts adopt during trade-off analysis, and inform our recommendations for collaborative model exploration systems.

[1]  Evelyne Lutton,et al.  Guest editorial: Special issue on genetic programming, evolutionary computation and visualization , 2018, Genetic Programming and Evolvable Machines.

[2]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[3]  Sylvie Recous,et al.  Azodyn: a simple model simulating the date of nitrogen deficiency for decision support in wheat fertilization , 1999 .

[4]  James R. Eagan,et al.  How Data Workers Cope with Uncertainty: A Task Characterisation Study , 2017, CHI.

[5]  Jennifer K. Phillips,et al.  A Data–Frame Theory of Sensemaking , 2007 .

[6]  Pierre Dragicevic,et al.  Conceptual and Methodological Issues in Evaluating Multidimensional Visualizations for Decision Support , 2018, IEEE Transactions on Visualization and Computer Graphics.

[7]  David H. Laidlaw,et al.  A Case Study Using Visualization Interaction Logs and Insight Metrics to Understand How Analysts Arrive at Insights , 2016, IEEE Transactions on Visualization and Computer Graphics.

[8]  Matthew Hanson,et al.  A brief history of expertise , 2004 .

[9]  Jeffrey Heer,et al.  CommentSpace: structured support for collaborative visual analysis , 2011, CHI.

[10]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[11]  Fusuo Zhang,et al.  In-season nitrogen management strategy for winter wheat: Maximizing yields, minimizing environmental impact in an over-fertilization context , 2010 .

[12]  Ronald A. Rensink,et al.  The Perception of Correlation in Scatterplots , 2010, Comput. Graph. Forum.

[13]  Helena M. Mentis,et al.  Supporting content and process common ground in computer-supported teamwork , 2009, CHI.

[14]  Matthew Hanson,et al.  Expertise in therapy and counseling: Exploring Expertise in Therapy and Counseling , 2004 .

[15]  Robert S. Laramee,et al.  Storytelling and Visualization: An Extended Survey , 2018, Inf..

[16]  Pierre Dragicevic,et al.  Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[17]  Miriah D. Meyer,et al.  A Framework for Externalizing Implicit Error Using Visualization , 2019, IEEE Transactions on Visualization and Computer Graphics.

[18]  Robert E. Kraut,et al.  Using Visual Information for Grounding and Awareness in Collaborative Tasks , 2012, Hum. Comput. Interact..

[19]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[20]  Brad A. Myers,et al.  The Story in the Notebook: Exploratory Data Science using a Literate Programming Tool , 2018, CHI.

[21]  Stefan Bruckner,et al.  Visual Parameter Space Analysis: A Conceptual Framework , 2014, IEEE Transactions on Visualization and Computer Graphics.

[22]  William Ribarsky,et al.  Defining Insight for Visual Analytics , 2009, IEEE Computer Graphics and Applications.

[23]  Francesco Pappalardo,et al.  Mathematical modeling of biological systems , 2013, Briefings Bioinform..

[24]  Jean-Roch Mouret,et al.  Prediction of the production kinetics of the main fermentative aromas in winemaking fermentations , 2015 .

[25]  Cédric Baudrit,et al.  Towards a global modelling of the Camembert-type cheese ripening process by coupling heterogeneous knowledge with dynamic Bayesian networks. , 2010 .

[26]  Anastasia Bezerianos,et al.  Evolutionary Visual Exploration: Evaluation With Expert Users , 2013, Comput. Graph. Forum.

[27]  S. Recous,et al.  STICS : a generic model for the simulation of crops and their water and nitrogen balances. I. Theory, and parameterization applied to wheat and corn , 1998 .

[28]  Susan R. Fussell,et al.  Effects of Sensemaking Translucence on Distributed Collaborative Analysis , 2016, CSCW.

[29]  Shahryar Rahnamayan,et al.  3D-RadVis: Visualization of Pareto front in many-objective optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[30]  Daniel A. Keim,et al.  Bridging the Gap of Domain and Visualization Experts with a Liaison , 2015, EuroVis.

[31]  Tobias Isenberg,et al.  Data Visualization on Interactive Surfaces: A Research Agenda , 2013, IEEE Computer Graphics and Applications.

[32]  Sophie Martin,et al.  Some remarks on computational approaches towards sustainable complex agri-food systems , 2016 .

[33]  Melanie Feinberg,et al.  A Design Perspective on Data , 2017, CHI.

[34]  Aurélien Tabard,et al.  Horizontal vs. Vertical: How the Orientation of a Large Interactive Surface Impacts Collaboration in Multi-surface Environments , 2017, INTERACT.

[35]  Bongshin Lee,et al.  Data-Driven Storytelling Techniques : Analysis of a Curated Collection of Visual Stories , 2018 .

[36]  Chris North,et al.  An insight-based methodology for evaluating bioinformatics visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[37]  Carlos A. Coello Coello,et al.  Some techniques to deal with many-objective problems , 2009, GECCO '09.

[38]  John Kounios,et al.  The Aha! Moment , 2009, Annual review of psychology.

[39]  John T. Stasko,et al.  Casual Information Visualization: Depictions of Data in Everyday Life , 2007, IEEE Transactions on Visualization and Computer Graphics.

[40]  John R. Wilson,et al.  The nature of expertise: a review. , 2006, Applied ergonomics.

[41]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[42]  Jean-Marc Meynard,et al.  Combining user involvement with innovative design to develop a radical new method for managing N fertilization , 2017, Nutrient Cycling in Agroecosystems.

[43]  Katherine A. Daniell,et al.  Synthesis, part of a Special Feature on Implementing Participatory Water Management: Recent Advances in Theory, Practice and Evaluation Designing Participation Processes for Water Management and Beyond , 2010 .

[44]  Mary Beth Rosson,et al.  Awareness and teamwork in computer-supported collaborations , 2006, Interact. Comput..

[45]  M. Polanyi Chapter 7 – The Tacit Dimension , 1997 .

[46]  M. Chi,et al.  The Nature of Expertise , 1988 .

[47]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[48]  Matthew Hanson,et al.  A brief history of expertise: Exploring Expertise in Therapy and Counseling , 2004 .

[49]  John T. Stasko,et al.  Understanding and characterizing insights: how do people gain insights using information visualization? , 2008, BELIV.

[50]  Steven J. Jackson,et al.  Data Vision: Learning to See Through Algorithmic Abstraction , 2017, CSCW.

[51]  Jeffrey Heer,et al.  Interpretation and trust: designing model-driven visualizations for text analysis , 2012, CHI.

[52]  Ioan-Cristian Trelea,et al.  Interactive knowledge integration in modelling for food sustainability : challenges and prospects , 2017, CHI 2017.

[53]  Helena M. Mentis,et al.  Articulating common ground in cooperative work: content and process , 2008, CHI.

[54]  Yvonne Rogers,et al.  Collaborating around vertical and horizontal large interactive displays: which way is best? , 2004, Interact. Comput..

[55]  Steven J. Jackson,et al.  Trust in Data Science , 2018, Proc. ACM Hum. Comput. Interact..

[56]  Kathleen H. Pine,et al.  The Politics of Measurement and Action , 2015, CHI.

[57]  Tea Tusar,et al.  Visualization of Pareto Front Approximations in Evolutionary Multiobjective Optimization: A Critical Review and the Prosection Method , 2015, IEEE Transactions on Evolutionary Computation.