The Huge Variable Space in Empirical Studies for Visualization - A Challenge as well as an opportunity for Visualization Psychology

In each of the last five years, a few dozen empirical studies appeared in visualization journals and conferences. The existing empirical studies have already featured a large number of variables. There are many more variables yet to be studied. While empirical studies enable us to obtain knowledge and insight about visualization processes through observation and analysis of user experience, it seems to be a stupendous challenge for exploring such a huge variable space at the current pace. In this position paper, we discuss the implication of not being able to explore this space effectively and efficiently, and propose means for addressing this challenge.

[1]  Anastasia Bezerianos,et al.  A Systematic Review of Experimental Studies on Data Glyphs , 2017, IEEE Transactions on Visualization and Computer Graphics.

[2]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  David Whitney,et al.  How Capacity Limits of Attention Influence Information Visualization Effectiveness , 2012, IEEE Transactions on Visualization and Computer Graphics.

[4]  MIN CHEN,et al.  "Isms" in Visualization , 2020, Foundations of Data Visualization.

[5]  Danielle Albers Szafir,et al.  Modeling Color Difference for Visualization Design , 2018, IEEE Transactions on Visualization and Computer Graphics.

[6]  Min Chen,et al.  Visual Signatures in Video Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[7]  David H. Laidlaw,et al.  The relation between visualization size, grouping, and user performance , 2014, IEEE Transactions on Visualization and Computer Graphics.

[8]  Brian D. Fisher,et al.  Juxtaposing Controlled Empirical Studies in Visualization with Topic Developments in Psychology , 2019, ArXiv.

[9]  Robert Michael Kirby,et al.  Quantitative comparative evaluation of 2D vector field visualization methods , 2001, Proceedings Visualization, 2001. VIS '01..

[10]  Min Chen,et al.  Empirically Measuring Soft Knowledge in Visualization , 2017, Comput. Graph. Forum.

[11]  Arzu Çöltekin,et al.  User studies in cartography: opportunities for empirical research on interactive maps and visualizations , 2017 .

[12]  Denis Lalanne,et al.  A Qualitative Study on the Exploration of Temporal Changes in Flow Maps with Animation and Small‐Multiples , 2012, Comput. Graph. Forum.

[13]  Min Chen,et al.  A Multi‐task Comparative Study on Scatter Plots and Parallel Coordinates Plots , 2015, Comput. Graph. Forum.

[14]  David H. Laidlaw,et al.  A Survey of Variables Used in Empirical Studies for Visualization , 2020, Foundations of Data Visualization.