Evaluation of Multivariate Visualization on a Multivariate Task

Multivariate visualization techniques have attracted great interest as the dimensionality of data sets grows. One premise of such techniques is that simultaneous visual representation of multiple variables will enable the data analyst to detect patterns amongst multiple variables. Such insights could lead to development of new techniques for rigorous (numerical) analysis of complex relationships hidden within the data. Two natural questions arise from this premise: Which multivariate visualization techniques are the most effective for high-dimensional data sets? How does the analysis task change this utility ranking? We present a user study with a new task to answer the first question. We provide some insights to the second question based on the results of our study and results available in the literature. Our task led to significant differences in error, response time, and subjective workload ratings amongst four visualization techniques. We implemented three integrated techniques (Data-driven Spots, Oriented Slivers, and Attribute Blocks), as well as a baseline case of separate grayscale images. The baseline case fared poorly on all three measures, whereas Datadriven Spots yielded the best accuracy and was among the best in response time. These results differ from comparisons of similar techniques with other tasks, and we review all the techniques, tasks, and results (from our work and previous work) to understand the reasons for this discrepancy.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  Hong Zhou,et al.  Natural Textures for Weather Data Visualization , 2006, Tenth International Conference on Information Visualisation (IV'06).

[3]  Mark A. Livingston,et al.  Evaluation of Trend Localization with Multi-Variate Visualizations , 2011, IEEE Transactions on Visualization and Computer Graphics.

[4]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[5]  Daniel B. Carr,et al.  Visualizing Data Patterns with Micromaps , 2010 .

[6]  Jeff Beddow,et al.  Shape coding of multidimensional data on a microcomputer display , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[7]  Mark A. Livingston,et al.  An evaluation of methods for encoding multiple 2D spatial data , 2011, Electronic Imaging.

[8]  Frederick P. Brooks,et al.  Multivariate data visualization with data-driven spots , 2003 .

[9]  James R. Miller,et al.  Attribute Blocks: Visualizing Multiple Continuously Defined Attributes , 2007, IEEE Computer Graphics and Applications.

[10]  Victoria Interrante,et al.  Effectively visualizing multi-valued flow data using color and texture , 2003, IEEE Visualization, 2003. VIS 2003..

[11]  Matthew O. Ward,et al.  Exploring N-dimensional databases , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[12]  Victoria Interrante,et al.  Weaving Versus Blending: a quantitative assessment of the information carrying capacities of two alternative methods for conveying multivariate data with color. , 2006, IEEE Transactions on Visualization and Computer Graphics.

[13]  Haim Levkowitz,et al.  Color icons-merging color and texture perception for integrated visualization of multiple parameters , 1991, Proceeding Visualization '91.

[14]  James T. Enns,et al.  Building perceptual textures to visualize multidimensional datasets , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[15]  Gary Perlman,et al.  Data analysis programs for the UNIX operating system , 1980 .

[16]  David H. Laidlaw,et al.  Visualizing diffusion tensor images of the mouse spinal cord , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[17]  Penny Rheingans,et al.  Art-Inspired Techniques For Visualizing Time-Varying Data , 2008 .

[18]  Robert Michael Kirby,et al.  Comparing 2D vector field visualization methods: a user study , 2005, IEEE Transactions on Visualization and Computer Graphics.

[19]  James T. Enns,et al.  Perceptually based brush strokes for nonphotorealistic visualization , 2004, TOGS.

[20]  E. Williams.  Experimental Designs Balanced for the Estimation of Residual Effects of Treatments , 1949 .

[21]  Victoria Interrante,et al.  Strategies for the visualization of multiple 2D vector fields , 2006, IEEE Computer Graphics and Applications.

[22]  Mark A. Livingston,et al.  Evaluation of multivariate visualizations: a case study of refinements and user experience , 2012, Visualization and Data Analysis.