Evaluation of Parallel Coordinates: Overview, Categorization and Guidelines for Future Research

The parallel coordinates technique is widely used for the analysis of multivariate data. During recent decades significant research efforts have been devoted to exploring the applicability of the technique and to expand upon it, resulting in a variety of extensions. Of these many research activities, a surprisingly small number concerns user-centred evaluations investigating actual use and usability issues for different tasks, data and domains. The result is a clear lack of convincing evidence to support and guide uptake by users as well as future research directions. To address these issues this paper contributes a thorough literature survey of what has been done in the area of user-centred evaluation of parallel coordinates. These evaluations are divided into four categories based on characterization of use, derived from the survey. Based on the data from the survey and the categorization combined with the authors' experience of working with parallel coordinates, a set of guidelines for future research directions is proposed.

[1]  Martin Graham,et al.  Using curves to enhance parallel coordinate visualisations , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[2]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[3]  Daniel Weiskopf,et al.  Evaluation of a Bundling Technique for Parallel Coordinates , 2011, GRAPP/IVAPP.

[4]  E. Wegman.  Hyperdimensional Data Analysis Using Parallel Coordinates , 1990 .

[5]  Helen C. Purchase,et al.  Experimental Human-Computer Interaction - A Practical Guide with Visual Examples , 2012 .

[6]  Jing Li,et al.  Judging Correlation from Scatterplots and Parallel Coordinate Plots , 2010, Inf. Vis..

[7]  Alfred Inselberg,et al.  The plane with parallel coordinates , 1985, The Visual Computer.

[8]  Raquel M. Pillat,et al.  Experimental study on evaluation of multidimensional information visualization techniques , 2005, CLIHC '05.

[9]  Camilla Forsell,et al.  Task-based evaluation of multirelational 3D and standard 2D parallel coordinates , 2007, Electronic Imaging.

[10]  S. Johansson,et al.  Interactive Dimensionality Reduction Through User-defined Combinations of Quality Metrics , 2009, IEEE Transactions on Visualization and Computer Graphics.

[11]  Steven Franconeri,et al.  Ranking Visualizations of Correlation Using Weber's Law , 2014, IEEE Transactions on Visualization and Computer Graphics.

[12]  Silvia Miksch,et al.  Exploring highly structured data: a comparative study of stardinates and parallel coordinates , 2005, Ninth International Conference on Information Visualisation (IV'05).

[13]  M. Cooper,et al.  Revealing structure within clustered parallel coordinates displays , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[14]  Jarke J. van Wijk,et al.  Flexible Linked Axes for Multivariate Data Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[15]  Hans-Peter Seidel,et al.  An Edge-Bundling Layout for Interactive Parallel Coordinates , 2014, 2014 IEEE Pacific Visualization Symposium.

[16]  Natasha M. Maurits,et al.  Tiled Parallel Coordinates for the Visualization of Time-Varying Multichannel EEG Data , 2005, EuroVis.

[17]  Amitava Datta,et al.  A parallel coordinates style interface for exploratory volume visualization , 2005, IEEE Transactions on Visualization and Computer Graphics.

[18]  Holger Theisel.  Higher Order Parallel Coordinates , 2000, VMV.

[19]  Harri Siirtola,et al.  Visual Perception of Parallel Coordinate Visualizations , 2009, 2009 13th International Conference Information Visualisation.

[20]  Helwig Löffelmann,et al.  Visualizing the behaviour of higher dimensional dynamical systems , 1997 .

[21]  Matthew D. Cooper,et al.  3-dimensional display for clustered multi-relational parallel coordinates , 2005, Ninth International Conference on Information Visualisation (IV'05).

[22]  Raheem A. Beyah,et al.  P3D: A parallel 3D coordinate visualization for advanced network scans , 2013, 2013 IEEE International Conference on Communications (ICC).

[23]  Helwig Hauser,et al.  Angular brushing of extended parallel coordinates , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[24]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[25]  Xiaoru Yuan,et al.  Interactive local clustering operations for high dimensional data in parallel coordinates , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[26]  Daniel Weiskopf,et al.  Parallel-Coordinates Art , 2013 .

[27]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[28]  Chris North,et al.  An Evaluation of Microarray Visualization Tools for Biological Insight , 2004, IEEE Symposium on Information Visualization.

[29]  Tobias Isenberg,et al.  A Systematic Review on the Practice of Evaluating Visualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[30]  Matthias Zwicker,et al.  Ieee Transactions on Visualization and Computer Graphics Ewa Splatting , 2002 .

[31]  Mats Lind,et al.  Perceiving Patterns in Parallel Coordinates: Determining Thresholds for Identification of Relationships , 2008, Inf. Vis..

[32]  Andrew Vande Moere,et al.  The Effect of Aesthetic on the Usability of Data Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[33]  Matthew O. Ward,et al.  Clutter Reduction in Multi-Dimensional Data Visualization Using Dimension Reordering , 2004, IEEE Symposium on Information Visualization.

[34]  Jason Dykes,et al.  Exploring Uncertainty in Geodemographics with Interactive Graphics , 2011, IEEE Transactions on Visualization and Computer Graphics.

[35]  Eduard Gröller,et al.  Cupid: Cluster-Based Exploration of Geometry Generators with Parallel Coordinates and Radial Trees , 2014, IEEE Transactions on Visualization and Computer Graphics.

[36]  Victoria Interrante,et al.  User Studies: Why, How, and When? , 2003, IEEE Computer Graphics and Applications.

[37]  Daniel Weiskopf,et al.  State of the Art of Parallel Coordinates , 2013, Eurographics.

[38]  Klaus Mueller,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2008 Illustrative Parallel Coordinates , 2022 .

[39]  Michael J. McGuffin,et al.  Tracing Tuples Across Dimensions: A Comparison of Scatterplots and Parallel Coordinate Plots , 2012, Comput. Graph. Forum.

[40]  Mikko J. Rissanen,et al.  Evaluation of Parallel Coordinates for Interactive Alarm Filtering , 2011, 2011 15th International Conference on Information Visualisation.

[41]  Camilla Forsell,et al.  On the usability of three-dimensional display in parallel coordinates: Evaluating the efficiency of identifying two-dimensional relationships , 2014, Inf. Vis..

[42]  Bernd Hamann,et al.  Progressive parallel coordinates , 2012, 2012 IEEE Pacific Visualization Symposium.

[43]  Jonathan C. Roberts,et al.  Force-Directed Parallel Coordinates , 2013, 2013 17th International Conference on Information Visualisation.

[44]  Harri Siirtola,et al.  Combining parallel coordinates with the reorderable matrix , 2003, Proceedings International Conference on Coordinated and Multiple Views in Exploratory Visualization - CMV 2003 -.

[45]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[46]  Christopher D. Wickens,et al.  When Users Want What's not Best for Them , 1995 .

[47]  Matthew D. Cooper,et al.  Revealing Structure in Visualizations of Dense 2D and 3D Parallel Coordinates , 2006, Inf. Vis..

[48]  Matthew O. Ward,et al.  Hierarchical parallel coordinates for exploration of large datasets , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[49]  Jarke J. van Wijk,et al.  Eurographics/ieee-vgtc Symposium on Visualization 2010 Evaluation of Cluster Identification Performance for Different Pcp Variants , 2022 .

[50]  Mats Lind,et al.  Many-to-Many Relational Parallel Coordinates Displays , 2009, 2009 13th International Conference Information Visualisation.