An empirical study of data visualization techniques in PACS design

The paper presents an empirical study of multidimensional visualization techniques. The study is motivated by the problem of decision making in PACS (Picture Archiving and Communications System) design. A comprehensive survey of visualizations used in literature is performed and these survey results are then used to produce the final set of considered visualizations: tables (as control), scatterplots, parallel coordinates, and star plots. An electronic testing tool is developed to present visualizations to three sets of experimental subjects in order to determine which visualization technique allows users to make the correct decision in a sample decision making problem based on real-world data. Statistical analysis of the results demonstrates that visualizations show better results in decision support than tables. Further, when number of dimensions is large, 2D parallel coordinates show the best results in accuracy. The contribution of the presented research operates on two levels of abstraction. On the object level, it provides useful data regarding the relative merits of visualization techniques for the considered narrow use-case, which can then be generalized to other similar problem sets. On the meta level above, it contributes an enhanced methodology to the area of empirical visualization evaluation methods.

[1]  Nathan Cooprider,et al.  Extension of star coordinates into three dimensions , 2007, Electronic Imaging.

[2]  M. S. T. Carpendale,et al.  Considering Visual Variables as a Basis for Information Visualisation , 2003 .

[3]  Hans-Peter Kriegel,et al.  Visualization Techniques for Mining Large Databases: A Comparison , 1996, IEEE Trans. Knowl. Data Eng..

[4]  Simone Garlandini,et al.  Evaluating the Effectiveness and Efficiency of Visual Variables for Geographic Information Visualization , 2009, COSIT.

[5]  C. L. Philip Chen,et al.  Data-intensive applications, challenges, techniques and technologies: A survey on Big Data , 2014, Inf. Sci..

[6]  Ahmet M. Eskicioglu,et al.  Quality measurement for monochrome compressed images in the past 25 years , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[7]  Thomas L. Saaty,et al.  Decision-making with the AHP: Why is the principal eigenvector necessary , 2003, Eur. J. Oper. Res..

[8]  N. John,et al.  Navigating and visualizing three-dimensional data sets. , 2004, The British journal of radiology.

[9]  Ivan Bratko,et al.  VizRank: finding informative data projections in functional genomics by machine learning , 2005, Bioinform..

[10]  Dragan Ivetic,et al.  A COMPREHENSIVE QUALITY EVALUATION SYSTEM FOR PACS , 2009 .

[11]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[12]  Ulrich Engelke,et al.  Visual Performance in Multidimensional Data Characterisation with Scatterplots and Parallel Coordinates , 2016, HVEI.

[13]  Michel Feron,et al.  Trends in PACS architecture. , 2011, European journal of radiology.

[14]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[15]  Dragan Ivetic,et al.  Introducing an acceptability metric for image compression in PACS - A model , 2013, 2013 E-Health and Bioengineering Conference (EHB).

[16]  B. Marx The Visual Display of Quantitative Information , 1985 .

[17]  Andrew Vande Moere,et al.  The Effect of Aesthetic on the Usability of Data Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[18]  Marco Winckler,et al.  On evaluating information visualization techniques , 2002, AVI '02.

[19]  Basant Kumar,et al.  MOS Prediction of SPIHT Medical Images Using Objective Quality Parameters , 2009, 2009 International Conference on Signal Processing Systems.

[20]  Daniel McNeish,et al.  Using Data-Dependent Priors to Mitigate Small Sample Bias in Latent Growth Models , 2016 .

[21]  Faouzi Kossentini,et al.  Performance Analysis of the JPEG 2000 Image Coding Standard , 2005, Multimedia Tools and Applications.

[22]  Mats Lind,et al.  Simple 3D glyphs for spatial multivariate data , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[23]  Lawrence A. Bruckner ON CHERNOFF FACES , 1979 .

[24]  Christian Olivier,et al.  Performance evaluation of wavelet based coders on brain MRI volumetric medical datasets for storage and wireless transmission , 2007 .

[25]  Raquel M. Pillat,et al.  Experimental study on evaluation of multidimensional information visualization techniques , 2005, CLIHC '05.

[26]  Camilla Forsell,et al.  Task-based evaluation of multirelational 3D and standard 2D parallel coordinates , 2007, Electronic Imaging.

[27]  D. Dragan,et al.  Quality evaluation of medical image compression: What to measure? , 2010, IEEE 8th International Symposium on Intelligent Systems and Informatics.

[28]  Olga Kosheleva,et al.  Application of task-specific metrics in JPEG2000 ROI compression , 2002, Proceedings Fifth IEEE Southwest Symposium on Image Analysis and Interpretation.

[29]  R. Wilcox Introduction to Robust Estimation and Hypothesis Testing , 1997 .

[30]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[31]  Savita Gupta,et al.  Comparative Analysis of Image Compression Techniques: A Case Study on Medical Images , 2009, 2009 International Conference on Advances in Recent Technologies in Communication and Computing.

[32]  Richard L. Lewis,et al.  The mind and brain of short-term memory. , 2008, Annual review of psychology.

[33]  Roger P. Davies PACS: A Guide to the Digital Revolution , 2004 .

[34]  Alfred Inselberg,et al.  Parallel Coordinates: Visualization, Exploration and Classification of High-Dimensional Data , 2008 .

[35]  Tobias Isenberg,et al.  A Systematic Review on the Practice of Evaluating Visualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[36]  Lorenzo Trippa,et al.  Mitigating Bias in Generalized Linear Mixed Models: The Case for Bayesian Nonparametrics. , 2016, Statistical science : a review journal of the Institute of Mathematical Statistics.

[37]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[38]  Cheri Speier,et al.  The influence of information presentation formats on complex task decision-making performance , 2006, Int. J. Hum. Comput. Stud..

[39]  Xin Zhao,et al.  Structure revealing techniques based on parallel coordinates plot , 2012, The Visual Computer.

[40]  Dragan Ivetic,et al.  Medical Image on the Go! , 2011, Journal of Medical Systems.

[41]  Camilla Forsell,et al.  Evaluation of Parallel Coordinates: Overview, Categorization and Guidelines for Future Research , 2016, IEEE Transactions on Visualization and Computer Graphics.

[42]  Dragan Ivetic,et al.  Request redirection paradigm in medical image archive implementation , 2012, Comput. Methods Programs Biomed..

[43]  David S. Ebert,et al.  Experimental analysis of the effectiveness of features in Chernoff faces , 2000, Applied Imaging Pattern Recognition.

[44]  Jack G. Zheng Data Visualization in Business Intelligence , 2017 .

[45]  Wei Xiang,et al.  Error resilience analysis of wireless image transmission using JPEG, JPEG 2000 and JPWL , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[46]  David W. Polly,et al.  Dedicated Spine Measurement Software Quantifies Key Spino-Pelvic Parameters More Reliably than Traditional PACS , 2016 .

[47]  Soo-Mi Choi,et al.  Interactive Visualization of Diagnostic Data from Cardiac Images Using 3D Glyphs , 2003, ISMDA.

[48]  Touradj Ebrahimi,et al.  JPEG 2000 performance evaluation and assessment , 2002, Signal Process. Image Commun..

[49]  Barend Köbben,et al.  Evaluating dynamic visual variables , 1995 .

[50]  Xiaotong Liu,et al.  Multi-Resolution Climate Ensemble Parameter Analysis with Nested Parallel Coordinates Plots , 2017, IEEE Transactions on Visualization and Computer Graphics.