KAVAGait: Knowledge-Assisted Visual Analytics for Clinical Gait Analysis

In 2014, more than 10 million people in the US were affected by an ambulatory disability. Thus, gait rehabilitation is a crucial part of health care systems. The quantification of human locomotion enables clinicians to describe and analyze a patient's gait performance in detail and allows them to base clinical decisions on objective data. These assessments generate a vast amount of complex data which need to be interpreted in a short time period. We conducted a design study in cooperation with gait analysis experts to develop a novel Knowledge-Assisted Visual Analytics solution for clinical Gait analysis (KAVAGait). KAVAGait allows the clinician to store and inspect complex data derived during clinical gait analysis. The system incorporates innovative and interactive visual interface concepts, which were developed based on the needs of clinicians. Additionally, an explicit knowledge store (EKS) allows externalization and storage of implicit knowledge from clinicians. It makes this information available for others, supporting the process of data inspection and clinical decision making. We validated our system by conducting expert reviews, a user study, and a case study. Results suggest that KAVAGait is able to support a clinician during clinical practice by visualizing complex gait data and providing knowledge of other clinicians.

[1]  Hermann Schwameder,et al.  Computer aided analysis of gait patterns in patients with acute anterior cruciate ligament injury. , 2016, Clinical biomechanics.

[2]  Steven Franconeri,et al.  The Connected Scatterplot for Presenting Paired Time Series , 2016, IEEE Transactions on Visualization and Computer Graphics.

[3]  Denise Paschoal Soares,et al.  Principal component analysis in ground reaction forces and center of pressure gait waveforms of people with transfemoral amputation , 2016, Prosthetics and orthotics international.

[4]  Tobias Schreck,et al.  TimeSeriesPaths : Projection-Based Explorative Analysis of Multivariate Time Series Data , 2012, WSCG 2012.

[5]  J. Nadal,et al.  Application of principal component analysis in vertical ground reaction force to discriminate normal and abnormal gait. , 2009, Gait & posture.

[6]  Wolfgang Aigner,et al.  A knowledge-assisted visual malware analysis system: Design, validation, and reflection of KAMAS , 2016, Comput. Secur..

[7]  Min Chen,et al.  Data, Information, and Knowledge in Visualization , 2009, IEEE Computer Graphics and Applications.

[8]  Christopher Andrews,et al.  The human is the loop: new directions for visual analytics , 2014, Journal of Intelligent Information Systems.

[9]  William Ribarsky,et al.  Defining and applying knowledge conversion processes to a visual analytics system , 2009, Comput. Graph..

[10]  Tamara Munzner,et al.  LiveRAC: interactive visual exploration of system management time-series data , 2008, CHI.

[11]  Lucy T. Nowell,et al.  ThemeRiver: Visualizing Thematic Changes in Large Document Collections , 2002, IEEE Trans. Vis. Comput. Graph..

[12]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[13]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[14]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[15]  Karthik Ramani,et al.  MotionFlow: Visual Abstraction and Aggregation of Sequential Patterns in Human Motion Tracking Data , 2016, IEEE Transactions on Visualization and Computer Graphics.

[16]  Silvia Miksch,et al.  Gnaeus: Utilizing Clinical Guidelines for Knowledge-assisted Visualisation of EHR Cohorts , 2015, EuroVA@EuroVis.

[17]  Jolanta Pauk,et al.  Gait patterns classification based on cluster and bicluster analysis , 2016 .

[18]  Alan Cooper,et al.  About Face 3: the essentials of interaction design , 1995 .

[19]  B. Nigg,et al.  Asymmetries in ground reaction force patterns in normal human gait. , 1989, Medicine and science in sports and exercise.

[20]  Fenglin Liu,et al.  Parkinson's disease classification using gait analysis via deterministic learning , 2016, Neuroscience Letters.

[21]  Jurandir Nadal,et al.  Human gait classification after lower limb fracture using Artificial Neural Networks and principal component analysis , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[22]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[23]  Daniel A. Keim,et al.  Mastering the Information Age - Solving Problems with Visual Analytics , 2010 .

[24]  Sarah von Schrader,et al.  2010 Disability Status Report, United States , 2011 .

[25]  Charles Perin,et al.  SoccerStories: A Kick-off for Visual Soccer Analysis , 2013, IEEE Transactions on Visualization and Computer Graphics.

[26]  Reinhard Klein,et al.  Efficient unsupervised temporal segmentation of human motion , 2014, SCA '14.

[27]  Kevin J Deluzio,et al.  A Global Gait Asymmetry Index. , 2016, Journal of applied biomechanics.

[28]  Daniel A. Keim,et al.  Bring It to the Pitch: Combining Video and Movement Data to Enhance Team Sport Analysis , 2018, IEEE Transactions on Visualization and Computer Graphics.

[29]  Stephen G. Eick,et al.  Data visualization sliders , 1994, UIST '94.

[30]  Jürgen Bernard,et al.  FuryExplorer: visual-interactive exploration of horse motion capture data , 2015, Electronic Imaging.

[31]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 1: theoretical background. , 2005, Gait & posture.

[32]  Yingcai Wu,et al.  PieceStack: Toward Better Understanding of Stacked Graphs , 2016, IEEE Transactions on Visualization and Computer Graphics.

[33]  Daniel A. Keim,et al.  Visual Analytics of Movement , 2013, Springer Berlin Heidelberg.

[34]  A. Burstein Basic Biomechanics of the Musculoskeletal System. 3rd ed. , 2001 .

[35]  Tobias Schreck,et al.  MotionExplorer: Exploratory Search in Human Motion Capture Data Based on Hierarchical Aggregation , 2013, IEEE Transactions on Visualization and Computer Graphics.

[36]  Tamara Munzner,et al.  Design Study Methodology: Reflections from the Trenches and the Stacks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[37]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[38]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[39]  Tobias Schreck,et al.  Visual Cluster Analysis of Trajectory Data with Interactive Kohonen Maps , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[40]  R. Major Biomechanics of the Musculo-Skeletal System , 1994 .

[41]  Christopher Kirtley,et al.  Clinical Gait Analysis: Theory and Practice , 2006 .

[42]  Silvia Miksch,et al.  A matter of time: Applying a data-users-tasks design triangle to visual analytics of time-oriented data , 2014, Comput. Graph..

[43]  Min Chen,et al.  Knowledge-Assisted Ranking: A Visual Analytic Application for Sports Event Data , 2016, IEEE Computer Graphics and Applications.

[44]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[45]  Tamara Munzner,et al.  A Nested Model for Visualization Design and Validation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[46]  Nick Cramer,et al.  Familiarity Vs Trust: A Comparative Study of Domain Scientists' Trust in Visual Analytics and Conventional Analysis Methods , 2017, IEEE Transactions on Visualization and Computer Graphics.

[47]  Daniel A. Keim,et al.  Feature-driven visual analytics of soccer data , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[48]  Jeffrey Heer,et al.  Sizing the horizon: the effects of chart size and layering on the graphical perception of time series visualizations , 2009, CHI.

[49]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[50]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[51]  Daniel J. Wigdor,et al.  PhenoLines: Phenotype Comparison Visualizations for Disease Subtyping via Topic Models , 2018, IEEE Transactions on Visualization and Computer Graphics.

[52]  Joseph Hamill,et al.  Biomechanical Basis of Human Movement , 1995 .

[53]  Jaime Urquiza-Fuentes,et al.  Human-Centered Aspects , 2006, Human-Centered Visualization Environments.

[54]  Arnaud Sallaberry,et al.  Visual analysis of body movement in serious games for healthcare , 2016, 2016 IEEE Pacific Visualization Symposium (PacificVis).

[55]  Silvia Miksch,et al.  Qualizon graphs: space-efficient time-series visualization with qualitative abstractions , 2014, AVI.

[56]  Florian Windhager,et al.  Should we Dream the Impossible Dream of Reproducibility in Visual Analytics Evaluation? , 2015, EuroRV³@EuroVis.

[57]  Richard Baker,et al.  GaitaBase: Web-based repository system for gait analysis , 2010, Comput. Biol. Medicine.

[58]  Silvia Miksch,et al.  The Role of Explicit Knowledge: A Conceptual Model of Knowledge-Assisted Visual Analytics , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[59]  Lane Harrison,et al.  PROACT: Iterative Design of a Patient-Centered Visualization for Effective Prostate Cancer Health Risk Communication , 2017, IEEE Transactions on Visualization and Computer Graphics.

[60]  Niklas Elmqvist,et al.  Graphical Perception of Multiple Time Series , 2010, IEEE Transactions on Visualization and Computer Graphics.

[61]  David A. Winter,et al.  Biomechanics and Motor Control of Human Movement , 1990 .

[62]  Carole A. Tucker,et al.  Measuring Walking: A Handbook of Clinical Gait Analysis , 2014 .

[63]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[64]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.