Immersive analysis of user motion in VR applications

With the rise of virtual reality experiences for applications in entertainment, industry, science and medicine, the evaluation of human motion in immersive environments is becoming more important. By analysing the motion of virtual reality users, design choices and training progress in the virtual environment can be understood and improved. Since the motion is captured in a virtual environment, performing the analysis in the same environment provides a valuable context and guidance for the analysis. We have created a visual analysis system that is designed for immersive visualisation and exploration of human motion data. By combining suitable data mining algorithms with immersive visualisation techniques, we facilitate the reasoning and understanding of the underlying motion. We apply and evaluate this novel approach on a relevant VR application domain to identify and interpret motion patterns in a meaningful way.

[1]  Tobias Schreck,et al.  MotionExplorer: Exploratory Search in Human Motion Capture Data Based on Hierarchical Aggregation , 2013, IEEE Transactions on Visualization and Computer Graphics.

[2]  Timothy M. Kowalewski,et al.  Trajectory Mapper: Interactive Widgets and Artist-Designed Encodings for Visualizing Multivariate Trajectory Data , 2017, EuroVis.

[3]  Niklas Elmqvist,et al.  There Is No Spoon: Evaluating Performance, Space Use, and Presence with Expert Domain Users in Immersive Analytics , 2019, IEEE Transactions on Visualization and Computer Graphics.

[4]  Jason Jerald,et al.  The VR Book: Human-Centered Design for Virtual Reality , 2015 .

[5]  Cem Yuksel,et al.  On the parameterization of Catmull-Rom curves , 2009, Symposium on Solid and Physical Modeling.

[6]  Fionn Murtagh,et al.  Algorithms for hierarchical clustering: an overview, II , 2017, WIREs Data Mining Knowl. Discov..

[7]  Fionn Murtagh,et al.  Algorithms for hierarchical clustering: an overview , 2012, WIREs Data Mining Knowl. Discov..

[8]  R LewisJames,et al.  Item benchmarks for the system usability scale , 2018 .

[9]  Theodore Lim,et al.  Haptic virtual reality assembly – Moving towards Real Engineering Applications , 2010 .

[10]  Luciana Porcher Nedel,et al.  Immersive Visualization of Abstract Information: An Evaluation on Dimensionally-Reduced Data Scatterplots , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[11]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[12]  Ricardo Langner,et al.  Investigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices , 2017, ISS.

[13]  Y. Iwamoto,et al.  Evaluation of Skills in Arthroscopic Training Based on Trajectory and Force Data , 2009, Clinical orthopaedics and related research.

[14]  Tobias Schreck,et al.  Visual Cluster Analysis of Trajectory Data with Interactive Kohonen Maps , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[15]  Wolfgang Stuerzlinger,et al.  Evaluating an Immersive Space-Time Cube Geovisualization for Intuitive Trajectory Data Exploration , 2019, IEEE Transactions on Visualization and Computer Graphics.

[16]  Heidrun Schumann,et al.  Stacking-Based Visualization of Trajectory Attribute Data , 2012, IEEE Transactions on Visualization and Computer Graphics.

[17]  Tim Dwyer,et al.  Design space for spatio-data coordination: Tangible interaction devices for immersive information visualisation , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[18]  Brian Price.  Frank and Lillian Gilbreth and the Manufacture and Marketing of Motion Study, 1908-1924 , 1989 .

[19]  Franck Multon,et al.  Visual Perspective and Feedback Guidance for VR Free-Throw Training , 2015, IEEE Computer Graphics and Applications.

[20]  Irfan A. Essa,et al.  Video and accelerometer-based motion analysis for automated surgical skills assessment , 2017, International Journal of Computer Assisted Radiology and Surgery.

[21]  Daniel A. Keim,et al.  Dynamic Visual Abstraction of Soccer Movement , 2017, Comput. Graph. Forum.

[22]  Gennady L. Andrienko,et al.  Clustering Trajectories by Relevant Parts for Air Traffic Analysis , 2018, IEEE Transactions on Visualization and Computer Graphics.

[23]  Gennady L. Andrienko,et al.  Visual analytics of movement: An overview of methods, tools and procedures , 2013, Inf. Vis..

[24]  Theodore Lim,et al.  Development of a Haptic Virtual Reality System for Assembly Planning and Evaluation , 2013 .

[25]  Christian H. Bischof,et al.  Interactive Blood Damage Analysis for Ventricular Assist Devices , 2008, IEEE Transactions on Visualization and Computer Graphics.

[26]  Bruce H. Thomas,et al.  Immersive Collaborative Analysis of Network Connectivity: CAVE-style or Head-Mounted Display? , 2017, IEEE Transactions on Visualization and Computer Graphics.

[27]  Theodore Lim,et al.  Automated Coordinate Measuring Machine Inspection Planning Knowledge Capture and Formalization , 2018, J. Comput. Inf. Sci. Eng..

[28]  Christophe Hurter,et al.  FiberClay: Sculpting Three Dimensional Trajectories to Reveal Structural Insights , 2019, IEEE Transactions on Visualization and Computer Graphics.

[29]  Xiaoru Yuan,et al.  TripVista: Triple Perspective Visual Trajectory Analytics and its application on microscopic traffic data at a road intersection , 2011, 2011 IEEE Pacific Visualization Symposium.

[30]  Germanico Gonzalez-Badillo,et al.  The development of a physics and constraint-based haptic virtual assembly system , 2014 .

[31]  Jeff Sauro,et al.  Item benchmarks for the system usability scale , 2018 .

[32]  Bruce H. Thomas,et al.  GeoGate: Correlating Geo-Temporal Datasets Using an Augmented Reality Space-Time Cube and Tangible Interactions , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[33]  Matthias Klapperstück,et al.  Immersive Analytics , 2015, 2015 Big Data Visual Analytics (BDVA).

[34]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[35]  Gregory M. P. O'Hare,et al.  Virtual environment trajectory analysis: a basis for navigational assistance and scene adaptivity , 2005, Future Gener. Comput. Syst..

[36]  Stefan Buschmann,et al.  Animated visualization of spatial–temporal trajectory data for air-traffic analysis , 2016, The Visual Computer.

[37]  Jian Pei,et al.  2012- Data Mining. Concepts and Techniques, 3rd Edition.pdf , 2012 .

[38]  Daniel F. Keefe,et al.  Visualizing Motion Data in Virtual Reality: Understanding the Roles of Animation, Interaction, and Static Presentation , 2012, Comput. Graph. Forum.

[39]  Jie Li,et al.  Using Virtual Reality Technique to Enhance Experience of Exploring 3D Trajectory Visualizations , 2015, VINCI.

[40]  Huyen Nguyen,et al.  Immersive Visual Analysis of Insect Flight Behaviour , 2017 .

[41]  Christian Tominski,et al.  Visualization of Trajectory Attributes in Space–Time Cube and Trajectory Wall , 2014 .

[42]  Gabriel Zachmann,et al.  Virtual reality as a tool for verification of assembly and maintenance processes , 1999, Comput. Graph..