A Distributed Multimodal Multi-user Virtual Environment for Visualization and Query of Complex Data

This paper describes an early prototype of a distributed multimodal multi-user virtual environment used for the visualization and query of complex data. The system supports different user interfaces for viewing coloured 3D objects of various sizes representing high-dimensional data to allow visual exploration and pattern detection in the data. Users can navigate and query the environment by using multimodal interaction techniques including speech and gesture recognition. The system serves as a testbed to compare the usability of various interaction techniques for visualization and query of complex data.

[1]  Daniel A. Keim,et al.  Visual Analytics: Scope and Challenges , 2008, Visual Data Mining.

[2]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[3]  Christopher D. Wickens,et al.  Cognitive issues in virtual reality , 1995 .

[4]  Julio J. Valdés,et al.  Virtual Reality Representation of Information Systems and Decision Rules: An Exploratory Technique for Understanding Data and Knowledge Structure , 2003, RSFDGrC.

[5]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[6]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[7]  Pascal Savard,et al.  A comparative study of four input devices for desktop virtual walkthroughs , 2011, Comput. Hum. Behav..

[8]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[9]  Amir Mosavi.  Decision-making Software Architecture; the Visualization and Data Mining Assisted Approach , 2014 .

[10]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[11]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[12]  Andreas Holzinger,et al.  Human-Computer Interaction and Knowledge Discovery (HCI-KDD): What Is the Benefit of Bringing Those Two Fields to Work Together? , 2013, CD-ARES.

[13]  Lina J. Karam,et al.  A Study and Comparison of Human and Deep Learning Recognition Performance under Visual Distortions , 2017, 2017 26th International Conference on Computer Communication and Networks (ICCCN).