VR puzzle room for cognitive rehabilitation

The goal of this VR system is to simulate a puzzle / challenge for adaption in cognitive rehabilitation training. Development of the VR system is inspired by a 1st person puzzle-platform game where the player must navigate and complete through a series of puzzle rooms with each room being more difficult than the last. The unique features in this work include the use of “portals” and “portal gun”. The portal gun allows the player to shoot two separate “portals” on walls that will allow anything to be teleported from one portal to the other. Implemented on the Unity engine and SteamVR, the VR Toolkit is employed in modeling and script development. Technical innovations are made in modeling the animated and self-collision detectable spider; upon being collided with a weapon (bullet or blade) it uses a special dissolve shader to give the effect of disappearing gradually from the game. We present the specific tasks of cognitive rehabilitation, conceptualization of VR techniques and the detailed implementation of the system.

[1]  Lin Feng,et al.  Mobile Visualization of Biomedical Volume Datasets , 2012 .

[2]  Seah Hock Soon,et al.  NURBS Volume for Modelling Complex Objects , 2000, Volume Graphics.

[3]  Chee Kai Chua,et al.  Rapid Prototyping Applications in Medicine. Part 2: STL File Generation and Case Studies , 2001 .

[4]  Feng Lin,et al.  Graphical Simulation of Deformable Models , 2016, Springer International Publishing.

[5]  Seah Hock Soon,et al.  Coupling between Meshless FEM Modeling and Rendering on GPU for Real-time Physically-based Volumetric Deformation , 2012, J. WSCG.

[6]  Seah Hock Soon,et al.  Deformable volumetric model and isosurface: exploring a new approach for surface boundary construction , 1996, Comput. Graph..

[7]  Seah Hock Soon,et al.  Tunnel-free voxelisation of rational Bézier surfaces , 2003, The Visual Computer.

[8]  Arun Kumar,et al.  Mixed Spectrum Analysis on fMRI Time-Series , 2016, IEEE Transactions on Medical Imaging.

[9]  Hock Soon Seah,et al.  A flexible heterogeneous real-time digital image correlation system , 2018, Optics and Lasers in Engineering.

[10]  Lin Feng,et al.  A Novel GPU-Based Deformation Pipeline , 2012 .

[11]  Seah Hock Soon,et al.  Structure modeling and context-free grammar: exploring a new approach for surface boundary construction , 1997, Comput. Graph..

[12]  Seah Hock Soon,et al.  An effective 3D seed fill algorithm , 1998, Computers & graphics.

[13]  Patrick Cozzi.  Real-Time Volumetric Lighting for WebGL , 2015 .

[14]  Seah Hock Soon,et al.  A Volume Modeling Component of CAD , 2001, VG.

[15]  Feng Lin,et al.  A Graph-Theoretical Approach for Tracing Filamentary Structures in Neuronal and Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[16]  Feng Lin,et al.  On-Site Volume Rendering with GPU-Enabled Devices , 2014, Wirel. Pers. Commun..

[17]  Li Cheng,et al.  Transduction on Directed Graphs via Absorbing Random Walks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Zhenyu Jiang,et al.  GPU Accelerated Digital Volume Correlation , 2016 .

[19]  Chee Kai Chua,et al.  Rapid Prototyping Applications in Medicine. Part 1: NURBS-Based Volume Modelling , 2001 .

[20]  Seah Hock Soon,et al.  Modeling and dynamics simulation for deformable objects of orthotropic materials , 2016, The Visual Computer.

[21]  Zhongke Wu,et al.  Voxelization and fabrication of freeform models , 2007 .

[22]  Lin Feng,et al.  A Generic Mutual Information Based Algorithm for Spatial Registration of Multi-Modal Medical Images , 2011 .

[23]  Seah Hock Soon,et al.  Topology preserving voxelisation of rational Bézier and NURBS curves , 2003, Comput. Graph..

[24]  Seah Hock Soon,et al.  Spectral caustic rendering of a homogeneous caustic object based on wavelength clustering and eye sensitivity , 2014, The Visual Computer.

[25]  Lin Feng,et al.  Rule-based art pattern CAD , 1989, Comput. Graph..

[26]  Qian Zhang,et al.  PolarViz: a discriminating visualization and visual analytics tool for high-dimensional data , 2019, The Visual Computer.

[27]  Seah Hock Soon,et al.  Evaluation of difference bounds for computing rational Bézier curves and surfaces , 2004, Comput. Graph..

[28]  S. Jiaoying,et al.  Artificial intelligence in computer aided design , 1987 .