Vibro-tactile Feedback for Real-world Awareness in Immersive Virtual Environments

In immersive virtual environments (IVE), users' visual and auditory perception is replaced by computer-generated stimuli. Thus, knowing the positions of real objects is crucial for physical safety. While some solutions exist, e. g., using virtual replicas or visible cues indicating the interaction space boundaries, these are limiting the IVE design or depend on the hardware setup. Moreover, most solutions cannot handle lost tracking, erroneous tracker calibration, or moving obstacles. However, these are common scenarios especially for the increasingly popular home virtual reality settings. In this paper, we present a stand-alone hardware device designed to alert IVE users for potential collisions with real-world objects. It uses distance sensors mounted on a head-mounted display (HMD) and vibro-tactile actuators inserted into the HMD's face cushion. We implemented different types of sensor-actuator mappings with the goal to find a mapping function that is minimally obtrusive in normal use, but efficiently alerting in risk situations.

[1]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[2]  Dario Floreano,et al.  Quantifying Information Transfer Through a Head-Attached Vibrotactile Display: Principles for Design and Control , 2012, IEEE Transactions on Biomedical Engineering.

[3]  Matthias Budde,et al.  VibrationCap: studying vibrotactile localization on the human head with an unobtrusive wearable tactile display , 2017, SEMWEB.

[4]  Eduardo E. Veas,et al.  Vibrotactile patterns using sensitivity prioritisation , 2017, SEMWEB.

[5]  Luca Turchet,et al.  Haptic Feedback for Enhancing Realism of Walking Simulations , 2013, IEEE Transactions on Haptics.

[6]  Michael Rohs,et al.  HapticHead: 3D Guidance and Target Acquisition through a Vibrotactile Grid , 2016, CHI Extended Abstracts.

[7]  T Mark Beasley,et al.  Rank-Based Inverse Normal Transformations are Increasingly Used, But are They Merited? , 2009, Behavior genetics.

[8]  Luca Turchet.  Designing presence for real locomotion in immersive virtual environments: an affordance-based experiential approach , 2015, Virtual Reality.

[9]  Gerd Bruder,et al.  Augmented Virtual Studio for Architectural Exploration , 2010 .

[10]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[11]  Anderson Maciel,et al.  Designing a Vibrotactile Head-Mounted Display for Spatial Awareness in 3D Spaces , 2017, IEEE Transactions on Visualization and Computer Graphics.

[12]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Masatoshi Ishikawa,et al.  Augmenting spatial awareness with Haptic Radar , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[14]  Dimitar Valkov,et al.  Smooth immersion: the benefits of making the transition to virtual environments a continuous process , 2017, SUI.

[15]  Michael Rohs,et al.  Wearable head-mounted 3D tactile display application scenarios , 2016, MobileHCI Adjunct.

[16]  James A. Landay,et al.  ActiVibe: Design and Evaluation of Vibrations for Progress Monitoring , 2016, CHI.

[17]  Victoria Interrante,et al.  Distance Perception in Immersive Virtual Environments, Revisited , 2006, VR.

[18]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[19]  Tony J. Prescott,et al.  Centralizing Bias and the Vibrotactile Funneling Illusion on the Forehead , 2014, EuroHaptics.

[20]  Eduardo E. Veas,et al.  Personalising vibrotactile displays through perceptual sensitivity adjustment , 2017, SEMWEB.

[21]  C. E. Rash,et al.  Helmet-mounted Displays: Sensation, Perception, and Cognition Issues , 2009 .

[22]  Per Backlund,et al.  Sidh - a Game Based Firefighter Training Simulation , 2007, 2007 11th International Conference Information Visualization (IV '07).

[23]  Sergio Garrido-Jurado,et al.  Procedurally generated virtual reality from 3D reconstructed physical space , 2016, VRST.

[24]  Lorna M. Brown,et al.  Multidimensional tactons for non-visual information presentation in mobile devices , 2006, Mobile HCI.

[25]  Robert E. Schlegel,et al.  Tactile Stimulation of the Human Head for Information Display , 1994 .

[26]  Daniel Thalmann,et al.  A wearable system for mobility improvement of visually impaired people , 2007, The Visual Computer.

[27]  Herbert Edelsbrunner,et al.  Viewing geometric protein structures from inside a CAVE , 1996, IEEE Computer Graphics and Applications.

[28]  Enrico Rukzio,et al.  Unconstrained Pedestrian Navigation based on Vibro-tactile Feedback around the Wristband of a Smartwatch , 2016, CHI Extended Abstracts.

[29]  Anderson Maciel,et al.  Spatial discrimination of vibrotactile stimuli around the head , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[30]  Kimberly Myles,et al.  Guidelines for Head Tactile Communication , 2010 .

[31]  Vincent Hayward,et al.  Do it yourself haptics: part I , 2007, IEEE Robotics & Automation Magazine.

[32]  Timo Ropinski,et al.  The holodeck construction manual , 2008, SIGGRAPH '08.

[33]  Victor A. Mateevitsi,et al.  Sensing the environment through SpiderSense , 2013, AH.

[34]  Mel Slater,et al.  Visual Realism Enhances Realistic Response in an Immersive Virtual Environment , 2009, IEEE Computer Graphics and Applications.

[35]  Luca Giulio Brayda,et al.  An investigation of search behaviour in a tactile exploration task for sighted and non-sighted adults. , 2011, CHI EA '11.