Visuo-Haptic Illusions for Improving the Perceived Performance of Shape Displays

In this work, we utilize visuo-haptic illusions to improve the perceived performance of encountered-type haptic devices, specifically shape displays, in virtual reality. Shape displays are matrices of actuated pins that travel vertically to render physical shapes; however, they have limitations such as low resolution, small display size, and low pin speed. To address these limitations, we employ illusions such as redirection, scaling, and retargeting that take advantage of the visual dominance effect, the idea that vision often dominates when senses conflict. Our evaluation of these techniques suggests that redirecting sloped lines with angles less than 40 degrees onto a horizontal line is an effective technique for increasing the perceived resolution of the display. Scaling up the virtual object onto the shape display by a factor less than 1.8x can also increase the perceived resolution. Finally, using vertical redirection a perceived 3x speed increase can be achieved.

[1]  Satoshi Hasegawa,et al.  Cross-Field Aerial Haptics: Rendering Haptic Feedback in Air with Light and Acoustic Fields , 2016, CHI.

[2]  Ian R Summers,et al.  A broadband tactile array on the fingertip. , 2002, The Journal of the Acoustical Society of America.

[3]  Dongjun Lee,et al.  Enlarging just noticeable differences of visual-proprioceptive conflict in VR using haptic feedback , 2015, 2015 IEEE World Haptics Conference (WHC).

[4]  Simon Richir,et al.  Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[5]  Lynette A. Jones,et al.  Tactile and Haptic Illusions , 2011, IEEE Transactions on Haptics.

[6]  M W Riley,et al.  Force capability differences due to gloves. , 1985, Ergonomics.

[7]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[8]  Luv Kohli,et al.  Redirected touching: Warping space to remap passive haptics , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[9]  Y. Matsuoka,et al.  The tolerance for visual feedback distortions in a virtual environment , 2002, Physiology & Behavior.

[10]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[11]  Hiroshi Ishii,et al.  Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays , 2013, CHI.

[12]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[13]  Hiroshi Ishii,et al.  Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration , 2014, UIST.

[14]  Daniel J. Wigdor,et al.  Snake Charmer: Physically Enabling Virtual Objects , 2016, TEI.

[15]  Dongjun Lee,et al.  On utilizing pseudo-haptics for cutaneous fingertip haptic device , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[16]  Hiroshi Ishii,et al.  Relief: a scalable actuated shape display , 2010, TEI '10.

[17]  Takuji Narumi,et al.  Displaying shapes with various types of surfaces using visuo-haptic interaction , 2014, VRST '14.

[18]  Eyal Ofek,et al.  Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop , 2017, CHI.

[19]  Jun Rekimoto,et al.  Lumen: interactive visual and shape display for calm computing , 2004, SIGGRAPH '04.

[20]  Daniel Leithinger,et al.  Grasping information and collaborating through shape displays , 2015 .

[21]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[22]  Mary C. Whitton,et al.  Redirected touching: The effect of warping space on task performance , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[23]  Klaus H. Hinrichs,et al.  Imperceptible depth shifts for touch interaction with stereoscopic objects , 2014, CHI.

[24]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[25]  Hiroshi Ishii,et al.  Shape Displays: Spatial Interaction with Dynamic Physical Form , 2015, IEEE Computer Graphics and Applications.

[26]  R. Klatzky,et al.  Haptic exploration in the presence of vision. , 1993, Journal of experimental psychology. Human perception and performance.

[27]  J. Lanier,et al.  Model of Illusions and Virtual Reality , 2017, Front. Psychol..

[28]  Antoni Rodríguez-Fornells,et al.  Violating body movement semantics: Neural signatures of self-generated and external-generated errors , 2016, NeuroImage.

[29]  Sean Follmer,et al.  Wolverine: A Wearable Haptic Interface for Grasping in VR , 2016, UIST.

[30]  Wayne J. Book,et al.  Control concepts for digital clay , 2003 .

[31]  Takuji Narumi,et al.  Modifying an Identified Angle of Edged Shapes Using Pseudo-haptic Effects , 2012, EuroHaptics.

[32]  Hiroyuki Shinoda,et al.  Necessary spatial resolution for realistic tactile feeling display , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[33]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[34]  J. Gibson Observations on active touch. , 1962, Psychological review.

[35]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of curved lines. , 1933 .

[36]  Robert D. Howe,et al.  Mechanical Design and Control of a High-Bandwidth Shape Memory Alloy Tactile Display , 1997, ISER.

[37]  M. Reiner,et al.  Sensory dominance in combinations of audio, visual and haptic stimuli , 2009, Experimental Brain Research.

[38]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[39]  Takuji Narumi,et al.  Modifying an identified curved surface shape using pseudo-haptic effect , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[40]  Ivan Poupyrev,et al.  AIREAL: tactile gaming experiences in free air , 2013, SIGGRAPH '13.

[41]  Robert D. Howe,et al.  A tactile shape sensing and display system for teleoperated manipulation , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[42]  Michitaka Hirose,et al.  Simulation and presentation of curved surface in virtual reality environment through surface display , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[43]  Mark Burry,et al.  Aegis Hyposurface©: The Bordering of University and Practice , 2001 .

[44]  Hiroo Iwata,et al.  Project FEELEX: adding haptic surface to graphics , 2001, SIGGRAPH.

[45]  William A. McNeely,et al.  Robotic graphics: a new approach to force feedback for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[46]  Christopher R. Wagner,et al.  A tactile shape display using RC servomotors , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[47]  Sean Follmer,et al.  shapeShift: A Mobile Tabletop Shape Display for Tangible and Haptic Interaction , 2017, UIST.

[48]  Y. Fukui,et al.  Human shape recognition performance for 3D tactile display , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[49]  Gerd Bruder,et al.  Estimation of Detection Thresholds for Redirected Walking Techniques , 2010, IEEE Transactions on Visualization and Computer Graphics.

[50]  Allison M. Okamura,et al.  Haptic jamming: A deformable geometry, variable stiffness tactile display using pneumatics and particle jamming , 2013, 2013 World Haptics Conference (WHC).

[51]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.

[52]  Faisal Taher,et al.  Exploring Interactions with Physically Dynamic Bar Charts , 2015, CHI.