Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model

Humans can estimate the shape of a wielded object through the illusory feeling of the mass properties of the object obtained using their hands. Even though the shape of hand-held objects influences immersion and realism in virtual reality (VR), it is difficult to design VR controllers for rendering desired shapes according to the perceptions derived from the illusory effects of mass properties and shape perception. We propose Transcalibur, which is a hand-held VR controller that can render a 2D shape by changing its mass properties on a 2D planar area. We built a computational perception model using a data-driven approach from the collected data pairs of mass properties and perceived shapes. This enables Transcalibur to easily and effectively provide convincing shape perception based on complex illusory effects. Our user study showed that the system succeeded in providing the perception of various desired shapes in a virtual environment.

[1]  Eyal Ofek,et al.  CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality , 2018, CHI.

[2]  Pedro Lopes,et al.  Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation , 2018, CHI.

[3]  Matti Nelimarkka,et al.  The 8th International Conference on Tangible, Embedded and Embodied Interaction - TEI '14 , 2014 .

[4]  Woohun Lee,et al.  Hapcube: a tactile actuator providing tangential and normal pseudo-force feedback on a fingertip , 2018, SIGGRAPH Emerging Technologies.

[5]  Seungmoon Choi,et al.  Substituting Motion Effects with Vibrotactile Effects for 4D Experiences , 2018, CHI.

[6]  E. Tronci,et al.  1996 , 1997, Affair of the Heart.

[7]  Eyal Ofek,et al.  Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation , 2018, CHI.

[8]  Hiroshi Ishii,et al.  Weight and volume changing device with liquid metal transfer , 2014, TEI '14.

[9]  Pedro Lopes,et al.  Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation , 2015, UIST.

[10]  Allison M. Okamura,et al.  Fingertip Tactile Devices for Virtual Object Manipulation and Exploration , 2017, CHI.

[11]  M T Turvey,et al.  Perceiving the width and height of a hand-held object by dynamic touch. , 1998, Journal of experimental psychology. Human perception and performance.

[12]  Ryuta Okazaki,et al.  FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation , 2016, SIGGRAPH Emerging Technologies.

[13]  Geehyuk Lee,et al.  Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force , 2018, CHI.

[14]  Seung-Bok Choi,et al.  A magnetorheological fluid-based multifunctional haptic device for vehicular instrument controls , 2009 .

[15]  Masahiko Inami,et al.  Leviopole: mid-air haptic interactions using multirotor , 2018, SIGGRAPH Emerging Technologies.

[16]  Hyelip Lee,et al.  Wind-blaster: a wearable propeller-based prototype that provides ungrounded force-feedback , 2018, SIGGRAPH Emerging Technologies.

[17]  Sean Follmer,et al.  Wolverine: A Wearable Haptic Interface for Grasping in VR , 2016, UIST.

[18]  Fabian Hemmert,et al.  Weight-shifting mobiles: two-dimensional gravitational displays in mobile phones , 2010, CHI Extended Abstracts.

[19]  Michitaka Hirose,et al.  Implementation of Partial Surface Display , 1998, Presence.

[20]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[21]  Hiroo Iwata,et al.  Project FEELEX: adding haptic surface to graphics , 2001, SIGGRAPH.

[22]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[23]  G. Jantzen.  1988 , 1988, The Winning Cars of the Indianapolis 500.

[24]  M T Turvey,et al.  Haptically perceiving the distances reachable with hand-held objects. , 1988, Journal of experimental psychology. Human perception and performance.

[25]  Anderson Maciel,et al.  Experiencing guidance in 3D spaces with a vibrotactile head-mounted display , 2017, 2017 IEEE Virtual Reality (VR).

[26]  Peter J Beek,et al.  Which mechanical invariants are associated with the perception of length and heaviness of a nonvisible handheld rod? Testing the inertia tensor hypothesis. , 2004, Journal of experimental psychology. Human perception and performance.

[27]  Jun Rekimoto,et al.  Traxion: a tactile interaction device with virtual force sensation , 2013, SIGGRAPH '14.

[28]  Takuji Narumi,et al.  Computational design of hand-held VR controllers using haptic shape illusion , 2017, VRST.

[29]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[30]  Lawrence H. Kim,et al.  Robotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality , 2017, ISS.

[31]  M. Turvey.  Dynamic touch. , 1996, The American psychologist.

[32]  M T Turvey,et al.  Tensorial basis to the constancy of perceived object extent over variations of dynamic touch , 1993, Perception & psychophysics.

[33]  Eyal Ofek,et al.  Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller , 2018, CHI.

[34]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.