TanGo: Exploring Expressive Tangible Interactions on Head-Mounted Displays

We present TanGo, an always-available input modality on VR headset, which can be complementary to current VR accessories. TanGO is an active mechanical structure symmetrically equipped on Head-Mounted Display, enabling 3-dimensional bimanual sliding input with each degree of freedom furnished a brake system driven by micro servo generating totally 6 passive resistive force profiles. TanGo is an all-in-one structure that possess rich input and output while keeping compactness with the trade-offs between size, weight and usability. Users can actively gesture like pushing, shearing, or squeezing with specific output provided while allowing hands to rest in stationary experiences. TanGo also renders users flexibility to switch seamlessly between virtual and real usage in Augmented Reality without additional efforts and instruments. We demonstrate three applications to show the interaction space of TanGo and then discuss its limitation and show future possibilities based on preliminary user feedback.

[1]  Da-Yuan Huang,et al.  Aarnio: Passive Kinesthetic Force Output for Foreground Interactions on an Interactive Chair , 2019, CHI.

[2]  Xing-Dong Yang,et al.  Aero-plane: A Handheld Force-Feedback Device that Renders Weight Motion Illusion on a Virtual 2D Plane , 2019, UIST.

[3]  Da-Yuan Huang,et al.  Masque: Exploring Lateral Skin Stretch Feedback on the Face with Head-Mounted Displays , 2019, UIST.

[4]  Roshan Lalintha Peiris,et al.  FacePush: Introducing Normal Force on Face with Head-Mounted Displays , 2018, UIST.

[5]  Mehdi Setareh,et al.  Virtual-SAP: an immersive tool for visualizing the response of building structures to environmental conditions , 2003, IEEE Virtual Reality, 2003. Proceedings..

[6]  Geehyuk Lee,et al.  Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force , 2018, CHI Extended Abstracts.

[7]  Pattie Maes,et al.  GyroVR: Simulating Inertia in Virtual Reality using Head Worn Flywheels , 2016, UIST.

[8]  Takuji Narumi,et al.  Transcalibur: weight moving VR controller for dynamic rendering of 2D shape using haptic shape illusion , 2018, SIGGRAPH Emerging Technologies.

[9]  Yu-Chun Chen,et al.  Glissade: Generating Balance Shifting Feedback to Facilitate Auxiliary Digital Pen Input , 2020, CHI.

[10]  Dieter Schmalstieg,et al.  TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays , 2019, CHI.

[11]  Qian Han,et al.  Frictio: Passive Kinesthetic Force Feedback for Smart Ring Output , 2017, UIST.

[12]  Chi-Wing Fu,et al.  CardboardSense: Interacting with DIY Cardboard VR Headset by Tapping , 2016, Conference on Designing Interactive Systems.

[13]  Shwetak N. Patel,et al.  SqueezeBlock: using virtual springs in mobile devices for eyes-free interaction , 2010, UIST.

[14]  Jan Gugenheimer.  Nomadic Virtual Reality: Exploring New Interaction Concepts for Mobile Virtual Reality Head-Mounted Displays , 2016, UIST.

[15]  Bing-Yu Chen,et al.  ElastImpact: 2.5D Multilevel Instant Impact Using Elasticity on Head-Mounted Displays , 2019, UIST.

[16]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .

[17]  Enrico Rukzio,et al.  FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality , 2016, UIST.

[18]  Ellen Yi-Luen Do,et al.  Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions , 2017, CHI.

[19]  Da-Yuan Huang,et al.  RollingStone: Using Single Slip Taxel for Enhancing Active Finger Exploration with a Virtual Reality Controller , 2018, UIST.

[20]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[21]  Krzysztof Pietroszek,et al.  TickTockRay: smartwatch-based 3D pointing for smartphone-based virtual reality , 2016, VRST.

[22]  Christopher J. Riederer,et al.  Magnetic input for mobile virtual reality , 2015, SEMWEB.

[23]  Liwei Chan,et al.  FaceWidgets: Exploring Tangible Interaction on Face with Head-Mounted Displays , 2019, UIST.

[24]  Harpreet Sareen,et al.  FaceDisplay: Towards Asymmetric Multi-User Interaction for Nomadic Virtual Reality , 2018, CHI.

[25]  Rubaiat Habib Kazi,et al.  Experimental Evaluation of Sketching on Surfaces in VR , 2017, CHI.

[26]  Kouta Minamizawa,et al.  FrontFace: facilitating communication between HMD users and outsiders using front-facing-screen HMDs , 2017, MobileHCI.

[27]  Thad Starner,et al.  ScratchVR: low-cost, calibration-free sensing for tactile input on mobile virtual reality enclosures , 2018, UbiComp.

[28]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[29]  Xing-Dong Yang,et al.  Surround-see: enabling peripheral vision on smartphones during active use , 2013, UIST.

[30]  Eyal Ofek,et al.  CapstanCrunch: A Haptic VR Controller with User-supplied Force Feedback , 2019, UIST.

[31]  Alex Olwal,et al.  Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality , 2017, UIST.

[32]  Wei Peng,et al.  ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays , 2017, CHI.

[33]  Hemant Bhaskar Surale,et al.  TabletInVR: Exploring the Design Space for Using a Multi-Touch Tablet in Virtual Reality , 2019, CHI.

[34]  Antonio Krüger,et al.  Drag:on: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift , 2019, CHI.