HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow

Current haptic devices are often bulky and rigid, making them unsuitable for ubiquitous interaction and scenarios where the user must also interact with the real world. To address this gap, we propose HydroRing, an unobtrusive, finger-worn device that can provide the tactile sensations of pressure, vibration, and temperature on the fingertip, enabling mixed-reality haptic interactions. Different from previous explorations, HydroRing in active mode delivers sensations using liquid travelling through a thin, flexible latex tube worn across the fingerpad, and has minimal impact on a user's dexterity and their perception of stimuli in passive mode. Two studies evaluated participants' ability to perceive and recognize sensations generated by the device, as well as their ability to perceive physical stimuli while wearing the device. We conclude by exploring several applications leveraging this mixed-reality haptics approach.

[1]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[2]  Tovi Grossman,et al.  Implanted user interfaces , 2012, CHI.

[3]  Brian Byunghyun Kang,et al.  Exo-Glove: A Wearable Robot for the Hand with a Soft Tendon Routing System , 2015, IEEE Robotics & Automation Magazine.

[4]  Hiroshi Ishii,et al.  Weight and volume changing device with liquid metal transfer , 2014, TEI '14.

[5]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[6]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[7]  Pedro Lopes,et al.  Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation , 2018, CHI.

[8]  Haipeng Mi,et al.  LIME: LIquid MEtal Interfaces for Non-Rigid Interaction , 2016, UIST.

[9]  Alexander Freed,et al.  Rogue One: A Star Wars Story , 2016 .

[10]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[11]  Paul Taylor,et al.  Touch sensitive electrorheological fluid based tactile display , 2005 .

[12]  Michael Rohs,et al.  Squeezeback: Pneumatic Compression for Notifications , 2017, CHI.

[13]  William R. Provancher,et al.  Design of a Fingertip-Mounted Tactile Display with Tangential Skin Displacement Feedback , 2010, IEEE Transactions on Haptics.

[14]  Pan Hui,et al.  A Survey on Haptic Technologies for Mobile Augmented Reality , 2017, ACM Comput. Surv..

[15]  Hideyuki Ando,et al.  The nail-mounted tactile display for the behavior modeling , 2002, SIGGRAPH '02.

[16]  N. Nguyen,et al.  Fundamentals and Applications of Microfluidics , 2002 .

[17]  Junji Furusho,et al.  Fast Response MR-Fluid Actuator , 2004 .

[18]  Claudio Pacchierotti,et al.  Design and development of a 3RRS wearable fingertip cutaneous device , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[19]  Steve Mann,et al.  Water Jets as Pixels: Water Fountains as Both Sensors and Displays , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[20]  Chris Harrison,et al.  3D Printing Pneumatic Device Controls with Variable Activation Force Capabilities , 2015, CHI.

[21]  Woohun Lee,et al.  HapThimble: A Wearable Haptic Device towards Usable Virtual Touch Screen , 2016, CHI.

[22]  Claudio Pacchierotti,et al.  The hRing: A wearable haptic device to avoid occlusions in hand tracking , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[23]  Hiroshi Ishii,et al.  PneUI: pneumatically actuated soft composite materials for shape changing interfaces , 2013, UIST.

[24]  Hendrik Richter,et al.  LiquiTouch: liquid as a medium for versatile tactile feedback on touch surfaces , 2013, TEI '13.

[25]  Sean Guynes-Vishniac.  Rogue One: A Star Wars Story (review) , 2019 .

[26]  Calle Sjöström,et al.  Using haptics in computer interfaces for blind people , 2001, CHI Extended Abstracts.

[27]  S. Tung,et al.  A cellular motor driven microfluidic system , 2003, TRANSDUCERS '03. 12th International Conference on Solid-State Sensors, Actuators and Microsystems. Digest of Technical Papers (Cat. No.03TH8664).

[28]  M. Heller.  The Psychology of Touch , 1991 .

[29]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[30]  Jan O. Borchers,et al.  MudPad: localized tactile feedback on touch surfaces , 2010, UIST '10.

[31]  Antonio Frisoli,et al.  A Fingertip Haptic Display for Improving Curvature Discrimination , 2008, PRESENCE: Teleoperators and Virtual Environments.

[32]  Geehyuk Lee,et al.  Designing a Non-contact Wearable Tactile Display Using Airflows , 2016, UIST.

[33]  Chwee Teck Lim,et al.  Emergence of microfluidic wearable technologies. , 2016, Lab on a chip.

[34]  Mattia Poggiani,et al.  A Wearable Fabric-based display for haptic multi-cue delivery , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[35]  Kazuhiko Terashima,et al.  LinkTouch: A wearable haptic device with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[36]  G. Whitesides.  The origins and the future of microfluidics , 2006, Nature.

[37]  Hideyuki Ando,et al.  Nail-mounted tactile display for boundary/texture augmentation , 2007, ACE '07.

[38]  Steven K. Feiner,et al.  Augmented Reality for Maintenance and Repair (ARMAR) , 2007 .

[39]  Sean Follmer,et al.  Wolverine: A wearable haptic interface for grasping in virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[40]  Kouta Minamizawa,et al.  Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics , 2017, SIGGRAPH Emerging Technologies.

[41]  Hiroshi Ishii,et al.  Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices , 2012, UIST.

[42]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[43]  Alex Olwal,et al.  Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality , 2017, UIST.

[44]  Kouta Minamizawa,et al.  Submerged haptics: a 3-DOF fingertip haptic display using miniature 3D printed airbags , 2017, SIGGRAPH Emerging Technologies.

[45]  Tek-Jin Nam,et al.  Inflatable mouse: volume-adjustable mouse with air-pressure-sensitive input and haptic feedback , 2008, CHI.

[46]  Maud Marchal,et al.  FlexiFingers: Multi-finger interaction in VR combining passive haptics and pseudo-haptics , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[47]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[48]  Florian Müller,et al.  Liquido: Embedding Liquids into 3D Printed Objects to Sense Tilting and Motion , 2016, CHI Extended Abstracts.

[49]  Allison M. Okamura,et al.  Fingertip Tactile Devices for Virtual Object Manipulation and Exploration , 2017, CHI.

[50]  S. Lederman,et al.  Perception of texture by vision and touch: multidimensionality and intersensory integration. , 1986, Journal of experimental psychology. Human perception and performance.

[51]  Paul Taylor,et al.  Investigation of the touch sensitivity of ER fluid based tactile display , 2005, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[52]  Vincent Miralles,et al.  A Review of Heating and Temperature Control in Microfluidic Systems: Techniques and Applications , 2013, Diagnostics.

[53]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[54]  Robert W. Lindeman,et al.  Wearable vibrotactile systems for virtual contact and information display , 2006, Virtual Reality.