Exploring Multimodal Watch-back Tactile Display using Wind and Vibration

A tactile display on the back of a smartwatch is an attractive output option; however, its channel capacity is limited owing to the small contact area. In order to expand the channel capacity, we considered using two perceptually distinct types of stimuli, wind and vibration, together on the same skin area. The result is a multimodal tactile display that combines wind and vibration to create "colored" tactile sensations on the wrist. As a first step toward this goal, we conducted in this study four user experiments with a wind-vibration tactile display to examine different ways of combining wind and vibration: Individual, Sequential, and Simultaneous. The results revealed the sequential combination of wind and vibration to exhibit the highest potential, with an information transfer capacity of 3.29 bits. In particular, the transition of tactile modality was perceived at an accuracy of 98.52%. The current results confirm the feasibility and potential of a multimodal tactile display combining wind and vibration.

[1]  J. Ryu,et al.  Design and Psychophysical Evaluation of Pneumatic Tactile Display , 2006, 2006 SICE-ICASE International Joint Conference.

[2]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[3]  James A. Landay,et al.  BrushTouch: Exploring an Alternative Tactile Method for Wearable Haptics , 2017, CHI.

[4]  Patrick Baudisch,et al.  Skin Drag Displays: Dragging a Physical Tactor across the User's Skin Produces a Stronger Tactile Stimulus than Vibrotactile , 2015, CHI.

[5]  Lynette A. Jones,et al.  Warm or Cool, Large or Small? The Challenge of Thermal Displays , 2008, IEEE Transactions on Haptics.

[6]  Ian Oakley,et al.  Determining the Feasibility of Forearm Mounted Vibrotactile Displays , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[7]  Li-Wei Chan,et al.  EdgeVib: Effective Alphanumeric Character Output Using a Wrist-Worn Tactile Display , 2016, UIST.

[8]  Günther Schmidt,et al.  Display of Holistic Haptic Sensations by Combined Tactile and Kinesthetic Feedback , 2004, Presence: Teleoperators & Virtual Environments.

[9]  Lynette A. Jones,et al.  Evaluating Vibrotactile Dimensions for the Design of Tactons , 2014, IEEE Transactions on Haptics.

[10]  Katherine J. Kuchenbecker,et al.  Design of body-grounded tactile actuators for playback of human physical contact , 2011, 2011 IEEE World Haptics Conference.

[11]  Chris Schmandt,et al.  Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments , 2000, TCHI.

[12]  Hyunjoo Lee,et al.  A flexible multimodal tactile display for delivering shape and material information , 2015 .

[13]  H. Kajimoto,et al.  Ants in the Pants -ticklish tactile display using rotating brushes- , 2008, 2008 SICE Annual Conference.

[14]  Jun Rekimoto,et al.  GraspZoom: zooming and scrolling control model for single-handed mobile interaction , 2009, Mobile HCI.

[15]  Ryuta Okazaki,et al.  FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation , 2016, SIGGRAPH Emerging Technologies.

[16]  Sebastian Boring,et al.  WatchSense: On- and Above-Skin Input Sensing through a Wearable Depth Sensor , 2017, CHI.

[17]  Akio Yamamoto,et al.  Towards multimodal haptics for teleoperation: Design of a tactile thermal display , 2012, 2012 12th IEEE International Workshop on Advanced Motion Control (AMC).

[18]  J. Edward Colgate,et al.  Haptic interfaces for virtual environment and teleoperator systems , 1995 .

[19]  F. McGlone,et al.  The cutaneous sensory system , 2010, Neuroscience & Biobehavioral Reviews.

[20]  Geehyuk Lee,et al.  Designing a Non-contact Wearable Tactile Display Using Airflows , 2016, UIST.

[21]  Ravin Balakrishnan,et al.  HapticClench: Investigating Squeeze Sensations using Memory Alloys , 2017, UIST.

[22]  Hong Z. Tan,et al.  Tactor Localization at the Wrist , 2008, EuroHaptics.

[23]  Ding Xu,et al.  PneuHaptic: delivering haptic cues with a pneumatic armband , 2015, SEMWEB.

[24]  Thad Starner,et al.  BuzzWear: alert perception in wearable tactile displays on the wrist , 2010, CHI.

[25]  Hong Z. Tan,et al.  Optimum Information Transfer Rates for Communication through Haptic and Other Sensory Modalities , 2010, IEEE Transactions on Haptics.

[26]  Jonathan Rossiter,et al.  The Tickler: A Compliant Wearable Tactile Display for Stroking and Tickling , 2015, CHI Extended Abstracts.

[27]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[28]  Daniel P. Siewiorek,et al.  Design of a wearable tactile display , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[29]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[30]  Martin Halvey,et al.  Some like it hot: thermal feedback for mobile devices , 2011, CHI.

[31]  Gierad Laput,et al.  AuraSense: Enabling Expressive Around-Smartwatch Interactions with Electric Field Sensing , 2016, UIST.

[32]  Yaoping Hu,et al.  Force and vibrotactile integration for 3D user interaction within virtual environments , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[33]  Geehyuk Lee,et al.  Force gestures: augmenting touch screen gestures with normal and tangential forces , 2011, UIST.

[34]  Geehyuk Lee,et al.  Investigating the Information Transfer Efficiency of a 3x3 Watch-back Tactile Display , 2015, CHI.