Tactile Feedback for Above-Device Gesture Interfaces: Adding Touch to Touchless Interactions

Above-device gesture interfaces let people interact in the space above mobile devices using hand and finger movements. For example, users could gesture over a mobile phone or wearable without having to use the touchscreen. We look at how above-device interfaces can also give feedback in the space over the device. Recent haptic and wearable technologies give new ways to provide tactile feedback while gesturing, letting touchless gesture interfaces give touch feedback. In this paper we take a first detailed look at how tactile feedback can be given during above-device interaction. We compare approaches for giving feedback (ultrasound haptics, wearables and direct feedback) and also look at feedback design. Our findings show that tactile feedback can enhance above-device gesture interfaces.

[1]  David A. Forsyth,et al.  Around device interaction for multiscale navigation , 2012, Mobile HCI.

[2]  Jörg Müller,et al.  Design and evaluation of finger-count interaction: Combining multitouch gestures and menus , 2012, Int. J. Hum. Comput. Stud..

[3]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[4]  Stephen A. Brewster,et al.  Towards usable and acceptable above-device interactions , 2014, MobileHCI '14.

[5]  Jérôme Pasquero,et al.  A haptic wristwatch for eyes-free interactions , 2011, CHI.

[6]  Shahram Izadi,et al.  SideSight: multi-"touch" interaction around small devices , 2008, UIST '08.

[7]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[8]  Thad Starner,et al.  AirTouch: Synchronizing In-air Hand Gesture and On-body Tactile Feedback to Augment Mobile Gesture Interaction , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[9]  Hiroyuki Shinoda,et al.  Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound , 2010, IEEE Transactions on Haptics.

[10]  Jan O. Borchers,et al.  Understanding finger input above desktop devices , 2014, CHI.

[11]  Patrick Baudisch,et al.  Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device , 2011, UIST.

[12]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[13]  M. Ishikawa,et al.  In-air Typing Interface: Realizing 3D operation for mobile devices , 2012, The 1st IEEE Global Conference on Consumer Electronics 2012.

[14]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[15]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[16]  Sriram Subramanian,et al.  Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion , 2014, CHI.

[17]  Andreas Butz,et al.  Comparing Direct and Remote Tactile Feedback on Interactive Surfaces , 2012, EuroHaptics.

[18]  Sean White,et al.  Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring , 2011, CHI.

[19]  Chris Harrison,et al.  Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices , 2009, UIST '09.

[20]  Michael Rohs,et al.  HoverFlow: expanding the design space of around-device interaction , 2009, Mobile HCI.