Investigating the Recognition of Local Shapes Using Mid-air Ultrasound Haptics

Mid-air haptics technologies are able to convey haptic sensations without any direct contact between the user and the haptic interface. One representative example of this technology is ultrasound haptics, which uses ultrasonic phased arrays to deliver haptic sensations. Research on ultrasound haptics is only in its beginnings, and the literature still lacks principled perception studies in this domain. This paper presents a series of human subject experiments investigating important perceptual aspects related to the rendering of 2D shapes by an ultrasound haptic interface (the Ultrahaptics STRATOS platform). We carried out four user studies aiming at evaluating (i) the absolute detection threshold for a static focal point rendered via amplitude modulation, (ii) the absolute detection and identification thresholds for line patterns rendered via spatiotemporal modulation, (iii) the ability to discriminate different line orientations, and (iv) the ability to perceive virtual bumps and holes. These results shed light on the rendering capabilities and limitations of this novel technology for 2D shapes.

[1]  David R. Large,et al.  Exploring the Use of Mid-Air Ultrasonic Feedback to Enhance Automotive User Interfaces , 2018, AutomotiveUI.

[2]  Stephen A. Brewster,et al.  May the Force Be with You: Ultrasound Haptic Feedback for Mid-Air Gesture Interaction in Cars , 2018, AutomotiveUI.

[3]  Hiroyuki Shinoda,et al.  Airborne ultrasound tactile display , 2008, SIGGRAPH '08.

[4]  R. T. Verrillo,et al.  Effect of Contactor Area on the Vibrotactile Threshold , 1963 .

[5]  Slim Abdennadher,et al.  Rendering 3D virtual objects in mid-air using controlled magnetic fields , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  E. Carstensen,et al.  Tactile perception of ultrasound. , 1995, The Journal of the Acoustical Society of America.

[7]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[8]  Sriram Subramanian,et al.  Sparkle: Towards Haptic Hover-Feedback with Electric Arcs , 2016, UIST.

[9]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[10]  Hiroyuki Shinoda,et al.  Lateral Modulation of Midair Ultrasound Focus for Intensified Vibrotactile Stimuli , 2018, EuroHaptics.

[11]  Hiroyuki Shinoda,et al.  Aerial Vibrotactile Display Based on Multiunit Ultrasound Phased Array , 2018, IEEE Transactions on Haptics.

[12]  Desney S. Tan,et al.  AirWave: non-contact haptic feedback using air vortex rings , 2013, UbiComp.

[13]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[14]  Jong-Rak Park,et al.  Laser-induced thermoelastic effects can evoke tactile sensations , 2015, Scientific Reports.

[15]  Benjamin Long,et al.  Spatiotemporal modulation for mid-air haptic feedback from an ultrasonic phased array , 2018 .

[16]  Sriram Subramanian,et al.  Using Spatiotemporal Modulation to Draw Tactile Patterns in Mid-Air , 2018, EuroHaptics.

[17]  Leonid R. Gavrilov,et al.  A study of reception with the use of focused ultrasound. I. Effects on the skin and deep receptor structures in man , 1977, Brain Research.

[18]  Orestis Georgiou,et al.  Touchless Haptic Feedback for Supernatural VR Experiences , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[19]  Orestis Georgiou,et al.  Touchless Haptic Feedback for VR Rhythm Games , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).