Rendering volumetric haptic shapes in mid-air using ultrasound

We present a method for creating three-dimensional haptic shapes in mid-air using focused ultrasound. This approach applies the principles of acoustic radiation force, whereby the non-linear effects of sound produce forces on the skin which are strong enough to generate tactile sensations. This mid-air haptic feedback eliminates the need for any attachment of actuators or contact with physical devices. The user perceives a discernible haptic shape when the corresponding acoustic interference pattern is generated above a precisely controlled two-dimensional phased array of ultrasound transducers. In this paper, we outline our algorithm for controlling the volumetric distribution of the acoustic radiation force field in the form of a three-dimensional shape. We demonstrate how we create this acoustic radiation force field and how we interact with it. We then describe our implementation of the system and provide evidence from both visual and technical evaluations of its ability to render different shapes. We conclude with a subjective user evaluation to examine users' performance for different shapes.

[1]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[2]  C.A. Cain,et al.  Multiple-focus ultrasound phased-array pattern synthesis: optimal driving-signal distributions for hyperthermia , 1989, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[3]  E. Carstensen,et al.  Tactile perception of ultrasound. , 1995, The Journal of the Acoustical Society of America.

[4]  P. Berkelman,et al.  Design of a Hemispherical Magnetic Levitation Haptic Interface Device , 1996, Dynamic Systems and Control.

[5]  L. Gavrilov,et al.  Mechanisms of Stimulation Effects of Focused Ultrasound on Neural Structures : Role of Nonlinear Effects , 2003 .

[6]  Wang Tianmiao,et al.  Design of data glove and arm type haptic interface , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[7]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[8]  Miriam Reiner,et al.  The role of haptics in immersive telecommunication environments , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Yuriko Suzuki,et al.  Air jet driven force feedback in virtual reality , 2005, IEEE Computer Graphics and Applications.

[10]  Gábor Székely,et al.  High Precision Augmented Reality Haptics , 2006 .

[11]  John H. Wright,et al.  Information-Processing Channels in the Tactile Sensory System: A Psychophysical and Physiological Analysis , 2008 .

[12]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  L. Gavrilov The possibility of generating focal regions of complex configurations in application to the problems of stimulation of human receptor structures by focused ultrasound , 2008 .

[14]  Myrthe A. Plaisier,et al.  Salient features in 3-D haptic shape perception , 2009, Attention, perception & psychophysics.

[15]  V. Nascov,et al.  Fast computation algorithm for the Rayleigh-Sommerfeld diffraction formula using a type of scaled convolution. , 2009, Applied optics.

[16]  Shy Shoham,et al.  Towards multifocal ultrasonic neural stimulation: pattern generation algorithms , 2010, Journal of neural engineering.

[17]  Hiroyuki Shinoda,et al.  Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound , 2010, IEEE Transactions on Haptics.

[18]  Sriram Subramanian,et al.  Adding haptic feedback to mobile tv , 2011, CHI Extended Abstracts.

[19]  L. R. Gavrilov,et al.  Focused ultrasound as a tool to input sensory information to humans (Review) , 2012 .

[20]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[21]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[22]  Sriram Subramanian,et al.  Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion , 2014, CHI.

[23]  M. Nowicki,et al.  FOR LEAP MOTION CONTROLLER , 2014 .