Holographic Whisper: Rendering Audible Sound Spots in Three-dimensional Space by Focusing Ultrasonic Waves

We propose a novel method of spatial audio rendering using ultrasound. An ultrasonic phased array generates one or more focal points in air, and they act as point sources of audible sound when the ultrasound waves are modulated. Our sound-point loudspeaker has two major advantages over conventional ultrasound-based sound-beam (superdirectional) loudspeakers. The higher audience selectivity means that our sound-point loudspeaker can deliver sound to the ears of the target person, whereas a sound-beam loudspeaker delivers sound to not only the target person but also other persons standing in the same direction. The other advantage is lower exposure to ultrasound; while an audible sound beam travels along an ultrasonic beam in a soundbeam loudspeaker, audible sound can be heard along the direction perpendicular to the ultrasonic beam in our soundpoint loudspeaker. This paper reports the principles of our sound-point loudspeaker, prototype construction, evaluation, and applications.

[1]  Sriram Subramanian,et al.  Holographic acoustic elements for manipulation of levitated objects , 2015, Nature Communications.

[2]  A. J. Berkhout,et al.  A Holographic Approach to Acoustic Control , 1988 .

[3]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[4]  Colin H. Hansen,et al.  A Review of Current Ultrasound Exposure Limits , 2004 .

[5]  Daisuke Ikefuji,et al.  Multiple Audio Spots Design Based on Separating Emission of Carrier and Sideband Waves , 2014 .

[6]  Frank Joseph Pompei,et al.  The Use of Airborne Ultrasonics for Generating Audible Sound Beams , 1999 .

[7]  Sriram Subramanian,et al.  LeviPath: Modular Acoustic Levitation for 3D Path Visualisations , 2015, CHI.

[8]  Woon-Seng Gan,et al.  A digital beamsteerer for difference frequency in a parametric array , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  Hiroshi Mizoguchi,et al.  Three dimensional simulation and measurement of sound pressure distribution generated by 120 ch plane loudspeaker array , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[10]  Tomoo Kamakura,et al.  Parametric loudspeaker—characteristics of acoustic field and suitable modulation of carrier ultrasound , 1991 .

[11]  J Bengtsson,et al.  Kinoform design with an optimal-rotation-angle method. , 1994, Applied optics.

[12]  M. Yoneyama,et al.  The audio spotlight: An application of nonlinear interaction of sound waves to a new type of loudspeaker design , 1983 .

[13]  Woon-Seng Gan,et al.  A review of parametric acoustic array in air , 2012 .

[14]  J. Rekimoto,et al.  Three-dimensional noncontact manipulation by opposite ultrasonic phased arrays , 2014 .

[15]  Sriram Subramanian,et al.  Ghost Touch: Turning Surfaces into Interactive Tangible Canvases with Focused Ultrasound , 2015, ITS.

[16]  Woon-Seng Gan,et al.  An overview of directivity control methods of the parametric array loudspeaker , 2014, APSIPA Transactions on Signal and Information Processing.

[17]  Yasutoshi Makino,et al.  Active touch perception produced by airborne ultrasonic haptic hologram , 2015, 2015 IEEE World Haptics Conference (WHC).

[18]  Hiroyuki Shinoda,et al.  Aerial display of vibrotactile sensation with high spatial-temporal resolution using large-aperture airborne ultrasound phased array , 2013, 2013 World Haptics Conference (WHC).

[19]  Jun Rekimoto,et al.  Pixie dust: graphics generated by levitated and animated objects in computational acoustic-potential field , 2014, SIGGRAPH '14.

[20]  Steven A. Cummer,et al.  Acoustic Holographic Rendering with Two-dimensional Metamaterial-based Passive Phased Array , 2016, Scientific Reports.

[21]  Asier Marzo,et al.  GauntLev: A Wearable to Manipulate Free-floating Objects , 2016, CHI.

[22]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[23]  Hiroyuki Shinoda,et al.  Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound , 2010, IEEE Transactions on Haptics.

[24]  Yuta Sugiura,et al.  Graffiti fur: turning your carpet into a computer display , 2014, SIGGRAPH '14.