Stereo upmix-based binaural auralization for mobile devices

This paper presents a new binaural auralization algorithm suitable for mobile devices. A stereo-tomultichannel virtual upmix technique was utilized to expand the spatial dimension of stereo audio to a multichannel speaker space. In order to enhance subjective preferences and listener envelopment, reflections of the primary sound component were artificially generated by modeling a virtual ceiling and sidewalls based on concert hall acoustics. The uncorrelated ambient components were then distributed over spatial points at different azimuth and elevation angles. Computational efficiency was achieved by removing the redundant operations in each stage of the algorithm. Subjective tests were performed, and the results showed that the proposed algorithm significantly improves spatial perceptions of stereo audio being played over headphones.

[1]  Young-Cheol Park,et al.  Acoustic depth rendering for 3D multimedia applications , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[2]  Ee-Leng Tan,et al.  Linear Estimation Based Primary-Ambient Extraction for Stereo Audio Signals , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[3]  W. G. Gardner,et al.  HRTF measurements of a KEMAR , 1995 .

[4]  Gary Shapiro.  Consumer Electronics Association's Five Technology Trends to Watch: Exploring New Tech That Will Impact Our Lives , 2013, IEEE Consumer Electronics Magazine.

[5]  Do-Hyung Kim,et al.  Virtual reproduction of spherical multichannel sound over 5.1 speaker system , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[6]  Tomlinson Holman.  Surround Sound: Up and running , 2007 .

[7]  Seok-Pil Lee,et al.  Virtual source panning using multiple-wise vector base in the multispeaker stereo format , 2011, 2011 19th European Signal Processing Conference.

[8]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[9]  Christof Faller,et al.  Investigations on an Early-Reflection-Free Model for BRIRs , 2010 .

[10]  R. Dressler.  Dolby Surround Pro Logic II Decoder Principles of Operation , 2000 .

[11]  Mingsian R. Bai,et al.  Upmixing and Downmixing Two-Channel Stereo Audio for Consumer Electronics , 2007, ISM 2007.

[12]  Yoichi Ando,et al.  Concert Hall Acoustics , 1985 .

[13]  Gary S. Kendall,et al.  The Decorrelation of Audio Signals and Its Impact on Spatial Imagery , 1995 .

[14]  Young-Cheol Park,et al.  Stereo upmix-based binaural auralization for mobile devices , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[15]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[16]  Sunmin Kim,et al.  3D sound rendering system based on relationship between stereoscopic image and stereo sound for 3DTV , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[17]  Michael M. Goodwin,et al.  Geometric signal decompositions for spatial audio enhancement , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Thomas Esch,et al.  Model-Based Dereverberation Preserving Binaural Cues , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  M. Schroeder.  Binaural dissimilarity and optimum ceilings for concert halls: More lateral sound diffusion , 1979 .

[20]  Jeroen Breebaart,et al.  Phantom Materialization: A Novel Method to Enhance Stereo Audio Reproduction on Headphones , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[21]  H S Colburn,et al.  The precedence effect. , 1999, The Journal of the Acoustical Society of America.

[22]  Young-Cheol Park,et al.  Efficient Out of Head Localization System for Mobile Applications , 2006 .

[23]  Akio Ando,et al.  A 22.2 Multichannel Sound System for Ultrahigh-Definition TV (UHDTV) , 2008 .

[24]  Jacob Benesty,et al.  Enhancement of Spatial Sound Quality: A New Reverberation-Extraction Audio Upmixer , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[25]  Christof Faller,et al.  Multi-Loudspeaker Playback of Stereo Signals , 2006 .

[26]  Christof Faller,et al.  Binaural Reproduction of Stereo Signals Using Upmixing and Diffuse Rendering , 2011 .

[27]  Seok-Pil Lee,et al.  Efficient Primary-Ambient Decomposition Algorithm for Audio Upmix , 2012 .