Detection and direction estimation of a sudden loud sound for the hearing assistive eyeglasses

An assistive device for the hearing-impaired is proposed to detect and visually display the direction of incidence when a sudden loud sound occurs out of sight. The result is intuitively presented in four angular regions, such as the front, back, left, right regions, through the three procedures; decision of the sound occurrence, reduction of reflections, and direction estimation. Basic concepts of the direction estimation is to use the four directional microphones steering toward corresponding angular regions, and each directional microphone is realized by the array signal processing based on the modified LCMV beamformer. The result is obtained by comparing the beamformer output levels, and leads our attention to corresponding region using LEDs only when a sudden loud sound is detected. The detection is performed using the change of the overall sound pressure level with respect to time as a feature, and its performance and latency are affected by the length of temporal integration. To keep the performance with short latency, an amplitude follower is applied.

[1]  E. B. Newman,et al.  The precedence effect in sound localization. , 1949, The American journal of psychology.

[2]  James A. Landay,et al.  Can you see what i hear?: the design and evaluation of a peripheral sound display for the deaf , 2003, CHI '03.

[3]  Guy W. McNally,et al.  Dynamic Range Control of Digital Audio Signals , 1984 .

[4]  C.-C. Jay Kuo,et al.  Audio content analysis for online audiovisual data segmentation and classification , 2001, IEEE Trans. Speech Audio Process..

[5]  Birger Kollmeier,et al.  Speech pause detection for noise spectrum estimation by tracking power envelope dynamics , 2002, IEEE Trans. Speech Audio Process..

[6]  J. Capon.  High-resolution frequency-wavenumber spectrum analysis , 1969 .

[7]  Mohamad Adnan Al-Alaoui,et al.  Sound Visualization for the Hearing Impaired , 2007, iJET.

[8]  S. Gökhun Tanyer,et al.  Voice activity detection in nonstationary noise , 2000, IEEE Trans. Speech Audio Process..

[9]  Alain Dufaux.  Detection and Recognition of Impulsive Sound Signals , 2001 .

[10]  R. Patterson.  Auditory warning sounds in the work environment. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Daniel J. Tollin,et al.  The Precedence Effect in Sound Localization , 2015, Journal of the Association for Research in Otolaryngology.

[12]  Fausto Pellandini,et al.  Automatic sound detection and recognition for noisy environment , 2000, 2000 10th European Signal Processing Conference.

[13]  R. Lacoss.  DATA ADAPTIVE SPECTRAL ANALYSIS METHODS , 1971 .

[14]  Wei Zhang,et al.  A soft voice activity detector based on a Laplacian-Gaussian model , 2003, IEEE Trans. Speech Audio Process..

[15]  Yang-Hann Kim,et al.  Generation of an acoustically bright zone with an illuminated region using multiple sources. , 2002, The Journal of the Acoustical Society of America.

[16]  M. D. Evans,et al.  A multifunction domestic alert system for the deaf-blind , 1995 .

[17]  H S Colburn,et al.  The precedence effect. , 1999, The Journal of the Acoustical Society of America.

[18]  Hans Wallach,et al.  The precedence effect in sound localization. , 1949, The American journal of psychology.

[19]  William C. Mann,et al.  Smart Technology for Aging, Disability and Independence: The State of the Science , 2005 .

[20]  Qiru Zhou,et al.  Robust endpoint detection and energy normalization for real-time speech and speaker recognition , 2002, IEEE Trans. Speech Audio Process..

[21]  T. F. Mayfield,et al.  Auditory Warning Sounds in the Work Environment [ and Discussion ] , 2008 .