On the development of a frequency-lowering system that enhances place-of-articulation perception

Frequency lowering is a form of signal processing designed to deliver high-frequency speech cues to the residual hearing region of a listener with a high-frequency hearing loss. While this processing technique has been shown to improve the intelligibility of fricative and affricate consonants, perception of place of articulation has remained a challenge for hearing-impaired listeners, especially when the bandwidth of the speech signal is reduced during the frequency-lowering processing. This paper describes a modified vocoder-based frequency-lowering system similar to one reported by Posen, Reed, and Braida (1993), with the goal of improving place-of-articulation perception by enhancing the spectral differences of fricative consonants. In this system, frequency lowering is conditional; it suppresses the processing whenever the high-frequency portion (>400 Hz) of the speech signal is a periodic signal. In addition, the system separates non-sonorant consonants into three classes based on the spectral information (slope and peak location) of fricative consonants. Results from a group of normal-hearing listeners with our modified system show improved perception of frication and affrication features, as well as place-of-articulation distinction, without degrading the perception of nasals and semivowels compared to low-pass filtering and Posen et al.'s system.

[1]  J W Szostak,et al.  RNA aptamers that bind flavin and nicotinamide redox cofactors. , 1995, Journal of the American Chemical Society.

[2]  J. Keene,et al.  In vitro selection of RNA epitopes using autoimmune patient serum. , 1993, Journal of immunology.

[3]  P. Boersma.  Praat : doing phonetics by computer (version 5.1.05) , 2009 .

[4]  Hugh J. McDermott,et al.  Improvements in speech perception with an experimental nonlinear frequency compression hearing device , 2005, International journal of audiology.

[5]  P. Sigler,et al.  Structure of NF-κB p50 homodimer bound to a κB site , 1998, Nature.

[6]  C M Reed,et al.  Hearing aids--a review of past research on linear amplification, amplitude compression, and frequency lowering. , 1979, ASHA monographs.

[7]  N. Janjić,et al.  Inhibition of receptor binding by high-affinity RNA ligands to vascular endothelial growth factor. , 1994, Biochemistry.

[8]  Robert Allen Fox,et al.  Acoustic and spectral characteristics of young children's fricative productions: a developmental perspective. , 2005, The Journal of the Acoustical Society of America.

[9]  H J McDermott,et al.  Speech Perception with Steeply Sloping Hearing Loss: Effects of Frequency Transposition , 2000, British journal of audiology.

[10]  K. Harris.  Cues for the Discrimination of American English Fricatives in Spoken Syllables , 1958 .

[11]  J. Keene,et al.  Exploring molecular diversity with combinatorial shape libraries. , 1994, Trends in biochemical sciences.

[12]  Erin C. Schafer,et al.  Evaluation of nonlinear frequency compression for school-age children with moderate to moderately severe hearing loss. , 2010, Journal of the American Academy of Audiology.

[13]  L. Zhao,et al.  Interaction of the human T-cell lymphotrophic virus type I (HTLV-I) transcriptional activator Tax with cellular factors that bind specifically to the 21-base-pair repeats in the HTLV-I enhancer. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[14]  M. Green,et al.  HTLV-I Tax protein stimulation of DNA binding of bZIP proteins by enhancing dimerization. , 1993, Science.

[15]  Jace Wolfe,et al.  Long-term effects of non-linear frequency compression for children with moderate hearing loss , 2011, International journal of audiology.

[16]  R. Roeder,et al.  Cellular transcription factors and regulation of IL-2 receptor gene expression by HTLV-I tax gene product. , 1988, Science.

[17]  Brian C J Moore,et al.  Effect of linear and warped spectral transposition on consonant identification by normal-hearing listeners with a simulated dead region , 2010, International journal of audiology.

[18]  F. Kuk,et al.  Use of linear frequency transposition in simulated hearing loss. , 2008, Journal of the American Academy of Audiology.

[19]  C M Reed,et al.  Intelligibility of frequency-lowered speech produced by a channel vocoder. , 1993, Journal of rehabilitation research and development.

[20]  Jack W. Szostak,et al.  An RNA motif that binds ATP , 1993, Nature.

[21]  G. W. Hughes,et al.  Spectral Properties of Fricative Consonants , 1956 .

[22]  C M Reed,et al.  Development and testing of artificial low-frequency speech codes. , 1991, Journal of rehabilitation research and development.

[23]  Acoustic comparison of child and adult fricatives , 2000 .

[24]  J. Sadler,et al.  Localization of the single-stranded DNA binding site in the thrombin anion-binding exosite. , 1992, The Journal of biological chemistry.

[25]  Max Velmans.  The Design of Speech Recoding Devices for the Deaf: University of Manchester , 1974 .

[26]  Mary Pat Moeller,et al.  The importance of high-frequency audibility in the speech and language development of children with hearing loss. , 2004, Archives of otolaryngology--head & neck surgery.

[27]  S. Blumstein,et al.  On the role of the amplitude of the fricative noise in the perception of place of articulation in voiceless fricative consonants. , 1988, The Journal of the Acoustical Society of America.

[28]  B. Moore,et al.  Effects of low pass filtering on the intelligibility of speech in noise for people with and without dead regions at high frequencies. , 2001, The Journal of the Acoustical Society of America.

[29]  F. Richard Moore,et al.  Elements of computer music , 1990 .

[30]  A M Ali,et al.  Acoustic-phonetic features for the automatic classification of fricatives. , 2001, The Journal of the Acoustical Society of America.

[31]  D J Orchik,et al.  Use of frequency-shifted/time-compressed speech with hearing-impaired children. , 1976, Audiology : official organ of the International Society of Audiology.

[32]  J. Doudna,et al.  Selection of an RNA molecule that mimics a major autoantigenic epitope of human insulin receptor. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[33]  B. Cullen,et al.  In vitro selection of DNA elements highly responsive to the human T-cell lymphotropic virus type I transcriptional activator, Tax , 1994, Molecular and cellular biology.

[34]  J. Nyborg,et al.  Transactivation by the human T-cell leukemia virus Tax protein is mediated through enhanced binding of activating transcription factor-2 (ATF-2) ATF-2 response and cAMP element-binding protein (CREB). , 1993, The Journal of biological chemistry.

[35]  C M Reed,et al.  Discrimination of speech processed by low-pass filtering and pitch-invariant frequency lowering. , 1983, The Journal of the Acoustical Society of America.

[36]  K. Jeang,et al.  Mutational analysis of human T-cell leukemia virus type I Tax: regions necessary for function determined with 47 mutant proteins , 1992, Journal of virology.

[37]  W. Greene,et al.  Human T-cell leukemia virus type I Tax associates with and is negatively regulated by the NF-kappa B2 p100 gene product: implications for viral latency , 1994, Molecular and cellular biology.

[38]  E. Vermaas,et al.  Selection of single-stranded DNA molecules that bind and inhibit human thrombin , 1992, Nature.

[39]  Andrea Simpson,et al.  Frequency-Lowering Devices for Managing High-Frequency Hearing Loss: A Review , 2009, Trends in amplification.

[40]  L. Braida,et al.  Cross-frequency integration for consonant and vowel identification in bimodal hearing. , 2011, Journal of Speech, Language and Hearing Research.

[41]  L. Gold,et al.  RNA pseudoknots that inhibit human immunodeficiency virus type 1 reverse transcriptase. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Graeme M. Clark,et al.  A frequency importance function for a new monosyllabic word test , 1998 .

[43]  Hugh J. McDermott,et al.  Frequency-compression outcomes in listeners with steeply sloping audiograms , 2006, International journal of audiology.

[44]  M. Yoshida,et al.  The trans-activator tax of human T-cell leukemia virus type 1 (HTLV-1) interacts with cAMP-responsive element (CRE) binding and CRE modulator proteins that bind to the 21-base-pair enhancer of HTLV-1. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[45]  B. Moore,et al.  Using transposition to improve consonant discrimination and detection for listeners with severe high-frequency hearing loss , 2007, International Journal of Audiology.

[46]  C. Turner,et al.  High-frequency audibility: benefits for hearing-impaired listeners. , 1998, The Journal of the Acoustical Society of America.

[47]  M Velmans,et al.  Speech Imitation in Simulated Deafness, Using Visual Cues and Recoded' Auditory Information , 1973, Language and speech.

[48]  A. Jongman,et al.  Acoustic characteristics of English fricatives. , 2000, The Journal of the Acoustical Society of America.

[49]  R. S. McGowan,et al.  The emergence of phonetic segments: evidence from the spectral structure of fricative-vowel syllables spoken by children and adults. , 1989, Journal of speech and hearing research.

[50]  G. Franzoso,et al.  Kinetic analysis of human T-cell leukemia virus type I Tax-mediated activation of NF-kappa B , 1994, Molecular and cellular biology.

[51]  D. Turner,et al.  Predicting optimal and suboptimal secondary structure for RNA. , 1990, Methods in enzymology.

[52]  A. Pardi,et al.  High-resolution molecular discrimination by RNA. , 1994, Science.

[53]  T. Cech,et al.  Direct measurement of oligonucleotide substrate binding to wild-type and mutant ribozymes from Tetrahymena. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[54]  A. Jongman,et al.  Acoustic characteristics of clearly spoken English fricatives. , 2009, The Journal of the Acoustical Society of America.

[55]  G. A. Miller,et al.  Erratum: An Analysis of Perceptual Confusions Among Some English Consonants [J. Acoust. Soc. Am. 27, 339 (1955)] , 1955 .

[56]  R R Hurtig,et al.  Proportional frequency compression of speech for listeners with sensorineural hearing loss. , 1999, The Journal of the Acoustical Society of America.

[57]  Francis Kuk,et al.  Efficacy of linear frequency transposition on consonant identification in quiet and in noise. , 2009, Journal of the American Academy of Audiology.

[58]  W. Greene,et al.  Human T-cell leukemia virus type I Tax activation of NF-kappa B/Rel involves phosphorylation and degradation of I kappa B alpha and RelA (p65)-mediated induction of the c-rel gene , 1994, Molecular and cellular biology.

[59]  N. Janjić,et al.  High-affinity RNA ligands to basic fibroblast growth factor inhibit receptor binding. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Hugh J. McDermott,et al.  The use of frequency compression by cochlear implant recipients with postoperative acoustic hearing. , 2010, Journal of the American Academy of Audiology.

[61]  P. Burgstaller,et al.  Isolation of RNA Aptamers for Biological Cofactors by In Vitro Selection , 1994 .

[62]  I. Boros,et al.  Expansion of CREB's DNA recognition specificity by Tax results from interaction with Ala-Ala-Arg at positions 282-284 near the conserved DNA-binding domain of CREB. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Richard P. Lippmann,et al.  Perception of frequency lowered consonants , 1980 .

[64]  S. Blumstein,et al.  Acoustic characteristics of English voiceless fricatives: a descriptive analysis , 1988 .

[65]  A. Ellington,et al.  Aptamers as potential nucleic acid pharmaceuticals. , 1995, Biotechnology annual review.

[66]  R V Shannon,et al.  Consonant recordings for speech testing. , 1999, The Journal of the Acoustical Society of America.

[67]  J. Keene,et al.  In vitro selection of an RNA epitope immunologically cross-reactive with a peptide. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[68]  D. Bartel,et al.  Selective optimization of the Rev-binding element of HIV-1. , 1993, Nucleic acids research.

[69]  Tom Maniatis,et al.  Transcriptional activation: A complex puzzle with few easy pieces , 1994, Cell.

[70]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[71]  Robert Allen Fox,et al.  Sex-related acoustic changes in voiceless English fricatives. , 2005, Journal of speech, language, and hearing research : JSLHR.