Discrimination of consonant articulation location by tactile stimulation of the forearm

In this paper, we evaluate the ability of four able-bodied participants to discriminate the articulation location for spoken consonants, using tactile cues presented on the dorsal side of their forearm. Additionally, we determine the processing capability of the dorsal forearm's skin with a tactile sleeve worn by ten participants using two psychophysical studies. Our first study shows that 2–3 tactors arranged along the length of the forearm can be reliably identified by human users, when only the location of vibration is varied. Our second study indicates that the physical placement of localized vibrations map linearly to the perceived physical arrangement. Based on these findings, the subsequent speech experiment uses six tactors placed equidistant from each other and maps location of the constriction inside the mouth as directional cues on the forearm. Results of the speech study show that participants are able to indicate which of two randomly presented tactile cues (derived from consonant-vowel-consonant (CVC) non-sense syllables) has the preceding consonant closer to the lips. The discrimination performance is better (i) with fricatives than plosives, (ii) when the consonants are produced further apart inside the mouth, and (iii) when both place and manner of articulation feature is varied. The study also shows that discrimination performance with cues applied to the forearm is inferior to that with the fingerpads utilized in a previous study.

[1]  A M Ali,et al.  Acoustic-phonetic features for the automatic classification of fricatives. , 2001, The Journal of the Acoustical Society of America.

[2]  W. M. Rabinowitz,et al.  Information transmission with a multifinger tactual display , 1999, Perception & psychophysics.

[3]  Ali Israr,et al.  Discrimination of Vowels with a Multi-finger Tactual Display , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[4]  Ali Israr Tactual transmission of phonetic features , 2007 .

[5]  L A Scadden Tactile Pattern Recognition and Body Loci , 1973, Perception.

[6]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[7]  J M Weisenberger,et al.  The Transmission of Phoneme‐Level Information by Multichannel Tactile Speech Perception Aids , 1995, Ear and hearing.

[8]  A. Jongman Acoustics of American English Speech: A Dynamic Approach , 1995 .

[9]  H. Tan,et al.  Frequency and amplitude discrimination along the kinestheticcutaneous continuum in the presence of masking stimuli. , 2006, The Journal of the Acoustical Society of America.

[10]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[11]  P L Brooks,et al.  Evaluation of a tactile vocoder for work recognition. , 1983, The Journal of the Acoustical Society of America.

[12]  R. Klatzky,et al.  Feeling textures through a probe: Effects of probe and surface geometry and exploratory factors , 2003, Perception & psychophysics.

[13]  W. R. Garner Uncertainty and structure as psychological concepts , 1975 .

[14]  Hong Z. Tan,et al.  Discrimination and identification of finger joint-angle position using active motion , 2007, TAP.

[15]  Ali Israr,et al.  Controller design and consonantal contrast coding using a multi-finger tactual display. , 2009, The Journal of the Acoustical Society of America.

[16]  Alex Pentland,et al.  Tactual displays for sensory substitution and wearable computers , 2005, SIGGRAPH Courses.

[17]  Kimberly Myles,et al.  Vibrotactile Sensitivity of the Head , 2009 .

[18]  J. Zwislocki,et al.  Absolute scaling of sensory magnitudes: A validation , 1980, Perception & psychophysics.

[19]  R. Cholewiak,et al.  Vibrotactile localization on the abdomen: Effects of place and space , 2004, Perception & psychophysics.

[20]  M E Demorest,et al.  Lipreading sentences with vibrotactile vocoders: performance of normal-hearing and hearing-impaired subjects. , 1991, The Journal of the Acoustical Society of America.

[21]  Hanfeng Yuan,et al.  Tactual display of consonant voicing to supplement lipreading , 2005, The Journal of the Acoustical Society of America.

[22]  A. A. Collins,et al.  Vibrotactile localization on the arm: Effects of place, space, and age , 2003, Perception & psychophysics.

[23]  A. Jongman,et al.  Acoustic characteristics of English fricatives. , 2000, The Journal of the Acoustical Society of America.

[24]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[25]  Jan Van der Spiegel,et al.  Acoustic-phonetic features for the automatic classification of stop consonants , 2001, IEEE Trans. Speech Audio Process..

[26]  Nathaniel I. Durlach,et al.  Note on Information Transfer Rates in Human Communication , 1998, Presence.

[27]  Hui Tang,et al.  Tactile sensitivity of the tongue on photolithographically fabricated patterns , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[28]  Robert H. Gault,et al.  Progress in experiments on tactual interpretation of oral speech. , 1924 .

[29]  Ali Israr,et al.  A low cost vibrotactile array to manage respiratory motion , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[30]  C M Reed,et al.  Research on the Tadoma method of speech communication. , 1983, The Journal of the Acoustical Society of America.