Controller design and consonantal contrast coding using a multi-finger tactual display.

This paper presents the design and evaluation of a new controller for a multi-finger tactual display in speech communication. A two-degree-of-freedom controller consisting of a feedback controller and a prefilter and its application in a consonant contrasting experiment are presented. The feedback controller provides stable, fast, and robust response of the fingerpad interface and the prefilter shapes the frequency-response of the closed-loop system to match with the human detection-threshold function. The controller is subsequently used in a speech communication system that extracts spectral features from recorded speech signals and presents them as vibrational-motional waveforms to three digits on a receiver's left hand. Performance from a consonantal contrast test suggests that participants are able to identify tactual cues necessary for discriminating consonants in the initial position of consonant-vowel-consonant (CVC) segments. The average sensitivity indices for contrasting voicing, place, and manner features are 3.5, 2.7, and 3.4, respectively. The results show that the consonantal features can be successfully transmitted by utilizing a broad range of the kinesthetic-cutaneous sensory system. The present study also demonstrates the validity of designing controllers that take into account not only the electromechanical properties of the hardware, but the sensory characteristics of the human user.

[1]  Jan Van der Spiegel,et al.  Acoustic-phonetic features for the automatic classification of stop consonants , 2001, IEEE Trans. Speech Audio Process..

[2]  W. M. Rabinowitz,et al.  Information transmission with a multifinger tactual display , 1999, Perception & psychophysics.

[3]  I. Summers Tactile Aids for the Hearing Impaired , 1992 .

[4]  Nathaniel I. Durlach,et al.  Note on Information Transfer Rates in Human Communication , 1998, Presence.

[5]  A Boothroyd,et al.  Comparison of Two Multichannel Tactile Devices as Supplements to Speechreading in a Postlingually Deafened Adult , 1995, Ear and hearing.

[6]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[7]  A M Ali,et al.  Acoustic-phonetic features for the automatic classification of fricatives. , 2001, The Journal of the Acoustical Society of America.

[8]  Hong Z. Tan,et al.  A New Mult-Finger Tactual Display , 1996, Dynamic Systems and Control.

[9]  Charlotte M Reed,et al.  Temporal masking of multidimensional tactual stimuli. , 2003, The Journal of the Acoustical Society of America.

[10]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[11]  P K Kuhl,et al.  The contribution of fundamental frequency, amplitude envelope, and voicing duration cues to speechreading in normal-hearing subjects. , 1985, The Journal of the Acoustical Society of America.

[12]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[13]  A. Jongman,et al.  Acoustic characteristics of English fricatives. , 2000, The Journal of the Acoustical Society of America.

[14]  John C Stevens,et al.  Tactile information transfer: a comparison of two stimulation sites. , 2005, The Journal of the Acoustical Society of America.

[15]  S S Hsiao,et al.  Detection of vibration transmitted through an object grasped in the hand. , 1999, Journal of neurophysiology.

[16]  James C. Bliss Kinesthetic-tactile communications , 1962, IRE Trans. Inf. Theory.

[17]  M. Leek Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[18]  Hanfeng Yuan,et al.  Tactual display of consonant voicing to supplement lipreading , 2005, The Journal of the Acoustical Society of America.

[19]  C. L. Doren The effects of a surround on vibrotactile thresholds: Evidence for spatial and temporal independence in the non-Pacinian I (NP I) channel , 1990 .

[20]  J. Craig,et al.  Vibrotactile masking and the persistence of tactual features , 1987, Perception & psychophysics.

[21]  R W Cholewiak,et al.  Vibrotactile threshold in young and old observers: the effects of spatial summation and the presence of a rigid surround. , 1996, The Journal of the Acoustical Society of America.

[22]  C M Reed,et al.  Reception of Morse code through motional, vibrotactile, and auditory stimulation , 1997, Perception & psychophysics.

[23]  G A Gescheider,et al.  The effects of a surround on vibrotactile thresholds. , 1978, Sensory processes.

[24]  B H Brown,et al.  Vibrotactile and electrotactile perception of time-varying pulse trains. , 1994, The Journal of the Acoustical Society of America.

[25]  Ali Israr Tactual transmission of phonetic features , 2007 .

[26]  J M Weisenberger,et al.  Evaluation of two multichannel tactile aids for the hearing impaired. , 1989, The Journal of the Acoustical Society of America.

[27]  P J Blamey,et al.  A comparison of Tactaid II+ and Tactaid 7 use by adults with a profound hearing impairment. , 1999, Ear and hearing.

[28]  P. Evans,et al.  Vibrotactile masking: Temporal integration, persistence, and strengths of representations , 1987, Perception & psychophysics.

[29]  J M Weisenberger,et al.  The Transmission of Phoneme‐Level Information by Multichannel Tactile Speech Perception Aids , 1995, Ear and hearing.

[30]  C. Van Doren,et al.  The effects of a surround on vibrotactile thresholds: evidence for spatial and temporal independence in the non-Pacinian I (NPI) channel. , 1990, The Journal of the Acoustical Society of America.

[31]  H. Tan,et al.  Frequency and amplitude discrimination along the kinestheticcutaneous continuum in the presence of masking stimuli. , 2006, The Journal of the Acoustical Society of America.

[32]  N I Durlach,et al.  Tactile communication of speech: comparison of two computer-based displays. , 1988, Journal of rehabilitation research and development.

[33]  C M Reed,et al.  Research on the Tadoma method of speech communication. , 1983, The Journal of the Acoustical Society of America.