Electrotactile and vibrotactile displays for sensory substitution systems

Sensory substitution systems provide their users with environmental information through a human sensory channel (eye, ear, or skin) different from that normally used or with the information processed in some useful way. The authors review the methods used to present visual, auditory, and modified tactile information to the skin and discuss present and potential future applications of sensory substitution, including tactile vision substitution (TVS), tactile auditory substitution, and remote tactile sensing or feedback (teletouch). The relevant sensory physiology of the skin, including the mechanisms of normal touch and the mechanisms and sensations associated with electrical stimulation of the skin using surface electrodes (electrotactile, or electrocutaneous, stimulation), is reviewed. The information-processing ability of the tactile sense and its relevance to sensory substitution is briefly summarized. The limitations of current tactile display technologies are discussed, and areas requiring further research for sensory substitution systems to become more practical are suggested.<<ETX>>

[1]  N. Maalej,et al.  A miniature electrooptical force transducer , 1988, IEEE Transactions on Biomedical Engineering.

[2]  F. Rattay,et al.  Modeling the excitation of fibers under surface electrodes , 1988, IEEE Transactions on Biomedical Engineering.

[3]  B L Zuber,et al.  Characteristics of Reading Rate and Manual Scanning Patterns of Blind Optacon Readers , 1983, Human factors.

[4]  Frank A. Geldard,et al.  The mutability of time and space on the skin. , 1983, The Journal of the Acoustical Society of America.

[5]  A. Higashiyama,et al.  The perceptual properties of electrocutaneous stimulation: Sensory quality, subjective intensity, and intensity-duration relation , 1981, Perception & psychophysics.

[6]  William Epstein,et al.  Amodal Information and Transmodal Perception , 1985 .

[7]  P. Lawrence,et al.  Electrocutaneous Nerve Stimulation-I: Model and Experiment , 1978, IEEE Transactions on Biomedical Engineering.

[8]  J D Meindl,et al.  Electrocutaneous stimulation in a reading aid for the blind. , 1971, IEEE transactions on bio-medical engineering.

[9]  S Grimnes.  Electrovibration, cutaneous sensation of microampere current. , 1983, Acta physiologica Scandinavica.

[10]  Peter Ning,et al.  Electrocutaneous stimulation L The effects of stimulus parameters on absolute threshold , 1982, Perception & psychophysics.

[11]  J. G. Webster,et al.  Analysis and Control of the Current Distribution under Circular Dispersive Electrodes , 1982, IEEE Transactions on Biomedical Engineering.

[12]  E P Gardner,et al.  Sensory funneling. I. Psychophysical observations of human subjects and responses of cutaneous mechanoreceptive afferents in the cat to patterned skin stimuli. , 1972, Journal of Neurophysiology.

[13]  R. Johansson,et al.  Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. , 1984, Human neurobiology.

[14]  P Bach-y-Rita,et al.  Transmission of pictorial information through the skin. , 1973, Advances in biological and medical physics.

[15]  S. D. Reimers,et al.  Kinesthetic Sensing for the EMG Controlled "Boston Arm" , 1970 .

[16]  G Jansson,et al.  Tactile guidance of movement. , 1983, The International journal of neuroscience.

[17]  H. E. Torebjörk,et al.  Sensory correlates of somatic afferent fibre activation. , 1984, Human neurobiology.

[18]  L. Geddes,et al.  Ability of the Lapicque and Blair strength-duration curves to fit experimentally obtained data from the dog heart , 1989, IEEE Transactions on Biomedical Engineering.

[19]  D W Sparks,et al.  The identification of the direction of electrocutaneous stimulation along lineal multistimulator arrays , 1979, Perception & psychophysics.

[20]  James C. Bliss,et al.  Optical-to-Tactile Image Conversion for the Blind , 1970 .

[21]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[22]  Willis J. Tompkins,et al.  Sensory substitution for space gloves and for space robots , 1987 .

[23]  P K Kuhl,et al.  Investigating the MESA (multipoint electrotactile speech aid): the transmission of connected discourse. , 1979, The Journal of the Acoustical Society of America.

[24]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[25]  John G. Webster,et al.  Voltage-current characteristics of the electrotactile skin-electrode interface , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[26]  Kenneth O. Johnson,et al.  Spatial and Nonspatial Neural Mechanisms Underlying Tactile Spatial Discrimination , 1984 .

[27]  Georg v. Békésy,et al.  Human Skin Perception of Traveling Waves Similar to Those on the Cochlea , 1955 .

[28]  Donald E. Troxel,et al.  An Electrotactile Display , 1970 .

[29]  P. Lawrence,et al.  Electrocutaneous Nerve Stimulation-II: Stimulus Waveform Selection , 1979, IEEE Transactions on Biomedical Engineering.

[30]  G. H. Bishop.  RESPONSES TO ELECTRICAL STIMULATION OF SINGLE SENSORY UNITS OF SKIN , 1943 .

[31]  S Grimnes,et al.  Pathways of ionic flow through human skin in vivo. , 1984, Acta dermato-venereologica.

[32]  George A. Gescheider,et al.  Vibrotactile Frequency Characteristics as Determined by Adaptation and Masking Procedures , 1979 .

[33]  W D Larkin,et al.  Strength/duration relationships for electrocutaneous sensitivity: Stimulation by capacitive discharges , 1984, Perception & psychophysics.

[34]  C A Phillips,et al.  Sensory feedback control of upper- and lower-extremity motor prostheses. , 1988, Critical reviews in biomedical engineering.

[35]  A. Vallbo,et al.  Tactile Sensation Related to Activity in Primary Afferents with Special Reference to Detection Problems , 1984 .

[36]  A. Vallbo,et al.  Sensations evoked from the glabrous skin of the human hand by electrical stimulation of unitary mechanosensitive afferents , 1981, Brain Research.

[37]  F A Saunders.  Information transmission across the skin: high-resolution tactile sensory aids for the deaf and the blind. , 1983, The International journal of neuroscience.

[38]  G A Gescheider,et al.  Vibrotactile forward masking: psychophysical evidence for a triplex theory of cutaneous mechanoreception. , 1985, The Journal of the Acoustical Society of America.

[39]  Kenneth J. Kokjer,et al.  The Information Capacity of the Human Fingertip , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[40]  A Higashiyama,et al.  Temporal and spatial integration for electrocutaneous stimulation , 1983, Perception & psychophysics.

[41]  K O Johnson,et al.  Tactile spatial resolution. I. Two-point discrimination, gap detection, grating resolution, and letter recognition. , 1981, Journal of neurophysiology.

[42]  W Greatbatch,et al.  Metal electrodes in bioengineering. , 1981, Critical reviews in bioengineering.

[43]  B. O'Shaughnessy.  The sense of touch , 1989 .

[44]  R. T. Verrillo.  TEMPORAL SUMMATION IN VIBROTACTILE SENSITIVITY. , 1965, The Journal of the Acoustical Society of America.

[45]  Ronald T. Verrillo.  Psychophysics of vibrotactile stimulation , 1983 .

[46]  Ronald Raymond Riso,et al.  COMPARISON OF SUBDERMAL VERSUS SURFACE ELECTROCUTANEOUS STIMULATION. , 1982 .

[47]  R. Johansson,et al.  Thresholds of mechanosensitive afferents in the human hand as measured with von Frey hairs , 1980, Brain Research.

[48]  A. Huxley,et al.  The action potential in the myelinated nerve fibre of Xenopus laevis as computed on the basis of voltage clamp data , 1964, The Journal of physiology.

[49]  Carl E. Sherrick,et al.  Basic and applied research on tactile aids for deaf people: Progress and prospects , 1984 .

[50]  J. Holsheimer,et al.  A modeling study of nerve fascicle stimulation , 1989, IEEE Transactions on Biomedical Engineering.

[51]  P.H. Veltink,et al.  Influences of stimulation conditions on recruitment of myelinated nerve fibres: a model study , 1988, IEEE Transactions on Biomedical Engineering.

[52]  U. Lindblom,et al.  Properties of touch receptors in distal glabrous skin of the monkey. , 1965, Journal of neurophysiology.

[53]  V. Mountcastle,et al.  The sense of flutter-vibration: comparison of the human capacity with response patterns of mechanoreceptive afferents from the monkey hand. , 1968, Journal of neurophysiology.

[54]  D. Sinclair,et al.  MECHANISMS OF CUTANEOUS SENSATION , 1982, The Ulster Medical Journal.

[55]  A. E. Edmonds,et al.  Investigating the MESA (multipoint electrotactile speech aid): the transmission of segmental features of speech. , 1978, The Journal of the Acoustical Society of America.

[56]  Carter C. Collins,et al.  On Mobility Aids for the Blind , 1985 .

[57]  N. Mackay,et al.  Pain Sensations Associated with Electrocutaneous Stimulation , 1976, IEEE Transactions on Biomedical Engineering.

[58]  G. L. Aiello,et al.  Psychophysical Response to Electrocutaneous Stimulation , 1984, IEEE Transactions on Biomedical Engineering.

[59]  Georg v. Békésy,et al.  Sensations on the Skin Similar to Directional Hearing, Beats, and Harmonics of the Ear , 1957 .

[60]  A.Y.J. Szeto,et al.  Technological devices for deaf-blind children: needs and potential impact , 1988, IEEE Engineering in Medicine and Biology Magazine.

[61]  D. S. Alles,et al.  Information Transmission by Phantom Sensations , 1970 .

[62]  Esther P. Gardner,et al.  Cortical Neuronal Mechanisms Underlying the Perception of Motion Across the Skin , 1984 .

[63]  Ulf Lindblom.  The Afferent Discharge Elicited by Vibrotactile Stimulation , 1970 .

[64]  L. Geddes.  Electrodes and the measurement of bioelectric events , 1972 .

[65]  R. Johansson,et al.  Detection of tactile stimuli. Thresholds of afferent units related to psychophysical thresholds in the human hand. , 1979, The Journal of physiology.

[66]  S. S. Stevens.  The Psychophysics of Sensory Function. , 1960 .

[67]  A. Szeto,et al.  Electrocutaneous Pulse Rate and Pulse Width Psychometric Functions for Sensory Communications , 1979, Human factors.

[68]  A Boothroyd,et al.  Spatial, tactile presentation of voice fundamental frequency as a supplement to lipreading: results of extended training with a single subject. , 1988, Journal of rehabilitation research and development.

[69]  George A. Gescheider,et al.  Some Comparisons between Touch and Hearing , 1970 .

[70]  P J Blamey,et al.  A wearable multiple-electrode electrotactile speech processor for the profoundly deaf. , 1985, The Journal of the Acoustical Society of America.

[71]  Benjamin White,et al.  Perceptual Findings with the Vision-Substitution System , 1970 .

[72]  J. Loomis,et al.  Sensitivity to shifts of a point stimulus: An instance of tactile hyperacuity , 1978, Perception & psychophysics.

[73]  B Tursky,et al.  Reliability and interjudgment predictability of subjective judgments of electrocutaneous stimulation. , 1972, Psychophysiology.

[74]  P J Blamey,et al.  Psychophysical studies relevant to the design of a digital electrotactile speech processor. , 1987, The Journal of the Acoustical Society of America.

[75]  P L Brooks,et al.  Continuing evaluation of the Queen's University tactile vocoder. I: Identification of open set words. , 1986, Journal of rehabilitation research and development.

[76]  J B Spitzer,et al.  Vibrotactile stimulation for the adventitiously deaf: an alternative to cochlear implantation. , 1986, Archives of physical medicine and rehabilitation.

[77]  P L Brooks,et al.  The development and evaluation of a tactile vocoder for the profoundly deaf. , 1986, Canadian journal of public health = Revue canadienne de sante publique.

[78]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[79]  Ronald Raymond Riso,et al.  SUBDERMAL STIMULATION FOR ELECTROCUTANEOUS COMMUNICATION. , 1983 .

[80]  F. Rattay.  Analysis of models for extracellular fiber stimulation , 1989, IEEE Transactions on Biomedical Engineering.

[81]  R. LaMotte,et al.  Peripheral neural correlates of magnitude of cutaneous pain and hyperalgesia: simultaneous recordings in humans of sensory judgments of pain and evoked responses in nociceptors with C-fibers. , 1984, Journal of neurophysiology.

[82]  C. H. Rogers.  Choice of Stimulator Frequency for Tactile Arrays , 1970 .

[83]  J. Patrick Reilly,et al.  Application of a Neuroelectric Model to Electrocutaneous Sensory Sensitivity: Parameter Variation Study , 1987, IEEE Transactions on Biomedical Engineering.

[84]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[85]  C T WHITE,et al.  Temporal numerosity: IV. A comparison of the major senses. , 1959, Journal of Experimental Psychology.

[86]  John Lyman,et al.  Electrocutaneous Tracking: A Methodology for Evaluating Sensory Feedback Codes , 1979, IEEE Transactions on Biomedical Engineering.

[87]  I. Darian‐Smith,et al.  Peripheral neural representation of the spatial frequency of a grating moving across the monkey's finger pad. , 1980, The Journal of physiology.

[88]  Juhani Hyvärinen,et al.  Electrical stimulation of human hair follicles via microelectrodes , 1973 .

[89]  M. Goldstein,et al.  Tactile aids for profoundly deaf children. , 1985, The Journal of the Acoustical Society of America.

[90]  J. Phillips,et al.  Neural mechanisms of scanned and stationary touch. , 1985, The Journal of the Acoustical Society of America.

[91]  C M Reed,et al.  Research on tactile communication of speech: a review. , 1982, ASHA monographs.

[92]  F A GELDARD,et al.  Some neglected possibilities of communication. , 1960, Science.

[93]  Carter C. Collins,et al.  Tactile Television - Mechanical and Electrical Image Projection , 1970 .

[94]  Frank A. Saunders,et al.  Electrocutaneous Stimulation for Sensory Communication in Rehabilitation Engineering , 1982, IEEE Transactions on Biomedical Engineering.