Modality-Specific Differences in the Processing of Spatially, Temporally, and Spatiotemporally Distributed Information

The extent to which auditory, tactile, and visual perceptual representations are similar, particularly when dealing with speech and speech-like stimuli, was investigated. It was found that comparisons between auditory and tactile patterns were easier to perform than were similar comparisons between auditory and visual stimuli. This was true across a variety of styles of tactile and visual display, and was not due to limitations in the discriminability of the visual displays. The findings suggest that auditory and tactile representations of stimuli are more alike than are auditory and visual ones. It was also found that touch and vision differ in terms of the style of information distribution which they process most efficiently. Touch dealt with patterns best when the pattern was characterised by changes across time, whereas vision did best when spatially or spatiotemporally distributed patterns were presented. As the sense of hearing also seems to specialise in the processing of temporally ordered patterns, these results suggest one way in which the senses of hearing and touch differ from vision.

[1]  G. Békésy,et al.  Funneling in the Nervous System and its Role in Loudness and Sensation Intensity on the Skin , 1958 .

[2]  G. D. Goff.  Differential discrimination of frequency of cutaneous mechanical vibration. , 1967, Journal of experimental psychology.

[3]  N. O’connor,et al.  Seeing and hearing and space and time , 1978 .

[4]  G. Békésy,et al.  Neural Volleys and the Similarity between Some Sensations Produced by Tones and by Skin Vibrations , 1957 .

[5]  Jack M Loornis.  Tactile pattern perception , 1981 .

[6]  D. Oller,et al.  Similarities between tactual and auditory speech perception. , 1988, Journal of speech and hearing research.

[7]  D. Freides,et al.  Human information processing and sensory modality: cross-modal functions, information complexity, memory, and deficit. , 1974, Psychological bulletin.

[8]  Daiyo Sawada,et al.  Construction of haptic stimulus patterns for use in cross-modal and intramodal matching tasks , 1982 .

[9]  Georg v. Békésy,et al.  Human Skin Perception of Traveling Waves Similar to Those on the Cochlea , 1955 .

[10]  M. Bryden.  Auditory-visual and sequential-spatial matching in relation to reading ability. , 1972, Child development.

[11]  N. O’connor,et al.  Seeing and hearing and space and space and time , 1972 .

[12]  M. Björkman,et al.  Relations between intra-modal and cross-modal matching. , 1967, Scandinavian journal of psychology.

[13]  Georg v. Békésy,et al.  Similarities between hearing and skin sensations. , 1959 .

[14]  S. Handel,et al.  Pattern Perception: Integrating Information Presented in Two Modalities , 1968, Science.

[15]  F. Bellezza,et al.  Long-term memory for speaker’s voice and source location , 1976, Memory & cognition.

[16]  S Handel.  Space is to time as vision is to audition: seductive but misleading. , 1988, Journal of experimental psychology. Human perception and performance.

[17]  M Ittyerah,et al.  Inter- and Intra-Modal Processing of Sensory-Specific Stimuli , 1983, Perceptual and motor skills.

[18]  Carl E. Sherrick,et al.  Basic and applied research on tactile aids for deaf people: Progress and prospects , 1984 .

[19]  Drew H. Abney,et al.  Journal of Experimental Psychology : Human Perception and Performance Influence of Musical Groove on Postural Sway , 2015 .

[20]  S. S. Stevens.  Cross-modality validation of subjective scales for loudness, vibration, and electric shock. , 1959, Journal of experimental psychology.

[21]  J. Metcalfe,et al.  Spatial and temporal processing in the auditory and visual modalities , 1981, Memory & cognition.

[22]  R K Potter,et al.  VISIBLE PATTERNS OF SOUND. , 1945, Science.

[23]  Robert H. Gault,et al.  An Empirical Comparison of Audition, Vision, and Touch in the Discrimination of Temporal Patterns and Ability to Reproduce them , 1938 .

[24]  Trade-Off between Remembering Words and Their Source of Location , 1977, Perceptual and motor skills.

[25]  L. Marks.  On cross-modal similarity: Perceiving temporal patterns by hearing, touch, and vision , 1987, Perception & psychophysics.

[26]  L A Scadden,et al.  Effect of Stimulus-Change Method on Tactile-Image Recognition , 1971, Perceptual and motor skills.

[27]  S. S. Stevens.  Tactile vibration: dynamics of sensory intensity. , 1959, Journal of experimental psychology.

[28]  G. Békésy.  Current Status of Theories of Hearing , 1956 .

[29]  D. Mahar,et al.  Masking, Information Integration, and Tactile Pattern Perception: A Comparison of the Isolation and Integration Hypotheses , 1993, Perception.

[30]  J. Kirman.  Tactile communication of speech: a review and an analysis. , 1973, Psychological bulletin.

[31]  E. Gruenberg,et al.  Intramodal and crossmodal sensory transfer of visual and auditory temporal patterns , 1971 .

[32]  G. Sterritt,et al.  Auditory and Visual Rhythm Perception in Relation to Reading Ability in Fourth Grade Boys , 1966, Perceptual and motor skills.

[33]  G. von Békésy,et al.  Similarities between hearing and skin sensations. , 1959, Psychological review.

[34]  Michael Kubovy,et al.  Should We Resist the Seductiveness of the Space:Time::Vision:Audition Analogy? , 1988 .

[36]  W. R. Garner,et al.  The Perception and Learning of Temporal Patterns , 1968, The Quarterly journal of experimental psychology.

[37]  G. von Békésy,et al.  Current status of theories of hearing. , 1956, Science.

[38]  L E Marks,et al.  On cross-modal similarity: auditory-visual interactions in speeded discrimination. , 1987, Journal of experimental psychology. Human perception and performance.