Chapter 16 The development of temporal and spatial intermodal perception

Temporal and spatial intermodal equivalence relations provide an important basis for the perception of multimodal unity. Although some have claimed that intermodal perceptual capacities are innate, it is shown that empirical findings from human infants do not support this conclusion. Moreover, it is argued that developmental epigenetic systems theory provides a useful, process-oriented approach to understanding the development of intermodal perception. As an example of the epigenetic systems approach, empirical findings on the development of temporal and spatial intermodal perception are reviewed and a model of the development of temporally based intermodal responsiveness is presented. Furthermore, it is shown that in human infants responsiveness to temporal intermodal equivalence relations develops earlier than to spatial ones. Finally, it is proposed that whereas the development of responsiveness to temporal and spatial intermodal equivalence relations may be interdependent in early human development, it may not be in species faced with different ecological and evolutionary pressures.

[1]  David J. Lewkowicz,et al.  Infants' response to temporally based intersensory equivalence: The effect of synchronous sounds on visual preferences for moving stimuli , 1992 .

[2]  J Field,et al.  Infants' orientation to lateral sounds from birth to three months. , 1980, Child development.

[3]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[4]  S. Kosslyn,et al.  Concept development. , 1982, Advances in child development and behavior.

[5]  Richard N. Aslin,et al.  Saccadic localization of visual targets by the very young human infant , 1975 .

[6]  S Rosenbloom,et al.  Space Perception in Early Infancy: Perception within a Common Auditory-Visual Space , 1971, Science.

[7]  R K Clifton,et al.  Newborns' orientation toward sound: possible implications for cortical development. , 1981, Child development.

[8]  Gilbert Gottlieb,et al.  Experiential canalization of behavioral development: results , 1991 .

[9]  J. Piaget.  The construction of reality in the child , 1954 .

[10]  W. Abraham,et al.  The ontogenesis of an auditory localization response from birth to four months of age. , 1979, Canadian journal of psychology.

[11]  A. Minkowski,et al.  Regional Development of the Brain in Early Life , 1968 .

[12]  R. Lickliter.  Premature visual experience facilitates visual responsiveness in bobwhite quail neonates , 1990 .

[13]  G. Gottlieb.  Experiential Canalization of Behavioral Development: Theory. , 1991 .

[14]  William M. Jenkins,et al.  Neural Ontogeny of Higher Brain Function: Implications of Some Recent Neurophysiological Findings , 1991 .

[15]  Heinz Werner,et al.  Comparative Psychology of Mental Development , 1942 .

[16]  E. Gibson.  Principles of Perceptual Learning and Development , 1969 .

[17]  E. Spelke.  Perceiving Bimodally Specified Events in Infancy , 1979 .

[18]  I. Sigel,et al.  HANDBOOK OF CHILD PSYCHOLOGY , 2006 .

[19]  P. Salapatek,et al.  Infant visual perception , 1983 .

[20]  D. Lewkowicz.  Infants’ responsiveness to the auditory and visual attributes of a sounding/moving stimulus , 1992, Perception & psychophysics.

[21]  N. Spear,et al.  Intersensory integration in the infant rat. , 1994 .

[22]  Karlen Lyons-Ruth,et al.  Bimodal Perception in Infancy: Response to Auditory-Visual Incongruity. , 1977 .

[23]  L. Marks.  The Unity of the Senses , 1978 .

[24]  D. Lehrman,et al.  Semantic and Conceptual Issues in the Nature-Nurture Problem , 1970 .

[25]  A. K. Myers,et al.  Matching the rate of concurrent tone bursts and light flashes as a function of flash surround luminance , 1981, Perception & psychophysics.

[26]  D. Lewkowicz.  Bisensory Response to Temporal Frequency in 4-Month-Old Infants , 1985 .

[27]  A. Sameroff.  Transactional Models in Early Social Relations , 1975 .

[28]  G. Ettlinger,et al.  Cross-modal performance: behavioural processes, phylogenetic considerations and neural mechanisms , 1990, Behavioural Brain Research.

[29]  Michael Kubovy,et al.  Should We Resist the Seductiveness of the Space:Time::Vision:Audition Analogy? , 1988 .

[30]  J. R. Pomerantz,et al.  The Perception of Structure: Essays in Honor of Wendell R. Garner , 1991 .

[31]  R. Lerner,et al.  The concept of development in contextualism , 1985 .

[32]  R. Kaufmann-Hayoz,et al.  Development of infants' sensitivity for slow and rapid motions , 1985 .

[33]  David J. Lewkowicz,et al.  Developmental changes in infants' bisensory response to synchronous durations☆ , 1986 .

[34]  Sound Localization Acuity in Very Young Infants: An Observer-Based Testing Procedure. , 1990 .

[35]  D. Massaro.  Perceiving talking faces: from speech perception to a behavioral principle , 1999 .

[36]  G Turkewitz,et al.  Limitations on input as a basis for neural organization and perceptual development: a preliminary theoretical statement. , 1982, Developmental psychobiology.

[37]  W. Collins,et al.  The concept of development: The Minnesota Symposia on Child Psychology , 2013 .

[38]  J. Kremenitzer,et al.  Smooth-pursuit eye movements in the newborn infant. , 1979, Child development.

[39]  J. Field.  The development of auditory-visual localization in infancy. , 1987 .

[40]  L. Garey,et al.  Maturation of Synapses and Gaba-Immunoreactive Neurons in the Perinatal Human Visual Cortex , 1993 .

[41]  G. Bronson.  The postnatal growth of visual capacity. , 1974, Child development.

[42]  Ann L. Brown,et al.  Advances in developmental psychology , 1981 .

[43]  R. Lewontin,et al.  The Ontogeny of Information , 2000 .

[44]  P. Yakovlev,et al.  The myelogenetic cycles of regional maturation of the brain , 1967 .

[45]  Elizabeth S Spelke,et al.  Perception of Moving, Sounding Objects by Four-Month-Old Infants , 1983, Perception.

[46]  David J. Lewkowicz,et al.  The Development of Temporally-Based Intersensory Perception in Human Infants , 1992 .

[47]  P. Bertelson,et al.  Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations , 1977 .

[48]  D. F. Fisher,et al.  Eye movements : cognition and visual perception , 1982 .

[49]  Gilbert Gottlieb,et al.  Synthesizing Nature-nurture: Prenatal Roots of Instinctive Behavior , 1997 .

[50]  B. Morrongiello,et al.  5 – Developmental Changes in Auditory Localization in Infancy , 1981 .

[51]  D. Lewkowicz.  Perception of auditory-visual temporal synchrony in human infants. , 1996, Journal of experimental psychology. Human perception and performance.

[52]  J. Gardner,et al.  Brain-stem auditory evoked responses as indicators of early brain insult. , 1988, Electroencephalography and clinical neurophysiology.

[53]  Q. Summerfield,et al.  Intermodal timing relations and audio-visual speech recognition by normal-hearing adults. , 1985, The Journal of the Acoustical Society of America.

[54]  H. McGurk,et al.  Space Perception in Early Infancy: Perception within a Common Auditory-Visual Space? , 1974, Science.

[55]  W. Greenough,et al.  Chapter XV – Experience-Induced Changes in Brain Fine Structure: Their Behavioral Implications1 , 1979 .

[56]  R. Lickliter.  Premature visual stimulation accelerates intersensory functioning in bobwhite quail neonates. , 1990, Developmental psychobiology.

[57]  R. Welch.  Chapter 15 Meaning, attention, and the “unity assumption” in the intersensory bias of spatial and temporal perceptions , 1999 .

[58]  U. Neisser,et al.  Infant sensitivity to audio-visual discrepancy: A failure to replicate , 1977 .

[59]  M. Bornstein,et al.  Development in Infancy , 1982 .

[60]  D. Freides,et al.  Human information processing and sensory modality: cross-modal functions, information complexity, memory, and deficit. , 1974, Psychological bulletin.

[61]  J. Bourgeois,et al.  Synaptogenesis in the Prefrontal Cortex of the Macaque , 1993 .

[62]  Norman R. F. Maier,et al.  Principles of animal psychology , 1952 .

[63]  M T Wallace,et al.  Development of Multisensory Neurons and Multisensory Integration in Cat Superior Colliculus , 1997, The Journal of Neuroscience.

[64]  A. Walker-Andrews.  Infants' perception of expressive behaviors: differentiation of multimodal information. , 1997, Psychological bulletin.

[65]  E. Knudsen.  Experience alters the spatial tuning of auditory units in the optic tectum during a sensitive period in the barn owl , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[66]  H. Birch,et al.  Visual differentiation, intersensory integration, and voluntary motor control. , 1967, Monographs of the Society for Research in Child Development.

[67]  E. Gibson.  Exploratory behavior in the development of perceiving, acting, and the acquiring of knowledge. , 1988 .

[68]  F. Goodkin,et al.  The development of mature patterns of head-eye coordination in the human infant. , 1980, Early human development.

[69]  D. Lewkowicz,et al.  Intersensory experience and early perceptual development: the role of spatial contiguity in Bobwhite quail chicks' responsiveness to multimodal maternal cues. , 1996, Developmental psychobiology.

[70]  R. Lynn,et al.  A secular decline in the strength of Spearman’s g in Japan , 1994 .

[71]  N. F. Dixon,et al.  The Detection of Auditory Visual Desynchrony , 1980, Perception.

[72]  Ove Franzén,et al.  Information Processing in the Somatosensory System , 1991 .

[73]  W. Friedman.  The Developmental psychology of time , 1982 .

[74]  G. Turkewitz,et al.  The Role of Developmental Limitations of Sensory Input on Sensory/Perceptual Organization , 1985, Journal of developmental and behavioral pediatrics : JDBP.

[75]  K. Lawson,et al.  Spatial and temporal congruity and auditory–visual integration in infants. , 1980 .

[76]  D. Lewkowicz.  Limitations on Infants' Response to Rate-Based Auditory-Visual Relations. , 1994 .

[77]  T. A. Ryan.  Interrelations of sensory systems in perception. , 1940 .

[78]  L. Bahrick,et al.  Intermodal learning in infancy: learning on the basis of two kinds of invariant relations in audible and visible events. , 1988, Child development.

[79]  J. Piaget,et al.  The Origins of Intelligence in Children , 1971 .

[80]  D. Lewkowicz,et al.  Intersensory experience and early perceptual development: Attenuated prenatal sensory stimulation affects postnatal auditory and visual responsiveness in bobwhite quail chicks (Colinus virginianus). , 1995 .

[81]  E. Ingram.  The interstimulus interval in classical autonomic conditioning of young infants. , 1978, Developmental psychobiology.

[82]  P Bertelson,et al.  Cognitive factors and adaptation to auditory-visual discordance , 1978, Perception & psychophysics.

[83]  Timothy D. Johnston,et al.  The persistence of dichotomies in the study of behavioral development , 1987 .

[84]  David J. Lewkowicz,et al.  Cross-modal equivalence in early infancy: Auditory–visual intensity matching. , 1980 .

[85]  E I Knudsen,et al.  Vision guides the adjustment of auditory localization in young barn owls. , 1985, Science.

[86]  R. Lickliter,et al.  Intersensory experience and early perceptual development: postnatal experience with multimodal maternal cues affects intersensory responsiveness in bobwhite quail chicks. , 1998, Developmental psychology.

[87]  R. Sellars.  Philosophy for the future , 1949 .

[88]  D. Lewkowicz,et al.  Unimodal sensory experience interferes with responsiveness to the spatial contiguity of multimodal maternal cues in bobwhite quail chicks , 1998 .

[89]  D. Massaro,et al.  Perceptual development in early infancy : problems and issues , 1988 .

[90]  W R Thurlow,et al.  Effects of degree of visual association and angle of displacement on the "ventriloquism" effect. , 1973, Perceptual and motor skills.

[91]  A. Scheibel.  Dendritic Structure and Language Development , 1993 .

[92]  E. Spelke,et al.  Infant perception of object unity from translatory motion in depth and vertical translation. , 1986, Child development.

[93]  H. Kennedy,et al.  The Relevance of Primate Corticogenesis for Understanding the Emergence of Cognitive Abilities in Man , 1993 .

[94]  Linda B. Smith.  Perceptual structure and developmental process. , 1991 .

[95]  Linda B. Smith,et al.  A Dynamic Systems Approach to the Development of Cognition and Action , 2007, Journal of Cognitive Neuroscience.

[96]  T. Bachmann,et al.  Cognitive contributions to the perception of spatial and temporal events (Advances in Psychology, Vol. 129) , 1999 .

[97]  David J. Lewkowicz,et al.  Development of intersensory perception in human infants. , 1994 .

[98]  Lester R. Aronson,et al.  The biopsychology of development , 1971 .

[99]  J. Dannemiller,et al.  Detection of relative motion by human infants. , 1991 .

[100]  J. Werboff,et al.  Classical Conditioning in Newborn Rats , 1962, Science.

[101]  Lorraine E. Bahrick,et al.  Increasing specificity in the development of intermodal perception , 1998 .