Multimodal signal detection: Independent decisions vs. integration

The pooling of information from simultaneous, spatially congruent auditory and visual stimuli is examined in a signal detection task. The paradigm used permits discrimination among a number of models of the decision mechanisms involved in processing multiple component stimuli. Parameter-free predictions are presented for the weighted integration model and for three versions of the independent decisions model. The data support an independent decisions model of the bimodal detection process in which attention is shared equally between modalities.

[1]  A. Vendrik,et al.  CAN A SENSORY SYSTEM BE SPECIFIED BY ITS INTERNAL NOISE? , 1965, The Journal of the Acoustical Society of America.

[2]  G. Schneider Two visual systems. , 1969, Science.

[3]  W. P. Colquhoun,et al.  Combining evidence presented simultaneously to the eye and the ear: A comparison of some predictive models , 1976 .

[4]  J. Robson,et al.  Spatial-frequency channels in human vision. , 1971, Journal of the Optical Society of America.

[5]  David E. Rumelhart,et al.  A multicomponent theory of the perception of briefly exposed visual displays , 1970 .

[6]  Mark B. Gardner Lateral Localization of 0°‐ or Near‐0°‐Oriented Speech Signals in Anechoic Space , 1968 .

[7]  L Weiskrantz,et al.  Visual capacity in the hemianopic field following a restricted occipital ablation. , 1974, Brain : a journal of neurology.

[8]  B. Gordon,et al.  The superior colliculus of the brain. , 1972, Scientific American.

[9]  Comments on “Interaction of the Auditory and Visual Sensory Modalities” [J. Acoust. Soc. Am. 41, 1–6 (1967)] , 1967 .

[10]  H. Hopkins,et al.  Interaction of the auditory and visual sensory modalities. , 1967, The Journal of the Acoustical Society of America.

[11]  J. C. R. Licklider,et al.  Detection of a Pulsed Sinusoid in Noise as a Function of Frequency , 1959 .

[12]  D Burns,et al.  A dual-task analysis of detection accuracy for the case of high target-distractor similarity: Further evidence for independent processing , 1979, Perception & psychophysics.

[13]  Wayne A. Wickelgren,et al.  Strength theories of disjunctive visual detection , 1967 .

[14]  S Fidell,et al.  Sensory function in multimodal signal detection. , 1970, The Journal of the Acoustical Society of America.

[15]  G. T. Gardner Evidence for independent parallel channels in tachistoscopic perception , 1973 .

[16]  N. Graham Visual detection of aperiodic spatial stimuli by probability summation among narrowband channels , 1977, Vision Research.

[17]  Wilson S. Geisler,et al.  Visual recognition in a theory of information processing. , 1973 .

[18]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[19]  R. A. Kinchla,et al.  Detecting a target letter in briefly presented arrays: A confidence rating analysis in terms of a weighted additive effects model , 1974 .

[20]  R. A. Kinchla,et al.  The role of structural redundancy in the perception of visual targets , 1977 .

[21]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[22]  M. Shaw,et al.  Optimal allocation of cognitive resources to spatial locations. , 1977, Journal of experimental psychology. Human perception and performance.