Multisensory processing of redundant information in go/no-go and choice responses

In multisensory research, faster responses are commonly observed when multimodal stimuli are presented, as compared to unimodal target presentations. This so-called redundant-signals effect can be explained by several frameworks, including separate-activation and coactivation models. The redundant-signals effect has been investigated in a large number of studies; however, most of those studies have been limited to the rejection of separate-activation models. Coactivation models have been analyzed in only a few studies, primarily using simple response tasks. Here, we investigated the mechanism of multisensory integration underlying go/no-go and choice responses to redundant auditory–visual stimuli. In the present study, the mean and variance of response times, as well as the accuracy rates of go/no-go and choice responses, were used to test a coactivation model based on the linear superposition of diffusion processes (Schwarz, 1994) within two absorbing barriers. The diffusion superposition model accurately describes the means and variances of response times as well as the proportions of correct responses observed in the two tasks. Linear superposition thus seems to be a general principle in the integration of redundant information provided by different sensory channels, and is not restricted to simple responses. The results connect existing theories of multisensory integration with theories on choice behavior.

[1]  M. Greenlee,et al.  Redundancy gains in simple responses and go/no-go tasks , 2010, Attention, perception & psychophysics.

[2]  W. Schwarz,et al.  Diffusion, superposition, and the redundant-targets effect , 1994 .

[3]  J. Griffiths.  The Theory of Stochastic Processes , 1967 .

[4]  James T Townsend,et al.  Consequences of Base Time for Redundant Signals Experiments. , 2007, Journal of mathematical psychology.

[5]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[6]  Anja Ischebeck,et al.  On the relative speed account of number-size interference in comparative judgments of numerals. , 2003, Journal of experimental psychology. Human perception and performance.

[7]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[8]  Joseph W. Houpt,et al.  Statistical measures for workload capacity analysis. , 2012, Journal of mathematical psychology.

[9]  S Yantis,et al.  Dividing attention between color and shape: Evidence of coactivation , 1993, Perception & psychophysics.

[10]  Miriam Kesselmeier,et al.  Fast and accurate calculations for cumulative first-passage time distributions in Wiener diffusion models , 2012 .

[11]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[12]  Philip L. Smith,et al.  Stochastic Dynamic Models of Response Time and Accuracy: A Foundational Primer. , 2000, Journal of mathematical psychology.

[13]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[14]  G R Grice,et al.  Combination rule for redundant information in reaction time tasks with divided attention , 1984, Perception & psychophysics.

[15]  Diederich,et al.  Dynamic Stochastic Models for Decision Making under Time Constraints , 1997, Journal of mathematical psychology.

[16]  Mark W Greenlee,et al.  Effects of spatial and selective attention on basic multisensory integration. , 2011, Journal of experimental psychology. Human perception and performance.

[17]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[18]  Hans Colonius,et al.  On quantifying multisensory interaction effects in reaction time and detection rate , 2011, Psychological research.

[19]  A. Rangel,et al.  Visual fixations and the computation and comparison of value in simple choice. , 2010, Nature neuroscience.

[20]  T. Stanford,et al.  Evaluating the Operations Underlying Multisensory Integration in the Cat Superior Colliculus , 2005, The Journal of Neuroscience.

[21]  F. Bloom,et al.  Modulation of early sensory processing in human auditory cortex during auditory selective attention. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[23]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[24]  D. Raab.  Statistical facilitation of simple reaction times. , 1962, Transactions of the New York Academy of Sciences.

[25]  W. Schwarz.  On the relationship between the redundant signals effect and temporal order judgments: parametric data and a new model. , 2006, Journal of experimental psychology. Human perception and performance.

[26]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[27]  M Giray,et al.  Motor coactivation revealed by response force in divided and focused attention. , 1993, Journal of experimental psychology. Human perception and performance.

[28]  S A Hillyard,et al.  An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. , 2002, Brain research. Cognitive brain research.

[29]  Paul Sajda,et al.  Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG , 2009, Proceedings of the National Academy of Sciences.

[30]  J. Townsend,et al.  An accuracy-response time capacity assessment function that measures performance against standard parallel predictions. , 2012, Psychological review.

[31]  A. Diederich.  Intersensory facilitation of reaction time: evaluation of counter and diffusion coactivation models , 1995 .

[32]  R Ulrich,et al.  Separate-activation models with variable base times: Testability and checking of cross-channel dependency , 1986, Perception & psychophysics.

[33]  Matthias Gondan,et al.  Testing the race model inequality in redundant stimuli with variable onset asynchrony. , 2009, Journal of experimental psychology. Human perception and performance.

[34]  Roger Ratcliff,et al.  A note on modeling accumulation of information when the rate of accumulation changes over time , 1980 .

[35]  Eric-Jan Wagenmakers,et al.  An EZ-diffusion model for response time and accuracy , 2007, Psychonomic bulletin & review.

[36]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[37]  Durk Talsma,et al.  Attentional orienting across the sensory modalities , 2008, Brain and Cognition.

[38]  Manuel Perea,et al.  Is the go/no-go lexical decision task an alternative to the yes/no lexical decision task? , 2002, Memory & cognition.

[39]  D. Navarro,et al.  Fast and accurate calculations for first-passage times in Wiener diffusion models , 2009 .

[40]  W Schwarz,et al.  A new model to explain the redundant-signals effect , 1989, Perception & psychophysics.

[41]  James L. McClelland,et al.  Loss aversion and inhibition in dynamical models of multialternative choice. , 2004, Psychological review.

[42]  J Miller,et al.  Channel interaction and the redundant-targets effect in bimodal divided attention. , 1991, Journal of experimental psychology. Human perception and performance.

[43]  S. Yantis,et al.  An interactive race model of divided attention. , 1991, Journal of experimental psychology. Human perception and performance.

[44]  Matthias Gondan,et al.  A permutation test for the race model inequality , 2010, Behavior research methods.

[45]  Daniel Senkowski,et al.  Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations , 2007, Neuropsychologia.

[46]  J. T. Mordkoff,et al.  Dividing attention between color and shape revisited: redundant targets coactivate only when parts of the same perceptual object , 2011, Attention, perception & psychophysics.

[47]  Rolf Ulrich,et al.  Simple reaction time and statistical facilitation: A parallel grains model , 2003, Cognitive Psychology.

[48]  J. Townsend,et al.  Spatio-temporal properties of elementary perception: an investigation of parallel, serial, and coactive theories , 1995 .

[49]  Jeff Miller,et al.  Timecourse of coactivation in bimodal divided attention , 1986, Perception & psychophysics.

[50]  D. Raab.  DIVISION OF PSYCHOLOGY: STATISTICAL FACILITATION OF SIMPLE REACTION TIMES* , 1962 .

[51]  Matthias Gondan,et al.  Testing the race inequality: A simple correction procedure for fast guesses , 2008 .

[52]  James T. Townsend,et al.  Activation-state representation of models for the redundant-signals-effect. , 1997 .

[53]  J. Driver,et al.  Audiovisual links in exogenous covert spatial orienting , 1997, Perception & psychophysics.

[54]  C W Eriksen,et al.  A source of error in attempts to distinguish coactivation from separate activation in the perception of redundant targets , 1988, Perception & psychophysics.

[55]  Jeffrey N. Rouder,et al.  A diffusion model account of masking in two-choice letter identification. , 2000, Journal of experimental psychology. Human perception and performance.

[56]  R. Ratcliff,et al.  A model of the go/no-go task. , 2007, Journal of experimental psychology. General.

[57]  Han L. J. van der Maas,et al.  On the mean and variance of response times under the diffusion model with an application to parameter estimation , 2009 .

[58]  Julie Horrocks,et al.  Modeling Event Times with Multiple Outcomes Using the Wiener Process with Drift , 2004, Lifetime data analysis.

[59]  G R Grice,et al.  Redundancy phenomena are affected by response requirements , 1990, Perception & psychophysics.

[60]  G. DeAngelis,et al.  Multisensory integration: psychophysics, neurophysiology, and computation , 2009, Current Opinion in Neurobiology.

[61]  Hans Colonius,et al.  Intersensory facilitation in the motor component? , 1987 .

[62]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[63]  G R Grice,et al.  What makes targets redundant? , 1992, Perception & psychophysics.