Cross-modal enhancement of perceived brightness: Sensory interaction versus response bias

Stein, London, Wilkinson, and Price (1996) reported the presence of cross-modal enhancement of perceived visual intensity: Participants tended to rate weak lights as brighter when accompanied by a concurrent pulse of white noise than when presented alone. In the present study, two methods were used to determine whether the enhancement reflects an early-stage sensory process or a later-stage decisional process, such as a response bias. First, enhancement was eliminated when the noise accompanied the light on only 25% versus 50% of the trials. Second, enhancement was absent when tested with a paired-comparison method. These findings are consistent with the hypothesis that the sound-induced enhancement in judgments of brightness reflects a response bias, rather than an early sensory process—that is, enhancement is the result of a relatively late decisional process.

[1]  I H Bernstein,et al.  Effects of some variations in auditory input upon visual choice reaction time. , 1971, Journal of experimental psychology.

[2]  T. Marill Detection theory and psychophysics , 1956 .

[3]  L. Marks,et al.  Cross-Modal Interaction between Vision and Touch: The Role of Synesthetic Correspondence , 2000, Perception.

[4]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[5]  J. Staddon,et al.  On sequential effects in absolute judgment experiments. , 1980 .

[6]  W. R. Garner The Processing of Information and Structure , 1974 .

[7]  D. LaBerge,et al.  PRESENTATION PROBABILITY AND CHOICE TIME. , 1964, Journal of experimental psychology.

[8]  de Gelder Sound Enhances Visual Perception: Cross-Modal Effects of Auditory Organization on Vision , 2001 .

[9]  R A Lutfi A model of auditory pattern analysis based on component-relative-entropy. , 1993, The Journal of the Acoustical Society of America.

[10]  Intensity perception. XII. Effect of presentation probability on absolute identification. , 1983, The Journal of the Acoustical Society of America.

[11]  D. M. Green,et al.  Sequential effects in judgments of loudness. , 1977, Journal of experimental psychology. Human perception and performance.

[12]  K. White,et al.  Stimulus presentation frequency in brightness discrimination and generalization: A test of adaptation-level and signal-detection interpretations , 1985, Perception & psychophysics.

[13]  D. Cross,et al.  Sequential Effects in Magnitude Scaling: Models and Theory , 1990 .

[14]  The Effect of Tone Frequency on Successive Comparison of Brightness , 1995 .

[15]  R. Melara Dimensional interaction between color and pitch , 1989 .

[16]  L E Marks,et al.  On cross-modal similarity: auditory-visual interactions in speeded discrimination. , 1987, Journal of experimental psychology. Human perception and performance.

[17]  R. R. Macdonald The Effect of Sequential Dependencies on Some Signal Detection Parameters , 1976 .

[18]  R. Taylor,et al.  Sensory Interaction: Vision is Modulated by Hearing , 1976, Perception.

[19]  Lawrence E. Marks,et al.  Visual-auditory interaction in speeded classification: Role of stimulus difference , 1995, Perception & psychophysics.

[20]  L. M. Ward Cross-modal additive conjoint structures and psychophysical scale convergence. , 1990, Journal of experimental psychology. General.

[21]  Mark H. Clark,et al.  Intermodal effects in choice reaction time , 1969 .

[22]  L. Marks,et al.  Absolute sensitivity to white noise under auxiliary visual stimulation1 , 1970 .

[23]  Robert D. Melara,et al.  Interaction between synesthetically corresponding dimensions. , 1987 .

[24]  L. M. Ward,et al.  Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. , 1994, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[25]  Richard C. Atkinson,et al.  Signal recognition as influenced by presentation schedules , 1967 .

[26]  J. Driver,et al.  Audiovisual links in exogenous covert spatial orienting , 1997, Perception & psychophysics.

[27]  P. Bertelson,et al.  The ventriloquist effect does not depend on the direction of deliberate visual attention , 2000, Perception & psychophysics.

[28]  L M Ward,et al.  Stimulus information and sequential dependencies in magnitude estimation and cross-modality matching. , 1979, Journal of experimental psychology. Human perception and performance.

[29]  James H. Howard,et al.  Stimulus compatibility effects of an accessory visual stimulus on auditory sensitivity , 1975 .

[30]  H. Buchtel,et al.  Spatial attentional shifts: Implications for the role of polysensory mechanisms , 1988, Neuropsychologia.

[31]  L E Marks,et al.  Perceptual and Linguistic Interactions in Speeded Classification: Tests of the Semantic Coding Hypothesis , 1999, Perception.

[32]  B. Stein,et al.  The Merging of the Senses , 1993 .

[33]  Robert B. Welch,et al.  The “ventriloquist effect”: Visual dominance or response bias? , 1975 .

[34]  L. M. Ward,et al.  Mixed-modality psychophysical scaling: Sequential dependencies and other properties , 1982, Perception & psychophysics.

[35]  Carl J. Bassi,et al.  Daily fluctuations in the detectability of dim lights by humans , 1986, Physiology & Behavior.

[36]  Randall S. Hansen,et al.  The effects of stimulus sequence and probability on perceptual processing , 1984, Perception & psychophysics.

[37]  R S Nickerson,et al.  Intersensory facilitation of reaction time: energy summation or preparation enhancement? , 1973, Psychological review.

[38]  B. Stein,et al.  Enhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis , 1996, Journal of Cognitive Neuroscience.

[39]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[40]  R. Melara,et al.  Dimensional interaction between color and pitch. , 1989, Journal of experimental psychology. Human perception and performance.