Auditory transients do not affect visual sensitivity in discriminating between objective streaming and bouncing events.

With few exceptions, the sound-induced bias toward bouncing characteristic of the stream/bounce effect has been demonstrated via subjective responses, leaving open the question whether perceptual factors, decisional factors, or some combination of the two underlie the illusion. We addressed this issue directly, using a novel stimulus and signal detection theory to independently characterize observers' sensitivity (d') and criterion (c) when discriminating between objective streaming and bouncing events in the presence or absence of a brief sound at the point of coincidence. We first confirmed that sound-induced motion reversals persist despite rendering the targets visually distinguishable by differences in texture density. Sound-induced bouncing persisted for targets differing by as many as nine just-noticeable-differences (JNDs). We then exploited this finding in our signal detection paradigm in which observers discriminated between objective streaming and bouncing events. We failed to find any difference in sensitivity (d') between sound and no-sound conditions, but we did observe a significantly more liberal criterion (c) in the sound condition than the no-sound condition. The results suggest that the auditory-induced bias toward bouncing in this context is attributable to a sound-induced shift in criterion implicating decisional processes rather than perceptual processes determining responses to these displays.

[1]  Charles Spence,et al.  Bouncing or streaming? Exploring the influence of auditory cues on the interpretation of ambiguous visual motion , 2004, Experimental Brain Research.

[2]  S. Shimojo,et al.  When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception , 2001, Psychological science.

[3]  S Shimojo,et al.  Postcoincidence trajectory duration affects motion event perception , 2001, Perception & psychophysics.

[4]  P. Mamassian,et al.  What does the illusory-flash look like? , 2010, Vision Research.

[5]  Streaming and bouncing: observations on motion defined objects , 2000, Clinical & experimental ophthalmology.

[6]  Geraint Rees,et al.  Sound alters activity in human V1 in association with illusory visual perception , 2006, NeuroImage.

[7]  Clara Casco,et al.  Revealing the origin of the audiovisual bounce-inducing effect. , 2012, Seeing and perceiving.

[8]  Clara Casco,et al.  Audiovisual bounce-inducing effect: attention alone does not explain why the discs are bouncing. , 2009, Journal of experimental psychology. Human perception and performance.

[9]  Katsumi Watanabe,et al.  Crossmodal Interaction in Humans , 2001 .

[10]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[11]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[12]  Yousuke Kawachi,et al.  The Stream/Bounce Effect Occurs for Luminance- and Disparity-Defined Motion Targets , 2012, Perception.

[13]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[14]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[15]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[16]  Kenzo Sakurai,et al.  Auditory Induced Bounce Perception Persists as the Probability of a Motion Reversal is Reduced , 2009, Perception.

[17]  M Di Luca,et al.  Recalibration of audiovisual simultaneity , 2010 .

[18]  Yousuke Kawachi,et al.  Presentation of a Visual Nearby Moving Object Alters Stream/Bounce Event Perception , 2006, Perception.

[19]  D. Whitaker,et al.  Sensory uncertainty governs the extent of audio-visual interaction , 2004, Vision Research.

[20]  Robert Sekuler,et al.  Multi-sensory integration of spatio-temporal segmentation cues: one plus one does not always equal two , 2007, Experimental Brain Research.

[21]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[22]  B I Bertenthal,et al.  Directional Bias in the Perception of Translating Patterns , 1993, Perception.

[23]  Takahiro Kawabe,et al.  Effects of the orientation of moving objects on the perception of streaming/bouncing motion displays , 2006, Perception & psychophysics.

[24]  Charles Spence,et al.  Perceptual and decisional contributions to audiovisual interactions in the perception of apparent motion: A signal detection study , 2007, Cognition.

[25]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[26]  Yoshitaka Nakajima,et al.  Audiovisual integration: an investigation of the "streaming-bouncing" phenomenon. , 2004, Journal of physiological anthropology and applied human science.

[27]  Alan Kingstone,et al.  Moving Multisensory Research Along , 2004 .

[28]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.