Psychoacoustic manipulation of the sound induced Illusory Flash

Psychological research on cross-modal auditory-visual perception has focused on the manipulation of sensory information predominantly by visual information. There are relatively few studies of the way auditory stimuli may affect other sensory information. The Sound-induced Illusory Flash is one illusory paradigm that involves the auditory system biasing other senses. However, little is known about the cross-modal illusion. More research is needed into the structure of the illusion that investigates the different conditions under which the Sound-induced Illusory Flash manifests and is enhanced or reduced. The experiment reported here investigates the effect of new auditory stimulus variables on the Sound-induced Illusory Flash. The variables to be discussed concern forming a contrast in the auditory stimulus to emphasise the illusory percept. The auditory contrasts used were single pitched beeps versus those alternating in pitch by an octave, and the presentation of sound monaurally versus binaurally. The ultimate aim is to develop the illusory effect as a basis for new intermedia techniques and creative applications for the temporal manipulation and spatialisation of visual objects.

[1]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[2]  S. Shimojo,et al.  Sensory modalities are not separate modalities: plasticity and interactions , 2001, Current Opinion in Neurobiology.

[3]  Diana Deutsch,et al.  The Octave Illusion and Auditory Perceptual Integration , 1981 .

[4]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[5]  L E Marks,et al.  On associations of light and sound: the mediation of brightness, pitch, and loudness. , 1974, The American journal of psychology.

[6]  D. Deutsch.  Two-channel listening to musical scales. , 1975, The Journal of the Acoustical Society of America.

[7]  L. Auger.  The Journal of the Acoustical Society of America , 1949 .

[8]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[9]  E. G. RICHARDSON.  Musical Acoustics , 1959, Nature.

[10]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[11]  D. Deutsch,et al.  An auditory illusion , 1974, Nature.

[12]  Ladan Shams,et al.  Early modulation of visual cortex by sound: an MEG study , 2005, Neuroscience Letters.

[13]  C. Stevens,et al.  Thinking In Four Dimensions , 2005 .

[14]  Shinsuke Shimojo,et al.  Sound-induced illusory flash perception: role of gamma band responses , 2002, Neuroreport.

[15]  Diana Deutsch,et al.  The octave illusion in relation to handedness and familial handedness background , 1983, Neuropsychologia.

[16]  Ulrik R Beierholm,et al.  Sound-induced flash illusion as an optimal percept , 2005, Neuroreport.

[17]  S. Shimojo,et al.  Visual illusion induced by sound. , 2002, Brain research. Cognitive brain research.

[18]  D. Deutsch.  A Musical Paradox , 1986 .

[19]  R. Shepard.  Circularity in Judgments of Relative Pitch , 1964 .

[20]  J C Risset,et al.  Pitch and rhythm paradoxes: comments on "Auditory paradox based on fractal waveform". , 1986, The Journal of the Acoustical Society of America.

[21]  D. Deutsch.  The Semitone Paradox , 1988 .

[22]  T SHIPLEY,et al.  Auditory Flutter-Driving of Visual Flicker , 1964, Science.

[23]  Shinsuke Shimojo,et al.  Beyond perceptual modality: Auditory effects on visual perception , 2001 .

[24]  R. Dean,et al.  The mirage of real-time algorithmic synaesthesia: Some compositional mechanisms and research agendas in computer music and sonification , 2006 .

[25]  Algis J. Vingrys,et al.  Cathode-ray-tube monitor artefacts in neurophysiology , 2005, Journal of Neuroscience Methods.

[26]  Leon van Noorden,et al.  Minimum differences of level and frequency for perceptual fission of tone sequences ABAB , 1977 .