Predictability modulates motor–auditory interactions in self-triggered audio–visual apparent motion

We studied an effect of predictability in an audio–visual apparent motion task using magnetoencephalography. The synchronous sequences of audio–visual stimuli were self-triggered by subjects. The task was to detect the direction of the apparent motion in experimental blocks in which the motion either started from the side selected by subjects (predictable condition) or was random (unpredictable condition). Magnetic fields yielded three patterns of activity in the motor, auditory, and visual areas. Comparison of the dipole strength between predictable and unpredictable conditions revealed a significant difference of the preparatory motor activity in the time interval from −450 to −100 ms before self-triggering the stimulus. Perception of the audio–visual apparent motion was also modulated by predictability. However, the modulation was found only for the auditory activity but not for the visual one. The effect of predictability was selective and modulated only the auditory component N1 (100 ms after stimulus), which reflects initial evaluation of stimulus meaning. Importantly, the preparatory motor activity correlates with the following auditory activity mainly in the same hemisphere. Similar modulation by predictability of the motor and auditory activities suggests interactions between these two systems within an action–perception cycle. The mechanism of these interactions can be understood as an effect of anticipation of the own action outcomes on the preparatory motor and perceptual activity.

[1]  E. Schafer,et al.  Self-Stimulation Alters Human Sensory Brain Responses , 1973, Science.

[2]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[3]  Werner Lutzenberger,et al.  The right supratemporal plane hears the distance of objects: neuromagnetic correlates of virtual reality , 2003, Neuroreport.

[4]  M. Ziessler,et al.  Anticipated action consequences as a nexus between action and perception: Evidence from event-related potentials , 2008, Biological Psychology.

[5]  G. Curio,et al.  Speaking modifies voice‐evoked activity in the human auditory cortex , 2000, Human brain mapping.

[6]  P. A. Kolers,et al.  Sensory specificity of apparent motion. , 1981, Journal of experimental psychology. Human perception and performance.

[7]  H. Ohmura.  Intersensory influences on the perception of apparent movement , 1987 .

[8]  Alan Kingstone,et al.  Moving Multisensory Research Along , 2004 .

[9]  Thomas R. Knösche,et al.  An fMRI-Constrained MEG Source Analysis with Procedures for Dividing and Grouping Activation , 2002, NeuroImage.

[10]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[11]  R. Hari,et al.  Suppressed responses to self-triggered sounds in the human auditory cortex. , 2004, Cerebral cortex.

[12]  Alan Kingstone,et al.  The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. , 2002, Brain research. Cognitive brain research.

[13]  W. McIlroy,et al.  Tactile stimulus predictability modulates activity in a tactile-motor cortical network , 2003, Experimental Brain Research.

[14]  M. Scherg,et al.  Two bilateral sources of the late AEP as identified by a spatio-temporal dipole model. , 1985, Electroencephalography and clinical neurophysiology.

[15]  D. Wolpert.  Computational approaches to motor control , 1997, Trends in Cognitive Sciences.

[16]  Thomas Z Strybel,et al.  A Comparison of Auditory and Visual Apparent Motion Presented Individually and with Crossmodal Moving Distractors , 2004, Perception.

[17]  C. Frith,et al.  How do we predict the consequences of our actions? a functional imaging study , 1998, Neuropsychologia.

[18]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[19]  A K Liu,et al.  Spatiotemporal imaging of human brain activity using functional MRI constrained magnetoencephalography data: Monte Carlo simulations. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[20]  S. Mateeff,et al.  Dynamic Visual Capture: Apparent Auditory Motion Induced by a Moving Visual Target , 1985, Perception.

[21]  Seong-Gi Kim,et al.  Effects of movement predictability on cortical motor activation , 1998, Neuroscience Research.

[22]  L Deecke,et al.  Planning, preparation, execution, and imagery of volitional action. , 1996, Brain research. Cognitive brain research.

[23]  Bernhard Hommel,et al.  Codes and their vicissitudes , 2001 .

[24]  Heinrich H Bülthoff,et al.  Effects of pointing direction and direction predictability on event-related lateralizations of the EEG. , 2002, Human movement science.

[25]  E Donchin,et al.  The effects of temporal and event uncertainty in determining the waveforms of the auditory event related potential (ERP). , 1976, Psychophysiology.

[26]  P. Ullsperger,et al.  Event‐related potentials in a self‐paced novelty oddball task , 2000, Neuroreport.

[27]  T. Johnson,et al.  Attention to auditory and peripheral visual stimuli: effects of arousal and predictability. , 1989, Acta psychologica.

[28]  H. Nittono.  Voluntary stimulus production enhances deviance processing in the brain. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  T. Picton,et al.  The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. , 1987, Psychophysiology.

[30]  L. Deecke,et al.  Neuromagnetic fields accompanying unilateral and bilateral voluntary movements: topography and analysis of cortical sources. , 1991, Electroencephalography and clinical neurophysiology.

[31]  H. Kornhuber,et al.  Hirnpotentialänderungen bei Willkürbewegungen und passiven Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale , 1965, Pflüger's Archiv für die gesamte Physiologie des Menschen und der Tiere.

[32]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.