Differential contribution of visual and auditory information to accurately predict the direction and rotational motion of a visual stimulus.

Vision and auditory information are critical for perception and to enhance the ability of an individual to respond accurately to a stimulus. However, it is unknown whether visual and auditory information contribute differentially to identify the direction and rotational motion of the stimulus. The purpose of this study was to determine the ability of an individual to accurately predict the direction and rotational motion of the stimulus based on visual and auditory information. In this study, we recruited 9 expert table-tennis players and used table-tennis service as our experimental model. Participants watched recorded services with different levels of visual and auditory information. The goal was to anticipate the direction of the service (left or right) and the rotational motion of service (topspin, sidespin, or cut). We recorded their responses and quantified the following outcomes: (i) directional accuracy and (ii) rotational motion accuracy. The response accuracy was the accurate predictions relative to the total number of trials. The ability of the participants to predict the direction of the service accurately increased with additional visual information but not with auditory information. In contrast, the ability of the participants to predict the rotational motion of the service accurately increased with the addition of auditory information to visual information but not with additional visual information alone. In conclusion, this finding demonstrates that visual information enhances the ability of an individual to accurately predict the direction of the stimulus, whereas additional auditory information enhances the ability of an individual to accurately predict the rotational motion of stimulus.

[1]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Stefan Treue,et al.  Different populations of neurons contribute to the detection and discrimination of visual motion , 2001, Vision Research.

[3]  H. Buchtel,et al.  Effects of stimulus source and intensity on covert orientation to auditory stimuli * * A preliminary version of this paper was presented to the 19th Annual Meeting of the International Neuropsychological Society, San Antonio TX, 13–16 February 1991. , 1996, Neuropsychologia.

[4]  G F Meyer,et al.  The integration of auditory and visual motion signals at threshold , 2003, Perception & psychophysics.

[5]  J. Gibson Optical motions and transformations as stimuli for visual perception. , 1957, Psychological review.

[6]  B. Abernethy,et al.  The relationship between expertise and visual search strategy in a racquet sport , 1987 .

[7]  U. Noppeney,et al.  Audiovisual Synchrony Improves Motion Discrimination via Enhanced Connectivity between Early Visual and Auditory Areas , 2010, The Journal of Neuroscience.

[8]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[9]  Michael T. Lippert,et al.  Improvement of visual contrast detection by a simultaneous sound , 2007, Brain Research.

[10]  B. Argall,et al.  Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus , 2004, Neuron.

[11]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[12]  P. Mamassian,et al.  The prediction of visual stimuli influences auditory loudness discrimination , 2014, Experimental Brain Research.

[13]  Hamish A Deery,et al.  Hazard and Risk Perception among Young Novice Drivers , 1999 .

[14]  David Crundall,et al.  VISUAL SEARCH WHILE DRIVING: SKILL AND AWARENESS DURING INSPECTION OF THE SCENE , 2002 .

[15]  N. Bolognini,et al.  Enhancement of visual perception by crossmodal visuo-auditory interaction , 2002, Experimental Brain Research.

[16]  Robert B. Welch,et al.  Contributions of audition and vision to temporal rate perception , 1986, Perception & psychophysics.

[17]  Stefan Treue,et al.  Seeing multiple directions of motion—physiology and psychophysics , 2000, Nature Neuroscience.

[18]  S. Wuerger,et al.  Cross-modal integration of auditory and visual motion signals , 2001, Neuroreport.

[19]  C. Olivers,et al.  Bleeping you out of the blink: Sound saves vision from oblivion , 2008, Brain Research.

[20]  J. Vroomen,et al.  Sound enhances visual perception: cross-modal effects of auditory organization on vision. , 2000, Journal of experimental psychology. Human perception and performance.

[21]  Alan Kingstone,et al.  Assessing automaticity in the audiovisual integration of motion. , 2005, Acta psychologica.

[22]  Hans-Jochen Heinze,et al.  Sound increases the saliency of visual events , 2008, Brain Research.