Multimodal Ternus: Visual, Tactile, and Visuo — Tactile Grouping in Apparent Motion

Gestalt rules that describe how visual stimuli are grouped also apply to sounds, but it is unknown if the Gestalt rules also apply to tactile or uniquely multimodal stimuli. To investigate these rules, we used lights, touches, and a combination of lights and touches, arranged in a classic Ternus configuration. Three stimuli (A, B, C) were arranged in a row across three fingers. A and B were presented for 50 ms and, after a delay, B and C were presented for 50 ms. Subjects were asked whether they perceived AB moving to BC (group motion) or A moving to C (element motion). For all three types of stimuli, at short delays, A to C dominated, while at longer delays AB to BC dominated. The critical delay, where perception changed from group to element motion, was significantly different for the visual Ternus (3 lights, 162 ms) and the tactile Ternus (3 touches, 195 ms). The critical delay for the multimodal Ternus (3 light – touch pairs, 161 ms) was not different from the visual or tactile Ternus effects. In a second experiment, subjects were exposed to 2.5 min of visual group motion (stimulus onset asynchrony = 300 ms). The exposure caused a shift in the critical delay of the visual Ternus, a trend in the same direction for the multimodal Ternus, but no shift in the tactile Ternus. These results suggest separate but similar grouping rules for visual, tactile, and multimodal stimuli.

[1]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[2]  C. Spence,et al.  Assessing the effect of visual and tactile distractors on the perception of auditory apparent motion , 2005, Experimental Brain Research.

[3]  M. Wertheimer Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[4]  P. A. Kolers,et al.  Sensory specificity of apparent motion. , 1981, Journal of experimental psychology. Human perception and performance.

[5]  F. A. Geldard,et al.  The Cutaneous "Rabbit": A Perceptual Illusion , 1972, Science.

[6]  Alan Kingstone,et al.  The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. , 2002, Brain research. Cognitive brain research.

[7]  P Kramer,et al.  Visible persistence and form correspondence in Ternus apparent motion , 1999, Perception & psychophysics.

[8]  J. Kirman,et al.  Tactile apparent movement: the effects of number of stimulators. , 1974, Journal of experimental psychology.

[9]  R. Shepard Perceptual-cognitive universals as reflections of the world. , 2001, The Behavioral and brain sciences.

[10]  Shinsuke Shimojo,et al.  Touch-induced visual illusion , 2005, Neuroreport.

[11]  Charles Spence,et al.  Intramodal perceptual grouping modulates multisensory integration: evidence from the crossmodal dynamic capture task , 2005, Neuroscience Letters.

[12]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[13]  G. Essick,et al.  Tactile motion activates the human middle temporal/V5 (MT/V5) complex , 2002, The European journal of neuroscience.

[14]  Alan Kingstone,et al.  Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. , 2004, Journal of experimental psychology. Human perception and performance.

[15]  J Timothy Petersik,et al.  The Evolution of Explanations of a Perceptual Phenomenon: A Case History Using the Ternus Effect , 2006, Perception.

[16]  Haluk Öğmen,et al.  Perceptual grouping induces non-retinotopic feature attribution in human vision , 2006, Vision Research.

[17]  Douglas P. Munoz,et al.  Auditory-visual interactions subserving primate gaze orienting , 2004 .

[18]  M. Beauvois The effect of tone duration on auditory stream formation , 1998, Perception & psychophysics.

[19]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[20]  J. Kirman,et al.  Tactile apparent movement: The effects of interstimulus onset interval and stimulus duration , 1974 .

[21]  B. Breitmeyer,et al.  Visual persistence and the effect of eccentric viewing, element size, and frame duration on bistable stroboscopic motion percepts , 1986, Perception & psychophysics.

[22]  Charles Spence,et al.  The modulation of crossmodal integration by unimodal perceptual grouping: a visuotactile apparent motion study , 2006, Experimental Brain Research.

[23]  James C Craig,et al.  Visual Motion Interferes with Tactile Motion Perception , 2006, Perception.

[24]  P. Bertelson,et al.  Visual recalibration and selective adaptation in auditory–visual speech perception: Contrasting build-up courses , 2007, Neuropsychologia.

[25]  O. Braddick A short-range process in apparent motion. , 1974, Vision research.

[26]  Bruno G. Breitmeyer,et al.  The role of visual pattern persistence in bistable stroboscopic motion , 1986, Vision Research.

[27]  J. Timothy Petersik,et al.  Factors controlling the competing sensations produced by a bistable stroboscopic motion display , 1979, Vision Research.

[28]  A. Vanlierde,et al.  Specific activation of the V5 brain area by auditory motion processing: an fMRI study. , 2005, Brain research. Cognitive brain research.