Crossmodal change blindness between vision and touch.

Change blindness is the name given to people's inability to detect changes introduced between two consecutively-presented scenes when they are separated by a distractor that masks the transients that are typically associated with change. Change blindness has been reported within vision, audition, and touch, but has never before been investigated when successive patterns are presented to different sensory modalities. In the study reported here, we investigated change detection performance when the two to-be-compared stimulus patterns were presented in the same sensory modality (i.e., both visual or both tactile) and when one stimulus pattern was tactile while the other was presented visually or vice versa. The two to-be-compared patterns were presented consecutively, separated by an empty interval, or else separated by a masked interval. In the latter case, the masked interval could either be tactile or visual. The first experiment investigated visual-tactile and tactile-visual change detection performance. The results showed that in the absence of masking, participants detected changes in position accurately, despite the fact that the two to-be-compared displays were presented in different sensory modalities. Furthermore, when a mask was presented between the two to-be-compared displays, crossmodal change blindness was elicited no matter whether the mask was visual or tactile. The results of two further experiments showed that performance was better overall in the unimodal (visual or tactile) conditions than in the crossmodal conditions. These results suggest that certain of the processes underlying change blindness are multisensory in nature. We discuss these findings in relation to recent claims regarding the crossmodal nature of spatial attention.

[1]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[2]  D. Simons In Sight, Out of Mind: When Object Representations Fail , 1996 .

[3]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[4]  D. Simons,et al.  Failure to detect changes to people during a real-world interaction , 1998 .

[5]  D. Simons,et al.  Failure to detect changes to attended objects in motion pictures , 1997 .

[6]  Charles Spence,et al.  Do “mudsplashes” induce tactile change blindness? , 2007, Perception & psychophysics.

[7]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[8]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[9]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[10]  H. Pick,et al.  Intersensory Perception and Sensory Integration , 1981 .

[11]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[12]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[13]  R. Gregory Mirrors in Mind , 1996 .

[14]  C. Spence,et al.  Exogenous spatial cuing studies of human crossmodal attention and multisensory integration , 2004 .

[15]  R. Haber The impending demise of the icon: A critique of the concept of iconic storage in visual information processing , 1983, Behavioral and Brain Sciences.

[16]  D. Kemmerer The semantics of space: Integrating linguistic typology and cognitive neuroscience , 2006, Neuropsychologia.

[17]  E. Abravanel Integrating the Information from Eyes and Hands: A Developmental Account , 1981 .

[18]  Vincent Di Lollo,et al.  Temporal integration in visual memory. , 1980, Journal of experimental psychology. General.

[19]  G. Sperling A Model for Visual Memory Tasks1 , 1963, Human factors.

[20]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[21]  Daniel J. Simons,et al.  Current Approaches to Change Blindness , 2000 .

[22]  C. Spence,et al.  The cost of expecting events in the wrong sensory modality , 2001, Perception & psychophysics.

[23]  Andrew T. Woods,et al.  Visual, haptic and crossmodal recognition of scenes , 2005, Experimental Brain Research.

[24]  P. Rodway The modality shift effect and the effectiveness of warning signals in different modalities. , 2005, Acta psychologica.

[25]  J. Downar,et al.  A multimodal cortical network for the detection of changes in the sensory environment , 2000, Nature Neuroscience.

[26]  C. Spence,et al.  Assessing the effect of visual and tactile distractors on the perception of auditory apparent motion , 2005, Experimental Brain Research.

[27]  C. Miles,et al.  Tactile short-term memory revisited. , 1996, Memory.

[28]  Bruce Bridgeman,et al.  Space-independent modality-driven attentional capture in auditory, tactile and visual systems , 2004, Experimental Brain Research.

[29]  P. A. Kolers,et al.  Sensory specificity of apparent motion. , 1981, Journal of experimental psychology. Human perception and performance.

[30]  Hong Z. Tan,et al.  When visual transients impair tactile change detection: A novel case of crossmodal change blindness? , 2006, Neuroscience Letters.

[31]  James L. McClelland,et al.  Information integration in perception and communication , 1996 .

[32]  Jason B. Mattingley,et al.  Directed Attention Eliminates ‘Change Deafness’ in Complex Auditory Scenes , 2005, Current Biology.

[33]  C. Spence,et al.  The failure to detect tactile change: A tactile analogue of visual change blindness , 2006, Psychonomic bulletin & review.

[34]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .

[35]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[36]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[37]  Richard A. Andersen,et al.  Separate body- and world-referenced representations of visual space in parietal cortex , 1998, Nature.

[38]  Ronald A. Rensink,et al.  Rapid Resumption of Interrupted Visual Search , 2005, Psychological science.

[39]  G A Gescheider,et al.  Cross-modality masking for touch and hearing. , 1967, Journal of experimental psychology.

[40]  A. Hollingworth Failures of retrieval and comparison constrain change detection in natural scenes. , 2003, Journal of experimental psychology. Human perception and performance.

[41]  D. Simons,et al.  Change Blindness in the Absence of a Visual Disruption , 2000, Perception.

[42]  Kenneth R. Boff,et al.  Sensory processes and perception , 1986 .

[43]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[44]  John M. Henderson,et al.  Transsaccadic Memory and Integration During Real-World Object Perception , 1997 .

[45]  V. Lollo Temporal integration in visual memory. , 1980 .

[46]  C. Spence,et al.  A crossmodal attentional blink between vision and touch , 2002, Psychonomic bulletin & review.

[47]  Giovanni Galfano,et al.  Nonspatial attentional shifts between audition and vision. , 2002, Journal of experimental psychology. Human perception and performance.

[48]  Michael J. Wright,et al.  Limitations for Change Detection in Multiple Gabor Targets , 2000 .

[49]  C. Spence,et al.  Numerosity Judgments for Tactile Stimuli Distributed over the Body Surface , 2006, Perception.

[50]  Jon Driver,et al.  Crossmodal Spatial Attention: Evidence from Human Performance , 2004 .

[51]  J. Gibson,et al.  A theoretical field-analysis of automobile-driving , 1938 .

[52]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[53]  A D Baddeley,et al.  Tactile Short-Term Memory , 1969, The Quarterly journal of experimental psychology.

[54]  Malika Auvray,et al.  L'influence des facteurs sémantiques sur la cécité aux changements progressifs dans les scènes visuelles , 2003 .

[55]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[56]  M Coltheart Iconic memory. , 1983, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[57]  Christopher Miles,et al.  Recognition memory for tactile sequences , 2002, Memory.

[58]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[59]  D. Le Bihan,et al.  Distinct Cortical Areas for Names of Numbers and Body Parts Independent of Language and Input Modality , 2000, NeuroImage.

[60]  Michael S Vitevitch,et al.  Change deafness: the inability to detect changes between two voices. , 2003, Journal of experimental psychology. Human perception and performance.

[61]  D. E. Broadbent,et al.  Iconic Memory [and Discussion] , 1983 .

[62]  Julian Hochberg,et al.  Representation of motion and space in video and cinematic displays , 1986 .

[63]  A. Schofield,et al.  Oscillatory motion induces change blindness. , 2006, Acta psychologica.

[64]  C. Koch,et al.  Competition and selection during visual processing of natural scenes and objects. , 2003, Journal of vision.