Using time to investigate space: a review of tactile temporal order judgments as a window onto spatial processing in touch

To respond to a touch, it is often necessary to localize it in space, and not just on the skin. The computation of this external spatial location involves the integration of somatosensation with visual and proprioceptive information about current body posture. In the past years, the study of touch localization has received substantial attention and has become a central topic in the research field of multisensory integration. In this review, we will explore important findings from this research, zooming in on one specific experimental paradigm, the temporal order judgment (TOJ) task, which has proven particularly fruitful for the investigation of tactile spatial processing. In a typical TOJ task participants perform non-speeded judgments about the order of two tactile stimuli presented in rapid succession to different skin sites. This task could be solved without relying on external spatial coordinates. However, postural manipulations affect TOJ performance, indicating that external coordinates are in fact computed automatically. We show that this makes the TOJ task a reliable indicator of spatial remapping, and provide an overview over the versatile analysis options for TOJ. We introduce current theories of TOJ and touch localization, and then relate TOJ to behavioral and electrophysiological evidence from other paradigms, probing the benefit of TOJ for the study of spatial processing as well as related topics such as multisensory plasticity, body processing, and pain.

[1]  Gian Domenico Iannetti,et al.  Spatially defined modulation of skin temperature and hand ownership of both hands in patients with unilateral complex regional pain syndrome. , 2012, Brain : a journal of neurology.

[2]  M. Wibral,et al.  Spatiotemporal Dynamics of Bimanual Integration in Human Somatosensory Cortex and Their Relevance to Bimanual Object Manipulation , 2012, The Journal of Neuroscience.

[3]  W. Medendorp,et al.  Greater benefits of multisensory integration during complex sensorimotor transformations. , 2012, Journal of Neurophysiology.

[4]  C. Spence,et al.  Early Vision Impairs Tactile Perception in the Blind , 2004, Current Biology.

[5]  Martin Eimer,et al.  Effects of hand posture on preparatory control processes and sensory modulations in tactile-spatial attention , 2004, Clinical Neurophysiology.

[6]  Murray Mm,et al.  The Body in a Multisensory World -- The Neural Bases of Multisensory Processes , 2012 .

[7]  A. Pickering,et al.  The electrophysiological time course of somatosensory spatial remapping: vision of the hands modulates effects of posture on somatosensory evoked potentials , 2013, The European journal of neuroscience.

[8]  G. Humphreys,et al.  Task effects on tactile temporal order judgments: when space does and does not matter. , 2008, Journal of experimental psychology. Human perception and performance.

[9]  S. Kitazawa,et al.  Reversal of subjective temporal order due to sensory and motor integrations , 2006 .

[10]  J. Lackner.  Some proprioceptive influences on the perceptual representation of body shape and orientation. , 1988, Brain : a journal of neurology.

[11]  C. Spence,et al.  Confusing the mind by crossing the hands. , 2002, Brain research. Cognitive brain research.

[12]  S. Kitazawa,et al.  Neural correlates of tactile temporal-order judgment in humans: an fMRI study. , 2013, Cerebral cortex.

[13]  C. Spence,et al.  Spatial localization of touch in the first year of life: early influence of a visual spatial code and the development of remapping across changes in limb position. , 2008, Journal of experimental psychology. General.

[14]  Perceptual learning following a long-lasting tactile reversal. , 1991, Journal of experimental psychology. Human perception and performance.

[15]  S. Soto-Faraco,et al.  Somatosensory saccades reveal the timing of tactile spatial remapping , 2011, Neuropsychologia.

[16]  Satoshi Shibuya,et al.  Effects of visual stimuli on temporal order judgments of unimanual finger stimuli , 2007, Experimental Brain Research.

[17]  S. Kitazawa,et al.  Effects of handedness on tactile temporal order judgment , 2004, Neuropsychologia.

[18]  C. Spence,et al.  Extending or projecting peripersonal space with tools? Multisensory interactions highlight only the distal and proximal ends of tools , 2004, Neuroscience Letters.

[19]  P. Haggard,et al.  The Posterior Parietal Cortex Remaps Touch into External Space , 2010, Current Biology.

[20]  Brigitte Röder,et al.  Processing load impairs coordinate integration for the localization of touch , 2014, Attention, Perception, & Psychophysics.

[21]  G. Rizzolatti,et al.  Spatial compatibility and anatomical factors in simple and choice reaction time , 1977, Neuropsychologia.

[22]  S. Soto-Faraco,et al.  Tactile remapping beyond space , 2010, The European journal of neuroscience.

[23]  Ole Jensen,et al.  Parietal Oscillations Code Nonvisual Reach Targets Relative to Gaze and Body , 2013, The Journal of Neuroscience.

[24]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[25]  B. Röder,et al.  Change of reference frame for tactile localization during child development. , 2009, Developmental science.

[26]  Susumu Tachi,et al.  Directional remapping in tactile inter-finger apparent motion: a motion aftereffect study , 2011, Experimental Brain Research.

[27]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[28]  Makoto Miyazaki,et al.  Acquisition of Multiple Prior Distributions in Tactile Temporal Order Judgment , 2012, Front. Psychology.

[29]  Charles Spence,et al.  Space-based, but not arm-based, shift in tactile processing in complex regional pain syndrome and its relationship to cooling of the affected limb. , 2009, Brain : a journal of neurology.

[30]  B. Forster,et al.  Hands behind your back: effects of arm posture on tactile attention in the space behind the body , 2011, Experimental Brain Research.

[31]  S. Soto-Faraco,et al.  Changing Reference Frames during the Encoding of Tactile Events , 2008, Current Biology.

[32]  J. Craig,et al.  The effect of motion on tactile and visual temporal order judgments , 2003, Perception & psychophysics.

[33]  F. Benedetti.  Processing of tactile spatial information with crossed fingers. , 1985, Journal of experimental psychology. Human perception and performance.

[34]  S. Kitazawa,et al.  Reversal of subjective temporal order due to arm crossing , 2001, Nature Neuroscience.

[35]  H. Anema,et al.  Fingers Crossed! An Investigation of Somatotopic Representations Using Spatial Directional Judgements , 2012, PloS one.

[36]  Dieter Kleinböhl,et al.  Body posture affects tactile discrimination and identification of fingers and hands , 2010, Experimental Brain Research.

[37]  A. Pouget,et al.  Multisensory spatial representations in eye-centered coordinates for reaching , 2002, Cognition.

[38]  Nicholas P. Holmes,et al.  The body schema and multisensory representation(s) of peripersonal space , 2004, Cognitive Processing.

[39]  C. Spence,et al.  Visual capture of apparent limb position influences tactile temporal order judgments , 2005, Neuroscience Letters.

[40]  C. Spence,et al.  Effect of posture change on tactile perception: impaired direction discrimination performance with interleaved fingers , 2005, Experimental Brain Research.

[41]  S. Kitazawa,et al.  Sensation at the tips of invisible tools , 2001, Nature Neuroscience.

[42]  G. D. Iannetti,et al.  The temporal order judgement of tactile and nociceptive stimuli is impaired by crossing the hands over the body midline , 2013, PAIN.

[43]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[44]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[45]  S. Kitazawa.  Where conscious sensation takes place , 2002, Consciousness and Cognition.

[46]  S. Kitazawa,et al.  Bayesian calibration of simultaneity in tactile temporal order judgment , 2006, Nature Neuroscience.

[47]  Eli Brenner,et al.  Sensory integration does not lead to sensory calibration , 2006, Proceedings of the National Academy of Sciences.

[48]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[49]  Brigitte Röder,et al.  Common Anatomical and External Coding for Hands and Feet in Tactile Attention: Evidence from Event-related Potentials , 2010, Journal of Cognitive Neuroscience.

[50]  S. Soto-Faraco,et al.  Alleviating the ‘crossed-hands’ deficit by seeing uncrossed rubber hands , 2007, Experimental Brain Research.

[51]  Felix Wichmann,et al.  The psychometric function: I , 2001 .

[52]  C. Spence,et al.  Back-to-front: Improved tactile discrimination performance in the space you cannot see , 2006, Neuroscience Letters.

[53]  B. Röder,et al.  Multiple spatial representations determine touch localization on the fingers. , 2014, Journal of experimental psychology. Human perception and performance.

[54]  F. Benedetti,et al.  Localization of tactile stimuli and body parts in space: two dissociated perceptual experiences revealed by a lack of constancy in the presence of position sense and motor activity. , 1988, Journal of experimental psychology. Human perception and performance.

[55]  Brigitte Röder,et al.  Assessing the effect of posture change on tactile inhibition-of-return , 2002, Experimental Brain Research.

[56]  C. Umilta,et al.  Compatibility due to the coding of the relative position of the effectors. , 1984, Acta psychologica.

[57]  J. Craig,et al.  The Crossed-Hands Deficit in Tactile Temporal-Order Judgments: The Effect of Training , 2006, Perception.

[58]  Peter Brugger,et al.  Impaired Spatial-Temporal Integration of Touch in Xenomelia (Body Integrity Identity Disorder) , 2012, Spatial Cogn. Comput..

[59]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[60]  Nadia Bolognini,et al.  Proprioceptive Alignment of Visual and Somatosensory Maps in the Posterior Parietal Cortex , 2007, Current Biology.

[61]  Jon Driver,et al.  Multimodal spatial constraints on tactile selective attention. , 1996 .

[62]  Salvador Soto-Faraco,et al.  Alpha Stimulation of the Human Parietal Cortex Attunes Tactile Perception to External Space , 2014, Current Biology.

[63]  S. Soto-Faraco,et al.  Electrophysiological correlates of tactile remapping , 2013, Neuropsychologia.

[64]  S. Kitazawa,et al.  Referral of tactile sensation to the tips of L-shaped sticks. , 2005, Journal of neurophysiology.

[65]  M. Barnett-Cowan,et al.  Crossing the hands is more confusing for females than males , 2010, Experimental Brain Research.

[66]  B. Röder,et al.  The implicit use of spatial information develops later for crossmodal than for intramodal temporal processing , 2013, Cognition.

[67]  J C Craig,et al.  Perceptual processing of adjacent and nonadjacent tactile nontargets , 1992, Perception & psychophysics.

[68]  S Lakatos,et al.  Time—distance relations in shifting attention between locations on one’s body , 1997, Perception & psychophysics.

[69]  R. Andersen,et al.  Reaches to Sounds Encoded in an Eye-Centered Reference Frame , 2000, Neuron.

[70]  B. Röder,et al.  Spatial remapping of touch: confusion of perceived stimulus order across hand and foot. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[71]  C. Spence,et al.  Spatial Modulation of Tactile Temporal-Order Judgments , 2005, Perception.

[72]  P. Haggard,et al.  More than skin deep: Body representation beyond primary somatosensory cortex , 2010, Neuropsychologia.

[73]  B. Röder,et al.  Integration of hand and finger location in external spatial coordinates for tactile localization. , 2012, Journal of experimental psychology. Human perception and performance.

[74]  A. Iriki,et al.  Book Review: Bilateral Activity and Callosal Connections in the Somatosensory Cortex , 2001, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[75]  C. Spence,et al.  Psychologically induced cooling of a specific body part caused by the illusory ownership of an artificial counterpart , 2008, Proceedings of the National Academy of Sciences.

[76]  A. Gallace,et al.  The analgesic effect of crossing the arms , 2011, PAIN.

[77]  B. Röder,et al.  Partial recovery of visual–spatial remapping of touch after restoring vision in a congenitally blind man , 2013, Neuropsychologia.

[78]  J C Craig,et al.  Tactile attention and the perception of moving tactile stimuli , 1991, Perception & psychophysics.

[79]  P. van Donkelaar,et al.  Predicting Future Sensorimotor States Influences Current Temporal Decision Making , 2011, The Journal of Neuroscience.

[80]  Ole Jensen,et al.  Multiple Reference Frames in Cortical Oscillatory Activity during Tactile Remapping for Saccades , 2011, The Journal of Neuroscience.

[81]  Charles Spence,et al.  Spatiotemporal interactions between audition and touch depend on hand posture , 2005, Experimental Brain Research.

[82]  Salvador Soto-Faraco,et al.  Spatial remapping of tactile events , 2008, Communicative & integrative biology.

[83]  P. Bertelson.  Chapter 14 Ventriloquism: A case of crossmodal perceptual grouping , 1999 .

[84]  C. Spence,et al.  Tactile selective attention and body posture: Assessing the multisensory contributions of vision and proprioception , 2004, Perception & psychophysics.

[85]  D. Sparks,et al.  Saccades to somatosensory targets. I. behavioral characteristics. , 1996, Journal of neurophysiology.

[86]  Georg Goldenberg,et al.  The Neural Basis of Imitation is Body Part Specific , 2006, The Journal of Neuroscience.

[87]  James C Craig,et al.  The effect of hand position and pattern motion on temporal order judgments , 2003, Perception & psychophysics.

[88]  Brigitte Röder,et al.  The body in a multisensory world , 2012 .

[89]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[90]  P. Haggard,et al.  The brain’s fingers and hands , 2006, Experimental Brain Research.