Simultaneity and Temporal Order Judgments Exhibit Distinct Reaction Times and Training Effects

A considerable body of sensory research has addressed the rules governing simultaneity judgments (SJs) and temporal order judgments (TOJs). In principle, neural events that register stimulus-arrival-time differences at an early sensory stage could set the limit on SJs and TOJs alike. Alternatively, distinct limits on SJs and TOJs could arise from task-specific neural events occurring after the stimulus-driven stage. To distinguish between these possibilities, we developed a novel reaction-time (RT) measure and tested it in a perceptual-learning procedure. The stimuli comprised dual-stream Rapid Serial Visual Presentation (RSVP) displays. Participants judged either the simultaneity or temporal order of red-letter and black-number targets presented in opposite lateral hemifield streams of black-letter distractors. Despite identical visual stimulation across-tasks, the SJ and TOJ tasks generated distinct RT patterns. SJs exhibited significantly faster RTs to synchronized targets than to subtly asynchronized targets; TOJs exhibited the opposite RT pattern. These task-specific RT patterns cannot be attributed to the early, stimulus-driven stage and instead match what one would predict if the limits on SJs and TOJs arose from task-specific decision spaces. That is, synchronized targets generate strong evidence for simultaneity, which hastens SJ RTs. By contrast, synchronized targets provide no information about temporal order, which slows TOJ RTs. Subtly asynchronizing the targets reverses this information pattern, and the corresponding RT patterns. In addition to investigating RT patterns, we also investigated training-transfer between the tasks. Training to improve SJ precision failed to improve TOJ precision, and vice versa, despite identical visual stimulation across tasks. This, too, argues against early, stimulus-driven limits on SJs and TOJs. Taken together, the present study offers novel evidence that distinct rules set the limits on SJs and TOJs.

[1]  Elena K. Festa,et al.  Remapping time across space. , 2013, Journal of vision.

[2]  Nestor Matthews,et al.  Right hemifield deficits in judging simultaneity: a perceptual learning study. , 2012, Journal of vision.

[3]  R. L. Knoll,et al.  The Perception of Temporal Order: Fundamental Issues and a General Model , 1973 .

[4]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[5]  Nestor Matthews,et al.  Task-specific perceptual learning on speed and direction discrimination , 2003, Vision Research.

[6]  Rolf Ulrich,et al.  Effects of redundant auditory stimuli on reaction time , 2007, Psychonomic bulletin & review.

[7]  Ira J. Hirsh,et al.  Auditory Perception of Temporal Order , 1959 .

[8]  Katharina Weiß,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Simultaneity and Temporal Order Perception: Different Sides of the Same Coin? Evidence from a Visual Prior-entry Study , 2022 .

[9]  Lucas Spierer,et al.  Plastic brain mechanisms for attaining auditory temporal order judgment proficiency , 2010, NeuroImage.

[10]  H. Pashler,et al.  Improvement in line orientation discrimination is retinally local but dependent on cognitive set , 1992, Perception & psychophysics.

[11]  L. Allan.  The relationship between judgments ofsuccessiveness and judgments of order , 1975 .

[12]  L. Allan.  The relationship between judgments of successiveness , 1975 .

[13]  R. Verleger,et al.  Mechanisms underlying the left visual-field advantage in the dual stream RSVP task: evidence from N2pc, P3, and distractor-evoked VEPs. , 2011, Psychophysiology.

[14]  L. Thompson,et al.  Effects of senescence on the temporal resolution of somesthetic stimuli presented to one hand or both. , 1968, Journal of gerontology.

[15]  E. Shaw.  Transformation of sound pressure level from the free field to the eardrum in the horizontal plane. , 1974, The Journal of the Acoustical Society of America.

[16]  S. Hochstein,et al.  Attentional control of early perceptual learning. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[17]  R. Ulrich.  Threshold models of temporal-order judgments evaluated by a ternary response task , 1987, Perception & psychophysics.

[18]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[19]  F. Pollick,et al.  A Psychophysical Investigation of Differences between Synchrony and Temporal Order Judgments , 2013, PloS one.

[20]  Raymond S. Nickerson,et al.  Attention and Performance Viii , 2014 .

[21]  M. García-Pérez,et al.  Converging evidence that common timing processes underlie temporal-order and simultaneity judgments: a model-based analysis , 2015, Attention, perception & psychophysics.

[22]  John J. Foxe,et al.  Recalibration of the Multisensory Temporal Window of Integration Results from Changing Task Demands , 2013, PloS one.

[23]  Bruno H Repp,et al.  Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. , 2002, Journal of experimental psychology. Human perception and performance.

[24]  R. Hyman.  Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[25]  D. Freides,et al.  Human information processing and sensory modality: cross-modal functions, information complexity, memory, and deficit. , 1974, Psychological bulletin.

[26]  J. Juola,et al.  Audiovisual synchrony and temporal order judgments: Effects of experimental method and stimulus type , 2008, Perception & psychophysics.

[27]  R. Verleger,et al.  Cooperation or Competition of the Two Hemispheres in Processing Characters Presented at Vertical Midline , 2013, PloS one.

[28]  Jeff Miller,et al.  Effects of redundant visual stimuli on temporal order judgments , 2004, Perception & psychophysics.

[29]  C. Spence,et al.  Confusing the mind by crossing the hands. , 2002, Brain research. Cognitive brain research.

[30]  W. E. Hick.  Quarterly Journal of Experimental Psychology , 1948, Nature.

[31]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[32]  S. Kitazawa,et al.  Reversal of subjective temporal order due to arm crossing , 2001, Nature Neuroscience.

[33]  S. Nishida,et al.  Audio–tactile superiority over visuo–tactile and audio–visual combinations in the temporal resolution of synchrony perception , 2009, Experimental Brain Research.

[34]  M. Wallace,et al.  The effects of visual training on multisensory temporal processing , 2013, Experimental Brain Research.

[35]  M. García-Pérez,et al.  On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model , 2012, Psychonomic bulletin & review.

[36]  C. Spence,et al.  Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments , 2008, Experimental Brain Research.

[37]  E. Miller,et al.  Response to Comment on "Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices" , 2007, Science.

[38]  B. Dosher,et al.  The dynamics of perceptual learning: an incremental reweighting model. , 2005, Psychological review.

[39]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[40]  A. Diederich,et al.  The time window of multisensory integration: relating reaction times and judgments of temporal order. , 2015, Psychological review.

[41]  D. Meyer,et al.  Attention and Performance XIV , 1973 .