Sources of interference in cross-modal action: response selection, crosstalk, and general dual-execution costs

Performing several actions simultaneously usually yields interference, which is commonly explained by referring to theoretical concepts such as crosstalk and structural limitations associated with response selection. While most research focuses on dual-task scenarios (involving two independent tasks), we here study the role of response selection and crosstalk for the control of cross-modal response compounds (saccades and manual responses) triggered by a single stimulus. In two experiments, participants performed single responses and spatially compatible versus incompatible dual-response compounds (crosstalk manipulation) in conditions with or without response selection requirements (i.e., responses either changed randomly between trials or were constantly repeated within a block). The results showed that substantial crosstalk effects were only present when response (compound) selection was required, not when a pre-selected response compound was merely repeated throughout a block of trials. We suggest that cross-response crosstalk operates on the level of response selection (during the activation of response codes), not on the level of response execution (when participants can rely on pre-activated response codes). Furthermore, we observed substantial residual dual-response costs even when neither response incompatibility nor response selection requirements were present. This suggests additional general dual-execution interference that occurs on a late, execution-related processing stage and even for two responses in rather distinct (manual and oculomotor) output modules. Generally, the results emphasize the importance of considering oculomotor interference in theorizing on multiple-action control.

[1]  F. Donders.  On the speed of mental processes. , 1969, Acta psychologica.

[2]  F. Donders,et al.  Over de snelheid van psychische Processen , 1868 .

[3]  Ian M. Franks,et al.  Reaction time differences in spatially constrained bilateral and unilateral movements , 2000, Experimental Brain Research.

[4]  Jeff Miller,et al.  Backward crosstalk effects in psychological refractory period paradigms: effects of second-task response types on first-task response latencies , 2006, Psychological research.

[5]  R W Proctor,et al.  Multiple spatial correspondence effects on dual-task performance. , 2000, Journal of experimental psychology. Human perception and performance.

[6]  Leanne Boucher,et al.  Saccades operate in violation of Hick’s law , 2002, Experimental Brain Research.

[7]  H Pashler,et al.  Making two responses to a single object: implications for the central attentional bottleneck. , 1992, Journal of experimental psychology. Human perception and performance.

[8]  Jeff Miller,et al.  Backward response-level crosstalk in the psychological refractory period paradigm. , 2006, Journal of experimental psychology. Human perception and performance.

[9]  G D Logan,et al.  Parallel memory retrieval in dual-task situations: II. Episodic memory. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[10]  G. Logan,et al.  Parallel response selection in dual-task situations , 2006, Perception & psychophysics.

[11]  M Gregory,et al.  Psychological refractory period and the length of time required to make a decision , 1967, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  K. Vohs,et al.  Psychology as the Science of Self-reports and Finger Movements Whatever Happened to Actual Behavior? , 2022 .

[13]  Sandra J. Thomson,et al.  Parallel response selection in dual-task situations via automatic category-to-response translation , 2010, Attention, perception & psychophysics.

[14]  D. Navon,et al.  Queuing or Sharing? A Critical Evaluation of the Single-Bottleneck Notion , 2002, Cognitive Psychology.

[15]  Lynn Huestegge,et al.  The role of saccades in multitasking: towards an output-related view of eye movements , 2011, Psychological research.

[16]  Eliot Hazeltine,et al.  Crossmodal action: modality matters , 2011, Psychological research.

[17]  B. Hommel.  Automatic stimulus-response translation in dual-task performance. , 1998, Journal of experimental psychology. Human perception and performance.

[18]  L. Huestegge,et al.  Cross-modal Action Complexity: Action- and Rule-related Memory Retrieval in Dual-response Control , 2017, Front. Psychol..

[19]  Wilfried Kunde,et al.  Who is talking in backward crosstalk? Disentangling response- from goal-conflict in dual-task performance , 2014, Cognition.

[20]  J Toby Mordkoff,et al.  Unequal motor durations under simple-, go/no-go, and choice-RT tasks: extension of Miller and Low (2001). , 2011, Journal of experimental psychology. Human perception and performance.

[21]  Barry H. Kantowitz,et al.  The psychological refractory period effect: Only half the double-stimulation story? , 1970 .

[22]  D. Navon,et al.  Role of outcome conflict in dual-task interference. , 1987, Journal of experimental psychology. Human perception and performance.

[23]  L. Huestegge,et al.  Oculomotor dominance in multitasking: mechanisms of conflict resolution in cross-modal action. , 2014, Journal of vision.

[24]  Torsten Schubert,et al.  Response activation in overlapping tasks and the response-selection bottleneck. , 2008, Journal of experimental psychology. Human perception and performance.

[25]  Lynn Huestegge,et al.  Constraints in task-set control: modality dominance patterns among effector systems. , 2013, Journal of experimental psychology. General.

[26]  I. Koch,et al.  Crossmodal action selection: Evidence from dual-task compatibility , 2010, Memory & cognition.

[27]  Bernhard Hommel,et al.  Control of stimulus-response translation in dual-task performance , 2002, Psychological research.

[28]  D Reynolds,et al.  Time and event uncertainty in unisensory reaction time. , 1966, Journal of experimental psychology.

[29]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[30]  P. Jolicoeur,et al.  A central capacity sharing model of dual-task performance. , 2003, Journal of experimental psychology. Human perception and performance.

[31]  I. Koch,et al.  Dual-task crosstalk between saccades and manual responses. , 2009, Journal of experimental psychology. Human perception and performance.

[32]  R. D. Gordon,et al.  Executive control of visual attention in dual-task situations. , 2001, Psychological review.

[33]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[34]  M G Fischman,et al.  Simple reaction time as a function of response complexity: memory drum theory revisited. , 1982, Journal of motor behavior.

[35]  D. Berlyne.  Uncertainty and conflict: a point of contact between information-theory and behavior-theory concepts. , 1957, Psychological review.

[36]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[37]  Wolfgang Prinz,et al.  Process interference and code overlap in dual-task performance , 2002 .

[38]  Nachshon Meiran,et al.  Journal of Experimental Psychology : Human Perception and Performance Objects and Events as Determinants of Parallel Processing in Dual Tasks : Evidence From the Backward Compatibility Effect , 2010 .

[39]  R. Proctor,et al.  Stimulus-response compatibility and psychological refractory period effects: Implications for response selection , 2002, Psychonomic bulletin & review.

[40]  A. Stockman,et al.  Color and brightness encoded in a common L- and M-cone pathway with expansive and compressive nonlinearities. , 2014, Journal of vision.

[41]  W. E. Hick.  Quarterly Journal of Experimental Psychology , 1948, Nature.

[42]  Lynn Huestegge,et al.  Talking while looking: On the encapsulation of output system representations , 2014, Cognitive Psychology.

[43]  L. Karlin,et al.  Effects of Number of Alternatives on the Psychological Refractory Period , 1968, The Quarterly journal of experimental psychology.

[44]  G D Logan,et al.  Parallel memory retrieval in dual-task situations: I. Semantic memory. , 2000, Journal of experimental psychology. Human perception and performance.

[45]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[46]  Markus Janczyk,et al.  Sequential modulation of backward crosstalk and task-shielding in dual-tasking. , 2016, Journal of experimental psychology. Human perception and performance.

[47]  Torsten Schubert,et al.  Processing differences between simple and choice reactions affect bottleneck localization in overlapping tasks , 1999 .

[48]  D. Holender.  24 Interference Between A Vocal and A Manual Response to the Same Stimulus , 1980 .