The Effects of Task Difficulty and Multitasking on Performance

Multitasking is prevalent during computer-mediated work. Users tend to switch between multiple ongoing computer-based tasks either due to a personal decision to break from the current task (self-interruption) or due to an external interruption, such as an electronic notification. To examine how different types of multitasking, along with subjective task difficulty, influence performance, we conducted a controlled experiment using a custom-developed multitasking environment. A total of 636 subjects were randomly assigned into one of the three conditions: discretionary, where they were allowed to decide when and how often to switch tasks; mandatory, where they were forced to switch tasks at specific times; and sequential, where they had to perform tasks in sequence, without switching. The experimental environment featured a primary problem-solving task and five secondary tasks. The results show that when the primary task was considered difficult, subjects forced to multitask had significantly lower performance compared with not only the subjects who did not multitask but also the subjects who were able to multitask at their discretion. Conversely, when the primary task was considered easy, subjects forced to multitask had significantly higher performance than both the subjects who did not multitask and the subjects who multitasked at their discretion.

[1]  M. Hakel,et al.  Effects of Objective and Subjective Task Complexity on Performance , 1997 .

[2]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[3]  J. Trafton,et al.  Does the Difficulty of an Interruption Affect our Ability to Resume? , 2007 .

[4]  Daniel C. McFarlane,et al.  Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction , 2002, Hum. Comput. Interact..

[5]  Rebecca E. Grinter,et al.  Quality versus quantity: e-mail-centric task management and its relation with overload , 2005 .

[6]  Eric Horvitz,et al.  Disruption and recovery of computing tasks: field study, analysis, and directions , 2007, CHI.

[7]  Raquel Benbunan-Fich,et al.  Measuring multitasking behavior with activity-based metrics , 2011, TCHI.

[8]  Víctor M. González,et al.  No task left behind?: examining the nature of fragmented work , 2005, CHI.

[9]  Dario D. Salvucci,et al.  Multitasking and monotasking: the effects of mental workload on deferred task interruptions , 2010, CHI.

[10]  Kara A. Latorella,et al.  The Scope and Importance of Human Interruption in Human-Computer Interaction Design , 2002, Hum. Comput. Interact..

[11]  David E. Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. , 1997 .

[12]  D. Broadbent,et al.  What makes interruptions disruptive? A study of length, similarity, and complexity , 1989 .

[13]  Nick Chater,et al.  Identifying Optimum Performance Trade-Offs Using a Cognitively Bounded Rational Analysis Model of Discretionary Task Interleaving , 2011, Top. Cogn. Sci..

[14]  Raquel Benbunan-Fich,et al.  Juggling on a high wire: Multitasking effects on performance , 2012, Int. J. Hum. Comput. Stud..

[15]  K. Teigen.  Yerkes-Dodson: A Law for all Seasons , 1994 .

[16]  D. Norman,et al.  Psychological Issues in Support of Multiple Activities , 1986 .

[17]  Antti Oulasvirta,et al.  Long-term working memory and interrupting messages in human – computer interaction , 2004, Behav. Inf. Technol..

[18]  Dylan M. Jones,et al.  Interruption of the Tower of London task: support for a goal-activation approach. , 2006, Journal of experimental psychology. General.

[19]  John T. Stasko,et al.  Establishing tradeoffs that leverage attention for utility: empirically evaluating information display in notification systems , 2003, Int. J. Hum. Comput. Stud..

[20]  Charles K. Crook,et al.  Ubiquitous Computing on Campus: Patterns of Engagement by University Students , 2001, Int. J. Hum. Comput. Interact..

[21]  David H. Jonassen.  Learning to Solve Complex Scientific Problems , 2007 .

[22]  David G. Kidd,et al.  Factors Affecting Interrupted Task Performance: Effects of Adaptability, Impulsivity and Intelligence , 2010 .

[23]  Mary Czerwinski,et al.  A diary study of task switching and interruptions , 2004, CHI.

[24]  Laura A. Dabbish,et al.  Self-interruption on the computer: a typology of discretionary task interleaving , 2009, CHI.

[25]  Pau Klein,et al.  San Francisco, California , 2007 .

[26]  Cathy N. Davidson.  Now You See It: How the Brain Science of Attention Will Transform the Way We Live, Work, and Learn , 2011 .

[27]  Joseph S. Valacich,et al.  The Effects of Interruptions, Task Complexity, and Information Presentation on Computer-Supported Decision-Making Performance , 2003, Decis. Sci..

[28]  Mary Czerwinski,et al.  Introduction: design and evaluation of notification user interfaces , 2003, Int. J. Hum. Comput. Stud..

[29]  Christopher A. Monk,et al.  Dealing with Interruptions can be Complex, but does Interruption Complexity Matter: A Mental Resources Approach to Quantifying Disruptions , 2008 .

[30]  Brian P. Bailey,et al.  Oasis: A framework for linking notification delivery to the perceptual structure of goal-directed tasks , 2010, TCHI.

[31]  Duncan P. Brumby,et al.  Strategic Adaptation to Performance Objectives in a Dual-Task Setting , 2010, Cogn. Sci..

[32]  Niels Taatgen,et al.  The Multitasking Mind , 2010, Oxford series on cognitive models and architectures.

[33]  Duncan P. Brumby,et al.  Natural Break Points , 2012 .

[34]  Geoffrey B. Duggan,et al.  Interleaving tasks to improve performance: Users maximise the marginal rate of return , 2013, Int. J. Hum. Comput. Stud..

[35]  Antti Oulasvirta,et al.  Surviving task interruptions: Investigating the implications of long-term working memory theory , 2006, Int. J. Hum. Comput. Stud..

[36]  D. Meyer,et al.  Executive control of cognitive processes in task switching. , 2001, Journal of experimental psychology. Human perception and performance.

[37]  Nick Yeung,et al.  Bottom-up influences on voluntary task switching: the elusive homunculus escapes. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[38]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[39]  Dario D. Salvucci,et al.  The effects of time constraints on user behavior for deferrable interruptions , 2011, CHI.

[40]  Frederick L. Oswald,et al.  Keeping All the Plates Spinning: Understanding and Predicting Multitasking Performance , 2017 .

[41]  Brian P. Bailey,et al.  On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state , 2006, Comput. Hum. Behav..

[42]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[43]  J. Gregory Trafton,et al.  Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal , 2003, Int. J. Hum. Comput. Stud..

[44]  Hansjörg Neth,et al.  Discretionary task interleaving: heuristics for time allocation in cognitive foraging. , 2007, Journal of experimental psychology. General.

[45]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[46]  Víctor M. González,et al.  "Constant, constant, multi-tasking craziness": managing multiple working spheres , 2004, CHI.

[47]  Geri Gay,et al.  The laptop and the lecture: The effects of multitasking in learning environments , 2003, J. Comput. High. Educ..

[48]  Donald A. Norman,et al.  User Centered System Design , 1986 .

[49]  Brian P. Bailey,et al.  Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management , 2008, TCHI.

[50]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.