Studying interruptions and multitasking in situ: The untapped potential of quantitative observational studies

Much of the large and growing body of literature on interruption and multitasking is motivated, in part, by a desire to reduce their negative effects in occupational settings, particularly those that are safety critical. Much of the existing knowledge has come from experimental studies, however, these do not necessarily generalize to non-experimental contexts. By virtue of being in situ, the results of observational studies are more generalizable, but internal validity remains an issue. Since many of the quantitative observational studies of interruption or multitasking to date have been largely descriptive, their full potential to contribute knowledge that informs practical improvements has been underutilized. We discuss ways to address threats to internal validity in quantitative observational studies through appropriate analysis with particular reference to workflow time studies, a form of direct observation. We also discuss the potential for more sophisticated analysis methods to both address some of the threats to internal validity and to provide more nuanced insights into the role and impacts of interruption and multitasking. In this way observational studies can contribute unique evidence to facilitate practical improvements to work practices and systems. Understanding interruption and multitasking can enable improvement to work practice.Quantitative observational studies give unique insights into interruption and multitasking.We discuss how the validity of workflow time studies can be improved.We outline innovative ways of quantitatively analysing observational data on work processes.