Traversing the many paths of workflow research: developing a conceptual framework of workflow terminology through a systematic literature review

The objective of this review was to describe methods used to study and model workflow. The authors included studies set in a variety of industries using qualitative, quantitative and mixed methods. Of the 6221 matching abstracts, 127 articles were included in the final corpus. The authors collected data from each article on researcher perspective, study type, methods type, specific methods, approaches to evaluating quality of results, definition of workflow and dependent variables. Ethnographic observation and interviews were the most frequently used methods. Long study durations revealed the large time commitment required for descriptive workflow research. The most frequently discussed technique for evaluating quality of study results was triangulation. The definition of the term "workflow" and choice of methods for studying workflow varied widely across research areas and researcher perspectives. The authors developed a conceptual framework of workflow-related terminology for use in future research and present this model for use by other researchers.

[1]  Peter H. Carstensen,et al.  The Duality of Articulation Work in Large Heterogeneous Settings - a Study in Health Care , 2005, ECSCW.

[2]  Hans-Ulrich Prokosch,et al.  Workflow analysis and evidence-based medicine: towards integration of knowledge-based functions in hospital information systems , 1999, AMIA.

[3]  Emer Smyth,et al.  So much to do, so little time , 2007 .

[4]  Kim M. Unertl,et al.  Applying Direct Observation to Model Workflow and Assess Adoption , 2006, AMIA.

[5]  Anita L. Tucker,et al.  Operational failures and interruptions in hospital nursing. , 2006, Health services research.

[6]  Darren Gergle,et al.  On the "localness" of user-generated content , 2010, CSCW '10.

[7]  Brian M Kleiner,et al.  Macroergonomics: analysis and design of work systems. , 2006, Applied ergonomics.

[8]  Ching-Fang Lee,et al.  The Problems of Embeddedness: Knowledge Transfer, Coordination and Reuse in Information Systems , 2006 .

[9]  Joseph Sharit Applying human and system reliability analysis to the design and analysis of written procedures in high-risk industries , 1998 .

[10]  Carl Gutwin,et al.  A Groupware Design Framework for Loosely Coupled Workgroups , 2005, ECSCW.

[11]  David W. Bates,et al.  Position Paper: Factors and Forces Affecting EHR System Adoption: Report of a 2004 ACMI Discussion , 2004, J. Am. Medical Informatics Assoc..

[12]  Lysa Schwartz,et al.  Must change, will change: Process re-engineering in publishing , 1999 .

[13]  Nicolas Marmaras,et al.  Investigating the anaesthesiologists' practice through externalist and internalist approaches , 2005 .

[14]  Bob Fields,et al.  Function allocation: a perspective from studies of work practice , 2000, Int. J. Hum. Comput. Stud..

[15]  Madhu C. Reddy,et al.  A finger on the pulse: temporal rhythms and information seeking in medical work , 2002, CSCW '02.

[16]  W. Deming Out of the crisis : quality, productivity and competitive position , 1986 .

[17]  Wendy E. Mackay,et al.  Is paper safer? The role of paper flight strips in air traffic control , 1999, TCHI.

[18]  M E Cortizas,et al.  Specimen processing: centralized or decentralized? , 1996, Clinical laboratory management review : official publication of the Clinical Laboratory Management Association.

[19]  Patricia C. Dykes,et al.  Workflow Analysis in Primary Care: Implications for EHR Adoption , 2005, AMIA.

[20]  Bruce I. Reiner,et al.  Workflow Optimization: Current Trends and Future Directions , 2002, Journal of Digital Imaging.

[21]  Thomas G Rundall,et al.  Kaiser Permanente's experience of implementing an electronic medical record: a qualitative study , 2005, BMJ : British Medical Journal.

[22]  John Fontanesi,et al.  The forms that bind: multiple data forms result in internal disaggregation of immunization information. , 2002, Journal of public health management and practice : JPHMP.

[23]  Suzanne Bakken,et al.  Description of a method to support public health information management: Organizational network analysis , 2007, J. Biomed. Informatics.

[24]  Alain Wisner,et al.  Understanding problem building: ergonomic work analysis , 1995 .

[25]  Eleonora Vratskidou,et al.  London School of Economics and Political Science, Hellenic Observatory The 3rd HO PhD Symposium on Contemporary Greece: Structures, Context and Challenges HELLENIC CULTURAL INSTITUTIONS IN SEARCH OF IDENTITY: THE CASE OF THE NATIONAL GALLERY- ALEXANDROS SOUTSOS MUSEUM , 2007 .

[26]  L. Petersen,et al.  Barriers to proliferation of electronic medical records. , 2004, Informatics in primary care.

[27]  Yvonne Rogers,et al.  What Are Workplace Studies For? , 1995, ECSCW.

[28]  R M Gardner,et al.  Impact of CPOE on Mortality Rates – Contradictory Findings, Important Messages , 2006, Methods of Information in Medicine.

[29]  Pascale Carayon,et al.  Performance Obstacles of Intensive Care Nurses , 2007, Nursing research.

[30]  E. Goorman,et al.  Modelling nursing activities: electronic patient records and their discontents. , 2000, Nursing inquiry.

[31]  Michelle De Guire,et al.  Applying workflow analysis tools to assess immunization delivery in outpatient primary care settings. , 2000, The Joint Commission journal on quality improvement.

[32]  John Bowers,et al.  Workflow From Within and Without: Technology and Cooperative Work on the Print Industry Shopfloor , 1995, ECSCW.

[33]  Kimberly Klein So much to do, so little time. To accomplish the mandatory initiatives of ARRA, healthcare organizations will require significant and thoughtful planning, prioritization and execution. , 2010, Journal of healthcare information management : JHIM.

[34]  Barbara Mirel,et al.  General hospital: modeling complex problem solving in complex work system , 2003, SIGDOC '03.

[35]  Anders Jansson,et al.  Participatory design with train drivers - a process analysis , 2005, Interact. Comput..

[36]  Johannes Bernarding,et al.  Digital workflow management for quality assessment in pathology. , 2008, Pathology, research and practice.

[37]  Carl Gutwin,et al.  Groupware walkthrough: adding context to groupware usability evaluation , 2002, CHI.

[38]  Charles L. Owen,et al.  Design Thinking: Notes on Its Nature and Use , 2006 .

[39]  Gillian Symon,et al.  The coordination of work activities: Cooperation and conflict in a hospital context , 1996, Computer Supported Cooperative Work (CSCW).

[40]  Marc Berg,et al.  Patient care information systems and health care work: a sociotechnical approach , 1999, Int. J. Medical Informatics.

[41]  S. Barley,et al.  Bringing Work Back In , 2001 .

[42]  Y. Han,et al.  Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System , 2005, Pediatrics.

[43]  Michael J. Earl,et al.  Strategies for Business Process Reengineering: Evidence from Field Studies , 1995, J. Manag. Inf. Syst..

[44]  Tonia Graves,et al.  Developing a Crystal Clear Future for the Serials Unit in an Electronic Environment: Results of a Workflow Analysis , 2006 .

[45]  Asha K Pai,et al.  Integration of a clinical community pharmacist position: emphasis on workflow design. , 2005, Journal of the American Pharmacists Association : JAPhA.

[46]  Brian Hazlehurst,et al.  Getting the right tools for the job: distributed planning in cardiac surgery , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[47]  B. Bloom Crossing the Quality Chasm: A New Health System for the 21st Century , 2002 .

[48]  Tom Rodden,et al.  Getting to know the 'customer in the machine' , 1999, GROUP '99.

[49]  Stanley L. Pestotnik,et al.  Reengineering a Surgical Service Line: Focusing on Core Process Improvement , 1997, American journal of medical quality : the official journal of the American College of Medical Quality.

[50]  Sameer Malhotra,et al.  Workflow Modeling in Critical Care: Piecing your own Puzzle , 2005, AMIA.

[51]  Ton A. M. Spil,et al.  Workflow management for multiple sclerosis patients: IT and organization , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[52]  Maaria Nuutinen,et al.  Contextual assessment of working practices in changing work , 2005 .

[53]  P. Carayon,et al.  Work system design for patient safety: the SEIPS model , 2006, Quality and Safety in Health Care.

[54]  Laurie L. Novak,et al.  Barcode Medication Administration: Supporting Transitions in Articulation Work , 2008, AMIA.

[55]  P C Heaton,et al.  Time and cost analysis of repacking medications in unit-of-use containers. , 2000, Journal of the American Pharmaceutical Association.

[56]  Eta S. Berner,et al.  A Mobile Data Collection Tool for Workflow Analysis , 2007, MedInfo.

[57]  Mark W. Newman,et al.  Sitemaps, storyboards, and specifications: a sketch of Web site design practice , 2000, DIS '00.

[58]  W. Bodmer Principles of Scientific Management , 1993, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[59]  Fokie Cnossen,et al.  Improving Situation Awareness in Anesthesiology , 2005 .

[60]  A Endress,et al.  The critical path method to analyze and modify OR‐workflow: Integration of an image documentation system , 2006, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[61]  Steven L. Alter Pervasive real-time IT as a disruptive technology for the IS field , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[62]  H. A. Reijersa,et al.  Best practices in business process redesign : an overview and qualitative evaluation of successful redesign heuristics , 2005 .

[63]  S Mbambo,et al.  A job analysis of selected health workers in a district health system in KwaZulu-Natal. Part Two: Job analysis of nurses in primary health care settings. , 2003, Curationis.

[64]  David Goldsman,et al.  A discrete-event simulation application for clinics serving the poor , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[65]  Richard I. Cook,et al.  Creating Resilient IT: How the Sign-Out Sheet Shows Clinicians Make Healthcare Work , 2006, AMIA.

[66]  Steve Sawyer,et al.  Always Articulating: Theorizing on Mobile and Wireless Technologies , 2006, Inf. Soc..

[67]  R. M. Guerrero,et al.  Work activities before and after implementation of an automated dispensing system. , 1996, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[68]  William A. Stubblefield,et al.  The social life of engineering authorizations , 2000, DIS '00.

[69]  Iain Morrison,et al.  Examining quality of care-how poor information flow can impact on hospital workflow and affect patient outcomes , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[70]  Amy N. Cohen,et al.  Review paper: Informatics Systems to Promote Improved Care for Chronic Illness: A Literature Review , 2007, J. Am. Medical Informatics Assoc..

[71]  Carsten S. Østerlund Genre Combinations: A Window into Dynamic Communication Practices , 2007, J. Manag. Inf. Syst..

[72]  Susanne Bødker,et al.  Computer Support for Social Awareness in Flexible Work , 2006, Computer Supported Cooperative Work (CSCW).

[73]  Marc Berg,et al.  Accumulating and Coordinating: Occasions for Information Technologies in Medical Work , 1999, Computer Supported Cooperative Work (CSCW).

[74]  Jakob E. Bardram,et al.  Plans as Situated Action: An Activity Theory Approach to Workflow Systems , 1997, ECSCW.

[75]  Clay Spinuzzi,et al.  Modeling genre ecologies , 2002, SIGDOC '02.

[76]  Dean F. Sittig,et al.  Lessons From “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System” , 2006, Pediatrics.

[77]  Katherine P. Andriole,et al.  Productivity and Cost Assessment of Computed Radiography, Digital Radiography, and Screen-Film for Outpatient Chest Examinations , 2002, Journal of Digital Imaging.

[78]  Simaan M. AbouRizk,et al.  Construction engineering and project management II: an application of lean concepts and simulation for drainage operations maintenance crews , 2003, Winter Simulation Conference.

[79]  Clay Spinuzzi,et al.  Software development as mediated activity: applying three analytical frameworks for studying compound mediation , 2001, SIGDOC '01.

[80]  M W M Jaspers,et al.  The use of cognitive methods in analyzing clinicians' task behavior. , 2002, Studies in health technology and informatics.

[81]  K N Barker,et al.  Re-engineering a pharmacy work system and layout to facilitate patient counseling. , 1996, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[82]  B. Karsh,et al.  A macro-ergonomic work system analysis of the diagnostic testing process in an outpatient health care facility for process improvement and patient safety , 2006, Ergonomics.

[83]  Vimla L. Patel,et al.  The multitasking clinician: Decision-making and cognitive demand during and after team handoffs in emergency care , 2007, Int. J. Medical Informatics.

[84]  Lucy A. Suchman,et al.  Reflections on a Work-Oriented Design Project , 1996, Hum. Comput. Interact..

[85]  Ann Blandford,et al.  Understanding emergency medical dispatch in terms of distributed cognition: a case study , 2006, Ergonomics.

[86]  Gloria Mark,et al.  Conventions and Commitments in Distributed CSCW Groups , 2002, Computer Supported Cooperative Work (CSCW).

[87]  David M. Ferrin,et al.  Emergency departments II: simulating Six Sigma improvement ideas for a hospital emergency department , 2003, WSC '03.

[88]  Michael J. Muller,et al.  Design as a minority discipline in a software company: toward requirements for a community of practice , 2002, CHI.

[89]  Andrew F. Monk,et al.  Using cognitive task analysis to facilitate the integration of decision support systems into the neonatal intensive care unit , 2005, Artif. Intell. Medicine.

[90]  Kim M. Unertl,et al.  Research Paper: Describing and Modeling Workflow and Information Flow in Chronic Disease Care , 2009, J. Am. Medical Informatics Assoc..

[91]  JUDITH W. DEXHEIMER,et al.  Review Paper: Prompting Clinicians about Preventive Care Measures: A Systematic Review of Randomized Controlled Trials , 2008, J. Am. Medical Informatics Assoc..

[92]  Vimla L. Patel,et al.  Interruptions in a level one trauma center: A case study , 2008, Int. J. Medical Informatics.

[93]  Sara A. Bly,et al.  Supporting the Flow of Information Through Constellations of Interaction , 1997, ECSCW.

[94]  Tom Rodden,et al.  Proceedings of the Fifth European Conference on Computer Supported Cooperative Work , 1997, Springer Netherlands.

[95]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[96]  D. Blumenthal Launching HITECH. , 2010, The New England journal of medicine.

[97]  Mark Rouncefield,et al.  Chalk and Cheese: BPR and ethnomethodogically informed ethnography in CSCW , 1995, ECSCW.

[98]  Marc Berg,et al.  The mantra of modeling and the forgotten powers of paper: a sociotechnical view on the development of process-oriented ICT in health care , 2003, Int. J. Medical Informatics.

[99]  Melroy E. D'Souza,et al.  Listening to users in a manufacturing organization: a context-based approach to the development of a computer-supported collaborative work system , 2003 .

[100]  Lucy A. Suchman,et al.  Making work visible , 1995, CACM.

[101]  Yan Xiao,et al.  Work coordination, workflow, and workarounds in a medical context , 2005, CHI Extended Abstracts.

[102]  Ron Wakkary,et al.  The resourcefulness of everyday design , 2007, C&C '07.

[103]  L. Uys,et al.  The practice of community caregivers in a home-based HIV/AIDS project in South Africa. , 2002, Journal of clinical nursing.

[104]  A Mira,et al.  Workflow analysis an international tool: cost reduction while retaining personnel. , 1999, Clinical laboratory management review : official publication of the Clinical Laboratory Management Association.

[105]  Gudela Grote,et al.  KOMPASS: a method for complementary function allocation in automated work systems , 2000, Int. J. Hum. Comput. Stud..

[106]  Penny Hagen,et al.  Balancing work, life and other concerns: a study of mobile technology use by Australian freelancers , 2006, NordiCHI '06.

[107]  Chris W. Clegg,et al.  A Sociotechnical Method for Designing Work Systems , 2002, Hum. Factors.

[108]  Michael J. Muller Invisible Work of Telephone Operators: An Ethnocritical Analysis , 1999, Computer Supported Cooperative Work (CSCW).

[109]  Emily S. Patterson,et al.  Research Paper: Improving Patient Safety by Identifying Side Effects from Introducing Bar Coding in Medication Administration , 2002, J. Am. Medical Informatics Assoc..

[110]  Sameer Malhotra,et al.  Workflow modeling in critical care: Piecing together your own puzzle , 2007, J. Biomed. Informatics.

[111]  Lillian Moller Gilbreth,et al.  The Psychology of Management: The Function of the Mind in Determining, Teaching and Installing Methods of Least Waste , 2008 .

[112]  Elizabeth M Borycki,et al.  Use of simulation in the study of clinician workflow. , 2006, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[113]  Ellen Balka,et al.  Who is in charge of patient safety? Work practice, work processes and utopian views of automatic drug dispensing systems , 2007, Int. J. Medical Informatics.

[114]  T. Govindaraj,et al.  An information system based on empirical studies of engineering designers , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[115]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[116]  Pierre Tchounikine,et al.  Redefining the Turn-Taking Notion in Mediated Communication of Virtual Learning Communities , 2004, Intelligent Tutoring Systems.

[117]  Vimla L. Patel,et al.  When You Come to a Fork in the Road, Take It: Strategy Selection in Order Entry , 2005, AMIA.

[118]  Diane H. Sonnenwald,et al.  Information behavior in dynamic group work contexts: interwoven situational awareness, dense social networks and contested collaboration in command and control , 2000, Inf. Process. Manag..

[119]  Pascale Carayon,et al.  Righting wrong site surgery. , 2004, The Joint Commission Journal on Quality and Safety.

[120]  Peter C. Wright,et al.  From information processing to dialogical meaning making: an experiential approach to cognitive ergonomics , 2004, Cognition, Technology & Work.

[121]  Hajo A. Reijers,et al.  Best practices in business process redesign: an overview and qualitative evaluation of successful redesign heuristics , 2005 .

[122]  Carl Gutwin,et al.  Designing for loose coupling in mobile groups , 2003, GROUP.

[123]  Jakob E. Bardram,et al.  “I love the system—I just don't use it!” , 1997, GROUP.

[124]  A Mira,et al.  Pre-analytical workflow analysis reveals simple changes and can result in improved hospital efficiency. , 2001, Clinical leadership & management review : the journal of CLMA.

[125]  Kevin B. Johnson,et al.  Case Report: Case Report: Activity Diagrams for Integrating Electronic Prescribing Tools into Clinical Workflow , 2006, J. Am. Medical Informatics Assoc..

[126]  Rob Procter,et al.  Making a Case in Medical Work: Implications for the Electronic Medical Record , 2003, Computer Supported Cooperative Work (CSCW).

[127]  David B. Martin,et al.  Working the contract , 2007, OZCHI '07.

[128]  Michael W. Carter,et al.  Healthcare process analysis: redesigning the medication ordering, dispensing, and administration process in an acute care academic health sciences centre , 2003, WSC '03.

[129]  M Jerva BPR (business process redesign) and systems analysis and design: making the case for integration. , 2001, Topics in health information management.

[130]  Richard Bentley,et al.  Getting some perspective: using process descriptions to index document history , 1999, GROUP.

[131]  A. Batenhorst,et al.  A comparison of time-and-motion and self-reporting methods of work measurement. , 2000, The Journal of nursing administration.

[132]  Helena Karasti,et al.  Bridging Work Practice and System Design: Integrating Systemic Analysis, Appreciative Intervention and Practitioner Participation , 2001, Computer Supported Cooperative Work (CSCW).

[133]  A. M. Pejtersen,et al.  Information seeking and sharing in design teams , 2003, GROUP.

[134]  Pernille Bertelsen,et al.  Participatory Work Flow Analysis prior to Implementation of EPR: A Method to Discover Needs for Change , 2005, MIE.

[135]  T Timpka,et al.  Division of labour in clinical microbiology. Co-operation and fragmentation. , 1996, Scandinavian journal of caring sciences.

[136]  Jonas Landgren,et al.  A study of emergency response work: patterns of mobile phone interaction , 2007, CHI.

[137]  Terry Capuano,et al.  Work Flow Analysis: Eliminating Non–Value-Added Work , 2004, Journal of Nursing Administration.

[138]  Fokie Cnossen,et al.  Proceedings of the Annual Conference of the European Association of Cognitive Ergonomics (EACE '05) , 2005 .

[139]  Toomas Timpka,et al.  A model for interpreting work and information management in process-oriented healthcare organisations , 2003, Int. J. Medical Informatics.

[140]  Ina Wagner,et al.  Making things work: dimensions of configurability as appropriation work , 2006, CSCW '06.

[141]  Sameer Kumar,et al.  Business process redesign as a tool for organizational development , 2004 .

[142]  Mariëlle den Hengst,et al.  Collaborative Business Engineering: A Decade of Lessons from the Field , 2004, J. Manag. Inf. Syst..

[143]  Alan R. Hevner,et al.  It's more than just use: An exploration of telemedicine use quality , 2007, Decis. Support Syst..

[144]  Kjeld Schmidt,et al.  Proceedings of the international ACM SIGGROUP conference on Supporting group work: the integration challenge , 1997 .

[145]  M Rouncefield,et al.  Trusting the Record , 2003, Methods of Information in Medicine.

[146]  L D Urden,et al.  Work Sampling: A Decision-Making Tool for Determining Resources and Work Redesign , 1997 .

[147]  Jackie Campbell,et al.  Designing a podiatry service to meet the needs of the population: a service simulation. , 2007, Australian health review : a publication of the Australian Hospital Association.

[148]  G. Stricker American Psychological Association Code of Ethics , 2010 .

[149]  Mario G. Beruvides,et al.  An analysis of middle management work in non-steady conditions , 1996 .

[150]  Akira Abeta,et al.  Implementation and evaluation of an automatic personal workflow extraction method , 1999, Proceedings. Twenty-Third Annual International Computer Software and Applications Conference (Cat. No.99CB37032).

[151]  Pascale Carayon,et al.  Designing a Technology Enhanced Practice for Home Nursing Care of Patients with Congestive Heart Failure , 2005, AMIA.

[152]  Madhu C. Reddy,et al.  Collaborative information seeking: A field study of a multidisciplinary patient care team , 2008, Inf. Process. Manag..

[153]  P. John Clarkson,et al.  Externalizing tacit overview knowledge: A model-based approach to supporting design teams , 2007, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[154]  John Long,et al.  A model of medical reception–the planning and control of multiple task work , 1995 .