A scoping review of qualitative research in JAMIA: past contributions and opportunities for future work

OBJECTIVE Qualitative methods are particularly well-suited to studying the complexities and contingencies that emerge in the development, preparation, and implementation of technological interventions in real-world clinical practice, and much remains to be done to use these methods to their full advantage. We aimed to analyze how qualitative methods have been used in health informatics research, focusing on objectives, populations studied, data collection, analysis methods, and fields of analytical origin. METHODS We conducted a scoping review of original, qualitative empirical research in JAMIA from its inception in 1994 to 2019. We queried PubMed to identify relevant articles, ultimately including and extracting data from 158 articles. RESULTS The proportion of qualitative studies increased over time, constituting 4.2% of articles published in JAMIA overall. Studies overwhelmingly used interviews, observations, grounded theory, and thematic analysis. These articles used qualitative methods to analyze health informatics systems before, after, and separate from deployment. Providers have typically been the main focus of studies, but there has been an upward trend of articles focusing on healthcare consumers. DISCUSSION While there has been a rich tradition of qualitative inquiry in JAMIA, its scope has been limited when compared with the range of qualitative methods used in other technology-oriented fields, such as human-computer interaction, computer-supported cooperative work, and science and technology studies. CONCLUSION We recommend increased public funding for and adoption of a broader variety of qualitative methods by scholars, practitioners, and policy makers and an expansion of the variety of participants studied. This should lead to systems that are more responsive to practical needs, improving usability, safety, and outcomes.

[1]  James F. Brinkley,et al.  Issues in biomedical research data management and analysis: needs and barriers. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[2]  L. Suchman,et al.  Diana E. Forsythe (11 November 1947-14 August 1997) , 1998 .

[3]  Kim M. Unertl,et al.  Research Paper: Describing and Modeling Workflow and Information Flow in Chronic Disease Care , 2009, J. Am. Medical Informatics Assoc..

[4]  Steven K. Feiner,et al.  Interactive tools for inpatient medication tracking: a multi-phase study with cardiothoracic surgery patients , 2016, J. Am. Medical Informatics Assoc..

[5]  Richard Harper,et al.  The Organisation in Ethnography –A Discussion of Ethnographic Fieldwork Programs in CSCW , 2000, Computer Supported Cooperative Work (CSCW).

[6]  Brian Hazlehurst,et al.  Distributed cognition: An alternative model of cognition for medical informatics , 2008, Int. J. Medical Informatics.

[7]  Thomas A. Schwandt,et al.  Judging interpretations: But is it rigorous? trustworthiness and authenticity in naturalistic evaluation , 2007 .

[8]  Philip J. Kroth,et al.  Physician stress and burnout: the impact of health information technology , 2018, J. Am. Medical Informatics Assoc..

[9]  Wolff-Michael Roth,et al.  Situational Awareness as an Instructable and Instructed Matter in Multi-Media Supported Debriefing: a Case Study from Aviation , 2015, Computer Supported Cooperative Work (CSCW).

[10]  Raj M. Ratwani,et al.  Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors , 2015, J. Am. Medical Informatics Assoc..

[11]  Madhu C. Reddy,et al.  Designing for privacy management in hospitals: Understanding the gap between user activities and IT staff's understandings , 2015, Int. J. Medical Informatics.

[12]  Joan S. Ash,et al.  The unintended consequences of computerized provider order entry: Findings from a mixed methods exploration , 2009, Int. J. Medical Informatics.

[13]  Joan S. Ash,et al.  An Unintended Consequence of CPOE Implementation: Shifts in Power, Control, and Autonomy , 2006, AMIA.

[14]  S. Woolgar,et al.  Computers and the Transformation of Social Analysis , 1991 .

[15]  Shilo Anders,et al.  Mediation of adoption and use: a key strategy for mitigating unintended consequences of health IT implementation , 2012, J. Am. Medical Informatics Assoc..

[16]  Scout Calvert,et al.  Opportunities and challenges in the use of personal health data for health research , 2016, J. Am. Medical Informatics Assoc..

[17]  C. Chew‐Graham,et al.  Association Between Physician Burnout and Patient Safety, Professionalism, and Patient Satisfaction: A Systematic Review and Meta-analysis , 2018, JAMA internal medicine.

[18]  Julia Adler-Milstein,et al.  HITECH Act Drove Large Gains In Hospital Electronic Health Record Adoption. , 2017, Health affairs.

[19]  Kathleen Manning,et al.  Authenticity in Constructivist Inquiry: Methodological Considerations Without Prescription , 1997 .

[20]  Aaron Marcus,et al.  User Interface Design's Return on Investment: Examples and Statistics , 2005 .

[21]  Wendy E. Mackay,et al.  Is paper safer? The role of paper flight strips in air traffic control , 1999, TCHI.

[22]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[23]  Philip R. O. Payne,et al.  Clinical research informatics: challenges, opportunities and definition for an emerging domain. , 2009, Journal of the American Medical Informatics Association : JAMIA.

[24]  Warren J. Winkelman,et al.  Research Paper: Patient-Perceived Usefulness of Online Electronic Medical Records: Employing Grounded Theory in the Development of Information and Communication Technologies for Use by Patients Living with Chronic Illness , 2005, J. Am. Medical Informatics Assoc..

[25]  Michael J. Muller,et al.  Participatory design , 1993, CACM.

[26]  D. Blumenthal,et al.  The "meaningful use" regulation for electronic health records. , 2010, The New England journal of medicine.

[27]  A. Rajić,et al.  A scoping review of scoping reviews: advancing the approach and enhancing the consistency , 2014, Research synthesis methods.

[28]  Lucy A. Suchman,et al.  Making work visible , 1995, CACM.

[29]  Nancy G. Leveson.  The Therac-25: 30 Years Later , 2017, Computer.

[30]  C. Coggan,et al.  A qualitative investigation into the receptivity to hip protective underwear among staff and residents of residential institutions. , 1998, The New Zealand medical journal.

[31]  Yunan Chen,et al.  Unintended Adverse Consequences of Health IT Implementation: Workflow Issues and Their Cascading Effects , 2019, Health Informatics.

[32]  A. Miah,et al.  Mobile, wearable and ingestible health technologies: towards a critical research agenda , 2017 .

[33]  Emily S. Patterson,et al.  Research Paper: Improving Patient Safety by Identifying Side Effects from Introducing Bar Coding in Medication Administration , 2002, J. Am. Medical Informatics Assoc..

[34]  Adi Kuntsman,et al.  Re-thinking Digital Health: Data, Appisation and the (im)possibility of ‘Opting out’ , 2019, Digital health.

[35]  Joan S. Ash,et al.  Research Paper: Types of Unintended Consequences Related to Computerized Provider Order Entry , 2006, J. Am. Medical Informatics Assoc..

[36]  Brian Hazlehurst,et al.  Distributed cognition in the heart room: How situation awareness arises from coordinated communications during cardiac surgery , 2007, J. Biomed. Informatics.

[37]  A Voss,et al.  Working IT Out in Medical Practice: IT Systems Design and Development as Co-Realisation , 2003, Methods of Information in Medicine.

[38]  Ann Blandford,et al.  Understanding infusion administration in the ICU through Distributed Cognition , 2012, J. Biomed. Informatics.

[39]  Joshua E. Richardson,et al.  Research paper: The effects of hands-free communication device systems: communication changes in hospital organizations , 2010, J. Am. Medical Informatics Assoc..

[40]  John D. Halamka,et al.  The HITECH Era in Retrospect. , 2017, The New England journal of medicine.

[41]  Anne Moen,et al.  Health@Home: the work of health information management in the household (HIMH): implications for consumer health informatics (CHI) innovations. , 2005, Journal of the American Medical Informatics Association : JAMIA.

[42]  Rachel N. Weber,et al.  Manufacturing Gender in Commercial and Military Cockpit Design , 1997 .

[43]  F. Cabitza,et al.  Unintended Consequences of Machine Learning in Medicine , 2017, JAMA.

[44]  Thomas A. Schwandt,et al.  Judging interpretations: But is it rigorous? trustworthiness and authenticity in naturalistic evaluation , 2007 .

[45]  Constance Perin,et al.  Operating as Experimenting: Synthesizing Engineering and Scientific Values in Nuclear Power Production , 1998 .

[46]  Emily S. Patterson,et al.  Exploring barriers and facilitators to the use of computerized clinical reminders. , 2005, Journal of the American Medical Informatics Association : JAMIA.

[47]  Naja L. Holten Møller,et al.  The Clinical Work of Secretaries: Exploring the Intersection of Administrative and Clinical Work in the Diagnosing Process , 2012, COOP.

[48]  Deborah Lupton,et al.  Critical perspectives on digital health technologies , 2014 .

[49]  Gunnar Ellingsen,et al.  A Review of 25 Years of CSCW Research in Healthcare: Contributions, Challenges and Future Agendas , 2012, Computer Supported Cooperative Work (CSCW).

[50]  J. McGowan,et al.  PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation , 2018, Annals of Internal Medicine.

[51]  William B. Lober,et al.  A patient-centered system in a provider-centered world: challenges of incorporating post-discharge wound data into practice , 2016, J. Am. Medical Informatics Assoc..

[52]  Dean F. Sittig,et al.  Lessons From “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System” , 2006, Pediatrics.

[53]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[54]  Guilherme Del Fiol,et al.  Information needs of physicians, care coordinators, and families to support care coordination of children and youth with special health care needs (CYSHCN) , 2017, J. Am. Medical Informatics Assoc..

[55]  H. Arksey,et al.  Scoping studies: towards a methodological framework , 2005 .

[56]  Sophie Dupuy-Chessa,et al.  Formal verification of UI using the power of a recent tool suite , 2014, EICS '14.

[57]  Iris Wallenburg,et al.  The gaming healthcare practitioner: How practices of datafication and gamification reconfigure care , 2018, Health Informatics J..