Envisioning an artificial intelligence documentation assistant for future primary care consultations: A co-design study with general practitioners

Abstract Objective The study sought to understand the potential roles of a future artificial intelligence (AI) documentation assistant in primary care consultations and to identify implications for doctors, patients, healthcare system, and technology design from the perspective of general practitioners. Materials and Methods Co-design workshops with general practitioners were conducted. The workshops focused on (1) understanding the current consultation context and identifying existing problems, (2) ideating future solutions to these problems, and (3) discussing future roles for AI in primary care. The workshop activities included affinity diagramming, brainwriting, and video prototyping methods. The workshops were audio-recorded and transcribed verbatim. Inductive thematic analysis of the transcripts of conversations was performed. Results Two researchers facilitated 3 co-design workshops with 16 general practitioners. Three main themes emerged: professional autonomy, human-AI collaboration, and new models of care. Major implications identified within these themes included (1) concerns with medico-legal aspects arising from constant recording and accessibility of full consultation records, (2) future consultations taking place out of the exam rooms in a distributed system involving empowered patients, (3) human conversation and empathy remaining the core tasks of doctors in any future AI-enabled consultations, and (4) questioning the current focus of AI initiatives on improved efficiency as opposed to patient care. Conclusions AI documentation assistants will likely to be integral to the future primary care consultations. However, these technologies will still need to be supervised by a human until strong evidence for reliable autonomous performance is available. Therefore, different human-AI collaboration models will need to be designed and evaluated to ensure patient safety, quality of care, doctor safety, and doctor autonomy.

[1]  Geoffrey E. Hinton.  Deep Learning-A Technology With the Potential to Transform Health Care. , 2018, JAMA.

[2]  Juan C. Quiroz,et al.  Challenges of developing a digital scribe to reduce clinical documentation burden , 2019, npj Digital Medicine.

[3]  Jenny M. Lewis,et al.  Reform and autonomy: Perceptions of the Australian general practice community , 2006 .

[4]  Juan C. Quiroz,et al.  A network model of activities in primary care consultations , 2019, J. Am. Medical Informatics Assoc..

[5]  J. de Haes,et al.  Doctor-patient communication: a review of the literature. , 1995, Social science & medicine.

[6]  Mark W Friedberg,et al.  Factors Affecting Physician Professional Satisfaction and Their Implications for Patient Care, Health Systems, and Health Policy. , 2013, Rand health quarterly.

[7]  Enrico Coiera,et al.  Safety of patient-facing digital symptom checkers , 2018, The Lancet.

[8]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[9]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[10]  Michael I. Jordan,et al.  Artificial Intelligence—The Revolution Hasn’t Happened Yet , 2019, Issue 1.

[11]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[12]  Kenneth D Mandl,et al.  Computerization and the future of primary care: A survey of general practitioners in the UK , 2018, PloS one.

[13]  F. Cabitza,et al.  Unintended Consequences of Machine Learning in Medicine , 2017, JAMA.

[14]  Enrico Coiera,et al.  The digital scribe , 2018, npj Digital Medicine.

[15]  P. Sainsbury,et al.  Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[16]  P. Grattan-Smith,et al.  Perceived practice change in Australian doctors as a result of medicolegal concerns , 2011, The Medical journal of Australia.

[17]  Robert D. Atkinson,et al.  Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again , 2019 .

[18]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[19]  Mary K. Pratt,et al.  Artificial intelligence in primary care , 2018 .

[20]  Margaret McCartney,et al.  Margaret McCartney: Innovation without sufficient evidence is a disservice to all , 2017, British Medical Journal.

[21]  Chirk Jenn Ng,et al.  Can mobile health apps replace GPs? A scoping review of comparisons between mobile apps and GP tasks , 2020, BMC Medical Informatics and Decision Making.

[22]  K. Mandl,et al.  Artificial Intelligence and the Future of Primary Care: Exploratory Qualitative Study of UK General Practitioners’ Views , 2019, Journal of medical Internet research.

[23]  Batya Friedman,et al.  Human agency and responsible computing: Implications for computer system design , 1992, J. Syst. Softw..

[24]  Elisabeth Mahase,et al.  Birmingham trust and Babylon Health discuss pre-A&E triage app , 2019, BMJ.

[25]  Isaac S Kohane,et al.  Artificial Intelligence in Healthcare , 2019, Artificial Intelligence and Machine Learning for Business for Non-Engineers.

[26]  A. Ziv,et al.  Primary Care Physicians’ Use of an Electronic Medical Record System: A Cognitive Task Analysis , 2009, Journal of General Internal Medicine.

[27]  D. Berwick,et al.  The triple aim: care, health, and cost. , 2008, Health affairs.

[28]  Kenneth D. Mandl,et al.  The Evolution of Patient Diagnosis: From Art to Digital Data-Driven Science , 2017, JAMA.

[29]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[30]  A. R.,et al.  Review of literature , 1951, American Potato Journal.

[31]  J. Hollander,et al.  Patient Perceptions of Telehealth Primary Care Video Visits , 2017, The Annals of Family Medicine.

[32]  Centaine L Snoswell,et al.  Telehealth for global emergencies: Implications for coronavirus disease 2019 (COVID-19) , 2020, Journal of telemedicine and telecare.

[33]  Martin Tomitsch,et al.  Design. Think. Make. Break. Repeat.: A Handbook of Methods , 2018 .

[34]  Yunan Chen,et al.  How does medical scribes' work inform development of speech-based clinical documentation technologies? A systematic review , 2020, J. Am. Medical Informatics Assoc..

[35]  Finn Kensing,et al.  Generating visions: future workshops and metaphorical design , 1992 .

[36]  C. Naylor,et al.  On the Prospects for a (Deep) Learning Health Care System , 2018, JAMA.

[37]  Morten Kyng,et al.  Design at Work , 1992 .

[38]  Harshana Liyanage,et al.  Artificial Intelligence in Primary Health Care: Perceptions, Issues, and Challenges , 2019, Yearbook of Medical Informatics.

[39]  Brian G. Arndt,et al.  Tethered to the EHR: Primary Care Physician Workload Assessment Using EHR Event Log Data and Time-Motion Observations , 2017, The Annals of Family Medicine.

[40]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[41]  John Fraser.  Professional autonomy - is it the future of general practice? , 2006, Australian family physician.

[42]  Clifford Mann.  Doctors need to give up professional protectionism , 2018, British Medical Journal.

[43]  Elias Mossialos,et al.  Virtual primary care: fragmentation or integration? , 2019, The Lancet. Digital health.

[44]  Alison M Darcy,et al.  Machine Learning and the Profession of Medicine. , 2016, JAMA.

[45]  Mabel Chew,et al.  The destiny of general practice: blind fate or 20/20 vision? , 2003, The Medical journal of Australia.

[46]  Upkar Varshney,et al.  Mobile health: Four emerging themes of research , 2014, Decis. Support Syst..

[47]  Christine A. Sinsky,et al.  From Triple to Quadruple Aim: Care of the Patient Requires Care of the Provider , 2014, The Annals of Family Medicine.

[48]  Michael Marien,et al.  Book Review: The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies , 2014 .

[49]  A. Lymberis,et al.  Smart wearable systems for personalised health management: current R&D and future challenges , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[50]  Yvan Leanza,et al.  A Systematic Review of Patients’ Experiences in Communicating with Primary Care Physicians: Intercultural Encounters and a Balance between Vulnerability and Integrity , 2015, PloS one.

[51]  R. Shaw,et al.  Mobile health technology for personalized primary care medicine. , 2015, The American journal of medicine.

[52]  Leo Anthony Celi,et al.  The “inconvenient truth” about AI in healthcare , 2019, npj Digital Medicine.

[53]  Johannes Gehrke,et al.  Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission , 2015, KDD.

[54]  Robert M. Anderson,et al.  Patient empowerment: reflections on the challenge of fostering the adoption of a new paradigm. , 2005, Patient education and counseling.

[55]  Enrico Coiera,et al.  The fate of medicine in the time of AI , 2018, The Lancet.