Assessing patient safety in a pediatric telemedicine setting: a multi-methods study

Background Telemedicine and telephone-triage may compromise patient safety, particularly if urgency is underestimated. We aimed to explore the level of safety of a pediatric telemedicine service, with particular reference to the appropriateness of the medical diagnoses made by the online physicians and the reasonableness of their decisions. Methods This retrospective multi-method study investigated the decision-making process of physicians in a pediatric tele-triage service provided in Israel. The first section of the study investigates several measures relating to patient safety in the telemedicine setting. Two physicians reviewed a random sample of 339 parent-physician consultations conducted via a pediatric telemedicine service provided by a healthcare organization during 2014–2017. The consultations were analyzed for factors that may have affected the online physicians’ decisions, with an emphasis on the appropriateness of the diagnoses and the reasonableness of the decisions. The online physicians’ decisions were also compared to the subsequent outcomes (i.e., parental compliance with the recommendations and medical follow-ups within the healthcare system) after each consultation. The second section of the study (using a qualitative approach) consisted of interviews with 15 physicians who work in the pediatric telemedicine service, in order to explore their subjective experiences and efforts for assuring patient safety. The physicians were asked about factors that may have affected their reaching an appropriate diagnosis and a reasonable decision while maintaining patient safety. Results The first section of the study demonstrates high levels of diagnosis appropriateness (98.5%) and decision reasonableness (92%), as well as low levels of false-positive (2.65%) and false-negative (5.3%), good sensitivity (82.85%), and high specificity (96.15%). A high association between the online decisions and the subsequent outcomes was also observed. The second section of the study presents physicians’ means for ensuring high patient safety – by implementing a range of factors that helped them reach appropriate diagnoses and reasonable decisions. Conclusions The results show overall high patient safety in the pediatric tele-triage service that was examined. However, decision makers must strive to implement additional means for further enhancing the clinicians’ ability to reach accurate diagnoses and provide optimal treatments within the tele-triage settings – with the aim of ensuring patient safety.

[1]  C. Charles,et al.  Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango). , 1997, Social science & medicine.

[2]  R. Trevethan,et al.  Sensitivity, Specificity, and Predictive Values: Foundations, Pliabilities, and Pitfalls in Research and Practice , 2017, Front. Public Health.

[3]  R. Grol,et al.  Safety of telephone triage in general practitioner cooperatives: do triage nurses correctly estimate urgency? , 2007, Quality and Safety in Health Care.

[4]  S. Hollinghurst,et al.  Targeted routine asthma care in general practice using telephone triage. , 2005, The British journal of general practice : the journal of the Royal College of General Practitioners.

[5]  Pat Croskerry,et al.  The theory and practice of clinical decision-making , 2005 .

[6]  M. Fry A systematic review of the impact of afterhours care models on emergency departments, ambulance and general practice services , 2011 .

[7]  O. Baron-Epel,et al.  Physicians’ experiences, attitudes and challenges in a Pediatric Telemedicine Service , 2018, Pediatric Research.

[8]  Katherine G. Sandford,et al.  Patient safety in after-hours telephone medicine. , 2007, Family medicine.

[9]  R. Grol,et al.  Nurse telephone triage: good quality associated with appropriate decisions. , 2012, Family practice.

[10]  S. Finkelstein,et al.  Home telehealth improves clinical outcomes at lower cost for home healthcare. , 2006, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[11]  O. Baron-Epel,et al.  The role of non-medical factors in physicians’ decision-making process in a pediatric telemedicine service , 2020, Health Informatics J..

[12]  Jeffrey L. Brown Managing legal risks of pediatric telephone care , 2006 .

[13]  A. O’Cathain,et al.  The appropriateness of, and compliance with, telephone triage decisions: a systematic review and narrative synthesis. , 2012, Journal of advanced nursing.

[14]  J Leprohon,et al.  Decision-making Strategies for Telephone Triage in Emergency Medical Services , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[16]  Pedro Encarnação,et al.  Evaluation of Telephone Triage and Advice Services: a Systematic Review on Methods, Metrics and Results , 2011, MIE.

[17]  A. Allen,et al.  Telemedicine technology and clinical applications. , 1995, JAMA.

[18]  Alison Bowes,et al.  Methodologies for assessing telemedicine: A systematic review of reviews , 2012, Int. J. Medical Informatics.

[19]  R. Williams Triage and emergency department services. , 1996, Annals of emergency medicine.

[20]  Y. Waisman Telemedicine in Pediatric Emergency Care: An Overview and Description of a Novel Service in Israel , 2016 .

[21]  Dale Kraemer,et al.  A systematic review of the efficacy of telemedicine for making diagnostic and management decisions , 2002, Journal of telemedicine and telecare.

[22]  C. V. van Uden,et al.  After-hours care in the United Kingdom, Denmark, and the Netherlands: new models. , 2006, Health affairs.

[23]  Linda Huibers,et al.  Safety of telephone triage in out-of-hours care: A systematic review , 2011, Scandinavian journal of primary health care.

[24]  M. Greenberg,et al.  Safety of Clinical and Non-Clinical Decision Makers in Telephone Triage: A Narrative Review , 2015, Journal of telemedicine and telecare.

[25]  J. Westfall,et al.  Harm resulting from inappropriate telephone triage in primary care. , 2006, Journal of the American Board of Family Medicine : JABFM.

[26]  D. Schriger,et al.  Effect of visual cues, vital signs, and protocols on triage: a prospective randomized crossover trial. , 1998, Annals of emergency medicine.

[27]  John M Westfall,et al.  After-hours telephone triage affects patient safety. , 2003, The Journal of family practice.

[28]  Vimla L Patel,et al.  Calibrating urgency: triage decision-making in a pediatric emergency department , 2008, Advances in health sciences education : theory and practice.

[29]  Andrew Georgiou,et al.  The quality, safety and governance of telephone triage and advice services – an overview of evidence from systematic reviews , 2017, BMC Health Services Research.