Multi-Criteria Evaluation of Mobile Triage Decision Systems

Mobile Clinical Decision Support Systems (CDSS) aim to assist medical practitioners with decision making and provide an easy access to information on the move using mobile devices such as a mobile phone. Despite many benefits of mobile CDSS, these systems need to undergo a comprehensive evaluation to determine the correctness of the actions that decision maker take and validate the system's knowledge and recommendation. In this paper, we discuss the impact of mobile CDSS on decision making process and outcomes, and describe the multi-criteria evaluation of a mobile field triage decision support system in terms of effectiveness, efficiency, satisfaction and use. In this research, data was collected from a group of qualified paramedics using both quantitative and qualitative methods. The results and findings shed new light on the role of mobile decision support systems in improving healthcare delivery and provided better understanding of the barriers to the adoption of these systems and the impact of different stakeholders’ views in evaluating the success of the DSS.

[1]  K. Kennedy,et al.  Triage: techniques and applications in decision making. , 1996, Annals of emergency medicine.

[2]  Gaetano Borriello,et al.  Design of a phone-based clinical decision support system for resource-limited settings , 2012, ICTD.

[3]  R. Aacharya,et al.  Emergency department triage: an ethical analysis , 2011, BMC emergency medicine.

[4]  Frada Burstein,et al.  A Multi-faceted Decision Support System Evaluation Approach , 2001 .

[5]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[6]  R Slowinski,et al.  Design and Development of a Mobile System for Supporting Emergency Triage , 2005, Methods of Information in Medicine.

[7]  J. Osheroff,et al.  Clinical Decision Support Systems : State of the Art , 2009 .

[8]  Jatinder N. D. Gupta,et al.  An integrative evaluation framework for intelligent decision support systems , 2009, Eur. J. Oper. Res..

[9]  Wayne P. Smith.  Triage in mass casualty situations , 2012 .

[10]  D. Spiegelhalter,et al.  Field trials of medical decision-aids: potential problems and solutions. , 1991, Proceedings. Symposium on Computer Applications in Medical Care.

[11]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[12]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[13]  Wojtek Michalowski,et al.  Prospective evaluation of the MET-AP system providing triage plans for acute pediatric abdominal pain , 2008, Int. J. Medical Informatics.

[14]  Ralph B. D'Agostino,et al.  Wiley encyclopedia of clinical trials , 2008 .

[15]  Prem Prakash Jayaraman,et al.  An Ontology-Based Framework for Real-Time Collection and Visualization of Mobile Field Triage Data in Mass Gatherings , 2013, 2013 46th Hawaii International Conference on System Sciences.

[16]  Andrew Georgiou,et al.  Review Paper: The Impact of Mobile Handheld Technology on Hospital Physicians' Work Practices and Patient Care: A Systematic Review , 2009, J. Am. Medical Informatics Assoc..

[17]  Leonid Churilov,et al.  A Mobile Emergency Triage Decision Support System Evaluation , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[18]  R. F. Woolson.  Wilcoxon Signed-Rank Test , 2008 .

[19]  J. Bazarian,et al.  Use and Analysis of Field Triage Criteria for Mass Gatherings , 2003, Prehospital and Disaster Medicine.

[20]  Arkady B. Zaslavsky,et al.  On Development and Evaluation of Prototype Mobile Decision Support for Hospital Triage , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.