User Interface Requirements for Web-Based Integrated Care Pathways: Evidence from the Evaluation of an Online Care Pathway Investigation Tool

Integrated care pathways (ICPs) define a chronological sequence of steps, most commonly diagnostic or treatment, to be followed in providing care for patients. Care pathways help to ensure quality standards are met and to reduce variation in practice. Although research on the computerisation of ICP progresses, there is still little knowledge on what are the requirements for designing user-friendly and usable electronic care pathways, or how users (normally health care professionals) interact with interfaces that support design, analysis and visualisation of ICPs. The purpose of the study reported in this paper was to address this gap by evaluating the usability of a novel web-based tool called COCPIT (Collaborative Online Care Pathway Investigation Tool). COCPIT supports the design, analysis and visualisation of ICPs at the population level. In order to address the aim of this study, an evaluation methodology was designed based on heuristic evaluations and a mixed method usability test. The results showed that modular visualisation and direct manipulation of information related to the design and analysis of ICPs is useful for engaging and stimulating users. However, designers should pay attention to issues related to the visibility of the system status and the match between the system and the real world, especially in relation to the display of statistical information about care pathways and the editing of clinical information within a care pathway. The paper concludes with recommendations for interface design.

[1]  Knut Bernstein,et al.  Managing Care Pathways combining SNOMED CT, Archetypes and an Electronic Guideline System , 2008, MIE.

[2]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[3]  Zhen Hu,et al.  Ontology-Based Clinical Pathways with Semantic Rules , 2011, Journal of Medical Systems.

[4]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction (4th Edition) , 2004 .

[5]  L. Moja,et al.  Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. , 2014, American journal of public health.

[6]  G. Rossi,et al.  An Object Oriented Approach to Web-Based Application Design , 1998 .

[7]  Michel Dumontier,et al.  Pharmacogenomic knowledge representation, reasoning and genome-based clinical decision support based on OWL 2 DL ontologies , 2015, BMC Medical Informatics and Decision Making.

[8]  Douglas S. Bell,et al.  Interface design principles for usable decision support: A targeted review of best practices for clinical prescribing interventions , 2012, J. Biomed. Informatics.

[9]  Louise Hayward-Rowse,et al.  A pilot project to design, implement and evaluate an electronic integrated care pathway. , 2006, Journal of nursing management.

[10]  J. V. van Berkum,et al.  How robust is the language architecture? The case of mood , 2013, Front. Psychol..

[11]  Ayse P. Gurses,et al.  Care pathways and patient safety: key concepts, patient outcomes and related interventions , 2010 .

[12]  Jakob Nielsen,et al.  Chapter 6 – Usability Testing , 1993 .

[13]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[14]  Syed Sibte Raza Abidi,et al.  Semantic Web-Based Modeling of Clinical Pathways Using the UML Activity Diagrams and OWLS , 2010 .

[15]  Elske Ammenwerth,et al.  Seeking Evidence to Support Usability Principles for Medication-Related Clinical Decision Support (CDS) Functions , 2013, MedInfo.

[16]  R. Hotchkiss.  Integrated care pathways , 1997, BMJ.

[17]  Karen Marie Lyng.  From clinical practice guidelines, to clinical guidance in practice - Impacts for computerization , 2013, Int. J. Medical Informatics.

[18]  Alicia O. Scott-Wright,et al.  A Methodology for Modular Representation of Guidelines , 2004, MedInfo.

[19]  Robert L. Goldstone,et al.  Flexibility in data interpretation: effects of representational format , 2013, Front. Psychol..

[20]  J. Sandars,et al.  Knowledge transfer for the management of dementia: a cluster-randomised trial of blended learning in general practice , 2010, Implementation science : IS.

[21]  Tom Bowen,et al.  International consensus and practical guidelines on the gynecologic and obstetric management of female patients with hereditary angioedema caused by C1 inhibitor deficiency. , 2012, The Journal of allergy and clinical immunology.

[22]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[23]  Dennis F. Galletta,et al.  Cognitive Fit: An Empirical Study of Information Acquisition , 1991, Inf. Syst. Res..

[24]  Dave Dongelmans,et al.  A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care , 2012, Int. J. Medical Informatics.

[25]  G. Whiteneck,et al.  Understanding outcomes based on the post-acute hospitalization pathways followed by persons with traumatic brain injury , 2003, Brain injury.

[26]  Karen Marie Lyng,et al.  Participatory design for computerization of clinical practice guidelines , 2011, J. Biomed. Informatics.

[27]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[28]  Iain Buchan,et al.  COCPIT: a tool for integrated care pathway variance analysis. , 2012, Studies in health technology and informatics.

[29]  Barbara Tversky,et al.  Visualizing space, time, and agents: production, performance, and preference , 2011, Cognitive Processing.

[30]  Karen Tu,et al.  Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care , 2010, Implementation science : IS.

[31]  Kris Vanhaecht,et al.  Have We Drawn the Wrong Conclusions About the Value of Care Pathways? Is a Cochrane Review Appropriate? , 2012, Evaluation & the health professions.

[32]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[33]  J Dempster,et al.  In pursuit of excellence: an integrated care pathway for C1 inhibitor deficiency , 2013, Clinical and experimental immunology.

[34]  Dieter Schmalstieg,et al.  StratomeX: Visual Analysis of Large‐Scale Heterogeneous Genomics Data for Cancer Subtype Characterization , 2012, Comput. Graph. Forum.

[35]  André Kushniruk,et al.  How Usability of a Web-Based Clinical Decision Support System Has the Potential to Contribute to Adverse Medical Events , 2008, AMIA.

[36]  Henning Müller,et al.  Overview of the First Workshop on Medical Content-Based Retrieval for Clinical Decision Support at MICCAI 2009 , 2009, MCBR-CDS.

[37]  Tony Solomonides,et al.  Care Pathway Records with Ontologies: Potential uses in Medical Research and Health Care , 2011 .

[38]  Elizabeth M. Borycki,et al.  Theories, Models and Frameworks for Diagnosing Technology-Induced Error , 2010, MedInfo.

[39]  Jakob Nielsen,et al.  Severity Ratings for Usability Problems , 2006 .

[40]  P Bundred,et al.  Integrated care pathways: effective tools for continuous evaluation of clinical practice. , 1996, Journal of evaluation in clinical practice.

[41]  Monica M. C. Schraefel.  Designing for the User , 2001, RE.

[42]  Yaron Denekamp,et al.  Mapping computerized clinical guidelines to electronic medical records: Knowledge-data ontological mapper (KDOM) , 2008, J. Biomed. Informatics.

[43]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[44]  David Buenestado,et al.  Evaluating Acceptance and User Experience of a Guideline-based Clinical Decision Support System Execution Platform , 2013, Journal of Medical Systems.

[45]  Stefan Schulz,et al.  SNOMED CT – advances in concept mapping, retrieval, and ontological foundations. Selected contributions to the Semantic Mining Conference on SNOMED CT (SMCS 2006) , 2008, BMC Medical Informatics Decis. Mak..

[46]  Manuela De Allegri,et al.  Which factors are important for the successful development and implementation of clinical pathways? A qualitative study , 2011, Quality and Safety in Health Care.

[47]  Blackford Middleton,et al.  Complementary methods of system usability evaluation: Surveys and observations during software design and development cycles , 2010, J. Biomed. Informatics.

[48]  Huilong Duan,et al.  Using Recommendation to Support Adaptive Clinical Pathways , 2012, Journal of Medical Systems.

[49]  André Kushniruk,et al.  Analysis of Complex Decision-Making Processes in Health Care: Cognitive Approaches to Health Informatics , 2001, J. Biomed. Informatics.

[50]  Abdul V. Roudsari,et al.  Use of Ontologies for Monitoring Electronic Health Records for Compliance with Clinical Practice Guidelines , 2011, ITCH.

[51]  Tim Dornan,et al.  Involving users in the design and usability evaluation of a clinical decision support system , 2002, Comput. Methods Programs Biomed..

[52]  Syed Sibte Raza Abidi,et al.  Semantic Web-Based Modeling of Clinical Pathways Using the UML Activity Diagrams and OWL-S , 2009, KR4HC.

[53]  Masaharu Nakayama,et al.  An Approach to Medical Knowledge Sharing in a Hospital Information System Using MCLink , 2013, Journal of Medical Systems.

[54]  Iain E. Buchan,et al.  Missed Opportunities Mapping: Computable Healthcare Quality Improvement , 2013, MedInfo.

[55]  Stefan Schulz,et al.  Formal representation of complex SNOMED CT expressions , 2008, BMC Medical Informatics Decis. Mak..

[56]  Gustavo Rossi,et al.  An Object Oriented Approach to Web-Based Applications Design , 1998, Theory Pract. Object Syst..