Uncovering healthcare practitioners' information processing using the think-aloud method: From paper-based guideline to clinical decision support system

OBJECTIVE To investigate whether the use of the think-aloud method with propositional analysis could be helpful in the design of a Clinical Decision Support System (CDSS) providing guideline recommendations about long-term follow-up of childhood cancer survivors. MATERIALS AND METHODS The think-aloud method was used to gain insight into healthcare professionals' information processing while reviewing a paper-based guideline. A total of 13 healthcare professionals (6 physicians and 7 physician assistants) prepared 2 fictitious patient consults using the paper-based guideline. Propositional analysis was used to analyze verbal protocols of the think-aloud sessions. A prototype CDSS was developed and a usability study was performed, again with the think-aloud method. RESULTS The analysis revealed that the paper-based guideline did not support healthcare practitioners in finding patient-specific recommendations. An information processing model for retrieving recommendations was developed and used as input for the design of a CDSS prototype user interface. Usability analysis of the prototype CDSS showed that the navigational structure of the system fitted well with healthcare practitioners' daily practices. CONCLUSIONS The think-aloud method combined with propositional analysis of healthcare practitioners' verbal utterances while they processed a paper-based guideline was useful in the design of a usable CDSS providing patient-specific guideline recommendations.

[1]  Caring for survivors of childhood cancers: the size of the problem. , 2006 .

[2]  Erik Hollnagel,et al.  Human factors/ergonomics as a systems discipline? "The human use of human beings" revisited. , 2014, Applied ergonomics.

[3]  Douglas S. Bell,et al.  Interface design principles for usable decision support: A targeted review of best practices for clinical prescribing interventions , 2012, J. Biomed. Informatics.

[4]  Monique W. M. Jaspers,et al.  The think aloud method: a guide to user interface design , 2004, Int. J. Medical Informatics.

[5]  Natalia Juristo Juzgado,et al.  Effectiveness of Requirements Elicitation Techniques: Empirical Results Derived from a Systematic Review , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[6]  Beatriz Sousa Santos,et al.  User-centered requirements engineering in health information systems: A study in the hemophilia field , 2012, Comput. Methods Programs Biomed..

[7]  Monique W M Jaspers,et al.  Medical assessment of adverse health outcomes in long-term survivors of childhood cancer. , 2007, JAMA.

[8]  L. Faulkner.  Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[9]  James P. Turley,et al.  The significance of cognitive modeling in building healthcare interfaces , 2006, Int. J. Medical Informatics.

[10]  E. James,et al.  The Effects of Clinical Pathways on Professional Practice, Patient Outcomes, Length of Stay, and Hospital Costs , 2012, Evaluation & the health professions.

[11]  Thomas Agoritsas,et al.  Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. , 2013, Chest.

[12]  Beth Crandall,et al.  Critical care physician cognitive task analysis: an exploratory study , 2009, Critical care.

[13]  S. Kaasa,et al.  Computer-Based Clinical Decision Support Systems and Patient-Reported Outcomes: A Systematic Review , 2015, The Patient - Patient-Centered Outcomes Research.

[14]  J. Grimshaw,et al.  From best evidence to best practice: effective implementation of change in patients' care , 2003, The Lancet.

[15]  Craig E. Kuziemsky,et al.  A review on systematic reviews of health information system studies , 2010, J. Am. Medical Informatics Assoc..

[16]  Robert A. Greenes,et al.  Methods of Cognitive Analysis to Support the Design and Evaluation of Biomedical Systems: The Case of Clinical Practice Guidelines , 2001, J. Biomed. Informatics.

[17]  Monique W. M. Jaspers,et al.  Development of a national protocol to screen Dutch cancer survivors on late cancer treatment effects , 2007, Int. J. Medical Informatics.

[18]  Julia E. W. C. van Gemert-Pijnen,et al.  From expert-driven to user-oriented communication of infection control guidelines , 2009, Int. J. Hum. Comput. Stud..

[19]  L. Hayden,et al.  Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2011 .

[20]  R. Wears,et al.  Computer technology and clinical work: still waiting for Godot. , 2005, JAMA.

[21]  Louise Lemieux-Charles,et al.  How can we improve guideline use? A conceptual framework of implementability , 2011, Implementation science : IS.

[22]  V. Hasselblad,et al.  Effect of Clinical Decision-Support Systems , 2012, Annals of Internal Medicine.

[23]  Vimla L. Patel,et al.  Identifying reasoning strategies in medical decision making: A methodological guide , 2005, J. Biomed. Informatics.

[24]  Vimla L. Patel,et al.  Cognitive evaluation of decision making processes and assessment of information technology in medicine , 1998, Int. J. Medical Informatics.

[25]  R Khajouei,et al.  The Impact of CPOE Medication Systems’ Design Aspects on Usability, Workflow and Medication Orders , 2010, Methods of Information in Medicine.

[26]  J. Stockman,et al.  Chronic Health Conditions in Adult Survivors of Childhood Cancer , 2008 .

[27]  L. Currie,et al.  Clinical cognition and biomedical informatics: Issues of patient safety. , 2006, Studies in health technology and informatics.

[28]  Peter Elkin,et al.  The Human Factors Engineering Approach to Biomedical Informatics Projects: State of the Art, Results, Benefits and Challenges , 2007, Yearbook of Medical Informatics.

[29]  Monique W. M. Jaspers,et al.  Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings , 2011, J. Am. Medical Informatics Assoc..

[30]  Monique W. M. Jaspers,et al.  From an expert-driven paper guideline to a user-centred decision support system: A usability comparison study , 2013, Artif. Intell. Medicine.

[31]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..