Presentation of laboratory test results in patient portals: influence of interface design on risk interpretation and visual search behaviour

BackgroundPatient portals are considered valuable instruments for self-management of long term conditions, however, there are concerns over how patients might interpret and act on the clinical information they access. We hypothesized that visual cues improve patients’ abilities to correctly interpret laboratory test results presented through patient portals. We also assessed, by applying eye-tracking methods, the relationship between risk interpretation and visual search behaviour.MethodsWe conducted a controlled study with 20 kidney transplant patients. Participants viewed three different graphical presentations in each of low, medium, and high risk clinical scenarios composed of results for 28 laboratory tests. After viewing each clinical scenario, patients were asked how they would have acted in real life if the results were their own, as a proxy of their risk interpretation. They could choose between: 1) Calling their doctor immediately (high interpreted risk); 2) Trying to arrange an appointment within the next 4 weeks (medium interpreted risk); 3) Waiting for the next appointment in 3 months (low interpreted risk). For each presentation, we assessed accuracy of patients’ risk interpretation, and employed eye tracking to assess and compare visual search behaviour.ResultsMisinterpretation of risk was common, with 65% of participants underestimating the need for action across all presentations at least once. Participants found it particularly difficult to interpret medium risk clinical scenarios. Participants who consistently understood when action was needed showed a higher visual search efficiency, suggesting a better strategy to cope with information overload that helped them to focus on the laboratory tests most relevant to their condition.ConclusionsThis study confirms patients’ difficulties in interpreting laboratories test results, with many patients underestimating the need for action, even when abnormal values were highlighted or grouped together. Our findings raise patient safety concerns and may limit the potential of patient portals to actively involve patients in their own healthcare.

[1]  P. Ubel,et al.  Helping patients decide: ten steps to better risk communication. , 2011, Journal of the National Cancer Institute.

[2]  Michelle L. Rogers,et al.  Research Paper: Usability Testing Finds Problems for Novice Users of Pediatric Portals , 2009, J. Am. Medical Informatics Assoc..

[3]  Angela Fagerlin,et al.  What's Time Got to Do with It? Inattention to Duration in Interpretation of Survival Graphs , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[4]  Gary Marchionini,et al.  Previews and overviews in digital libraries: Designing surrogates to support visual information seeking , 2000, J. Am. Soc. Inf. Sci..

[5]  W S A Smellie When is “abnormal” abnormal? Dealing with the slightly out of range laboratory result , 2006, Journal of Clinical Pathology.

[6]  S. Brunelli,et al.  Association between Serum Potassium and Outcomes in Patients with Reduced Kidney Function. , 2016, Clinical journal of the American Society of Nephrology : CJASN.

[7]  Stephanie Wilson,et al.  Identifying web usability problems from eye-tracking data , 2007, BCS HCI.

[8]  Eta S Berner,et al.  The wave has finally broken: now what? , 2013, Journal of the American Medical Informatics Association : JAMIA.

[9]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[10]  N. Elder,et al.  "But what does it mean for me?" Primary care patients' communication preferences for test results notification. , 2012, Joint Commission journal on quality and patient safety.

[11]  Guo-Zheng Li,et al.  Cough event classification by pretrained deep neural network , 2015, BMC Medical Informatics and Decision Making.

[12]  Christopher Pearce,et al.  A personally controlled electronic health record for Australia , 2014, J. Am. Medical Informatics Assoc..

[13]  Joseph Sharit,et al.  Usability of an Electronic Personal Health Record (PHR) Among a Diverse Group of Adults , 2014 .

[14]  Joris van de Klundert,et al.  What do we know about developing patient portals? a systematic literature review , 2016, J. Am. Medical Informatics Assoc..

[15]  Noa Segall,et al.  Usability evaluation of a personal health record. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[16]  S. Staniszewska,et al.  Patient and public involvement in health services and health research: A brief overview of evidence, policy and activity , 2009 .

[17]  Terry Young,et al.  Accessing personal medical records online: A means to what ends? , 2015, Int. J. Medical Informatics.

[18]  Susan T. Dumais,et al.  Optimizing search by showing results in context , 2001, CHI.

[19]  Elizabeth A Bayliss,et al.  Barriers to Self-Management and Quality-of-Life Outcomes in Seniors With Multimorbidities , 2007, The Annals of Family Medicine.

[20]  Clemens Scott Kruse,et al.  Patient and Provider Attitudes Toward the Use of Patient Portals for the Management of Chronic Disease: A Systematic Review , 2015, Journal of medical Internet research.

[21]  Siamak Noorbaloochi,et al.  Validation of Screening Questions for Limited Health Literacy in a Large VA Outpatient Population , 2008, Journal of General Internal Medicine.

[22]  Neil Powe,et al.  Taming the chronic kidney disease epidemic: a global view of surveillance efforts. , 2014, Kidney international.

[23]  Nicole L. Exe,et al.  Numeracy and Literacy Independently Predict Patients’ Ability to Identify Out-of-Range Test Results , 2014, Journal of medical Internet research.

[24]  Jens H. Weber,et al.  Conditions potentially sensitive to a Personal Health Record (PHR) intervention, a systematic review , 2015, BMC Medical Informatics and Decision Making.

[25]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[26]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[27]  Claudia Pagliari,et al.  Embedding online patient record access in UK primary care: a survey of stakeholder experiences , 2012, JRSM short reports.

[28]  Harold Bursztajn,et al.  Direct-to-patient laboratory test reporting: balancing access with effective clinical communication. , 2014, JAMA.

[29]  Vimla L. Patel,et al.  The patient clinical information system (PatCIS): technical solutions for and experience with giving patients access to their electronic medical records , 2002, Int. J. Medical Informatics.

[30]  Noel T Brewer,et al.  Tables or Bar Graphs? Presenting Test Results in Electronic Medical Records , 2012, Medical decision making : an international journal of the Society for Medical Decision Making.

[31]  Julia Adler-Milstein,et al.  A comparison of how four countries use health IT to support care for people with chronic conditions. , 2014, Health affairs.

[32]  Keith Simpson,et al.  Patient access to complex chronic disease records on the Internet , 2012, BMC Medical Informatics and Decision Making.

[33]  Jimeng Sun,et al.  Visual cluster analysis in support of clinical decision intelligence. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[34]  Ryan J. Shaw,et al.  A Usability Problem: Conveying Health Risks to Consumers on the Internet , 2012, AMIA.

[35]  François Andry,et al.  Data Visualization in a Personal Health Record using Rich Internet Application Graphic Components , 2009, HEALTHINF.

[36]  Meredith Ringel Morris,et al.  What do you see when you're surfing?: using eye tracking to predict salient regions of web pages , 2009, CHI.

[37]  Brian J Zikmund-Fisher,et al.  Can patients use test results effectively if they have direct access? , 2015, BMJ : British Medical Journal.

[38]  V. Reyna,et al.  How numeracy influences risk comprehension and medical decision making. , 2009, Psychological bulletin.

[39]  Howard Pai,et al.  Is Canada ready for patient accessible electronic health records? A national scan , 2008, BMC Medical Informatics Decis. Mak..

[40]  Jacob Solomon,et al.  Graphics help patients distinguish between urgent and non-urgent deviations in laboratory test results , 2016, J. Am. Medical Informatics Assoc..

[41]  Yuval Shahar,et al.  A Framework for Intelligent Visualization of Multiple Time-Oriented Medical Records , 2005, AMIA.

[42]  Keith Rayner,et al.  Cognitive and cultural influences on eye movements , 2008 .

[43]  K. Simpson,et al.  Patients’ Continuing Use of an Online Health Record: A Quantitative Evaluation of 14,000 Patient Years of Access Data , 2014, Journal of medical Internet research.

[44]  J. Nielsen F-shaped pattern for reading Web content, Jakob Nielsen's Alertbox , 2006 .

[45]  Brian Fisher,et al.  Patients' access to their electronic record: offer patients access as soon as you can. , 2013, The British journal of general practice : the journal of the Royal College of General Practitioners.

[46]  Ben Shneiderman,et al.  Visual information seeking in multiple electronic health records: design recommendations and a process model , 2010, IHI.

[47]  Sophie Hill,et al.  Absolute risk representation in cardiovascular disease prevention: comprehension and preferences of health care consumers and general practitioners involved in a focus group study , 2010, BMC public health.

[48]  A. Edwards,et al.  Communicating risk , 2012, BMJ : British Medical Journal.

[49]  Ben Shneiderman,et al.  Users can change their web search tactics: Design guidelines for categorized overviews , 2008, Inf. Process. Manag..

[50]  Gareth Iacobucci Patients promised online access to their medical records by 2018 , 2015, BMJ : British Medical Journal.

[51]  Alexander J. Rothman,et al.  Treating people with information: an analysis and review of approaches to communicating health risk information. , 1999, Journal of the National Cancer Institute. Monographs.

[52]  P. Ubel,et al.  Measuring Numeracy without a Math Test: Development of the Subjective Numeracy Scale , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[53]  Brian Fisher,et al.  How patients use access to their electronic GP record--a quantitative study. , 2011, Family practice.