Supporting Informed Decision Making Online in 20 Minutes: An Observational Web-log Study of a PSA Test Decision Aid

Background Web-based decision aids are known to have an effect on knowledge, attitude, and behavior; important components of informed decision making. We know what decision aids achieve in randomized controlled trials (RCTs), but we still know very little about how they are used and how this relates to the informed decision making outcome measures. Objective To examine men's use of an online decision aid for prostate cancer screening using website transaction log files (web-logs), and to examine associations between usage and components of informed decision making. Methods We conducted an observational web-log analysis of users of an online decision aid, Prosdex. Men between 50 and 75 years of age were recruited for an associated RCT from 26 general practices across South Wales, United Kingdom. Men allocated to one arm of the RCT were included in the current study. Time and usage data were derived from website log files. Components of informed decision making were measured by an online questionnaire. Results Available for analysis were 82 web-logs. Overall, there was large variation in the use of Prosdex. The mean total time spent on the site was 20 minutes. The mean number of pages accessed was 32 (SD 21) out of a possible 60 pages. Significant associations were found between increased usage and increased knowledge (Spearman rank correlation [ρ] = 0.69, P < .01), between increased usage and less favorable attitude towards PSA testing (ρ = -0.52, P < .01), and between increased usage and reduced intention to undergo PSA testing (ρ = -0.44, P < .01). A bimodal distribution identified two types of user: low access and high access users. Conclusions Increased usage of Prosdex leads to more informed decision making, the key aim of the UK Prostate Cancer Risk Management Programme. However, developers realistically have roughly 20 minutes to provide useful information that will support informed decision making when the patient uses a web-based interface. Future decision aids need to be developed with this limitation in mind. We recommend that web-log analysis should be an integral part of online decision aid development and analysis. Trial Registration ISRCTN48473735; http://www.controlled-trials.com/ISRCTN48473735 (Archived by WebCite at http://www.webcitation.org/5pqeF89tS)

[1]  R. Newcombe,et al.  A randomised controlled trial of the effects of a web-based PSA decision aid, Prosdex. Protocol , 2007, BMC family practice.

[2]  David Chia,et al.  Mortality results from a randomized prostate-cancer screening trial. , 2009, The New England journal of medicine.

[3]  C. Lawton,et al.  Screening and Prostate-Cancer Mortality in a Randomized European Study , 2010 .

[4]  Neeraj Arora,et al.  Patient preferences for medical decision making: who really wants to participate? , 2000, Medical care.

[5]  Marti A. Hearst,et al.  Improving Web Site Design , 2002, IEEE Internet Comput..

[6]  R. Thomson,et al.  Decision aids for people facing health treatment or screening decisions. , 2003, The Cochrane database of systematic reviews.

[7]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[8]  Aileen Clarke,et al.  Developing a quality criteria framework for patient decision aids: online international Delphi consensus process , 2006, BMJ : British Medical Journal.

[9]  M. Sprangers,et al.  Exploring the black box of a decision aid: what information do patients select from an interactive Cd-Rom on treatment options in breast cancer? , 2007, Patient education and counseling.

[10]  Mark J Sculpher,et al.  Effects of decision aids for menorrhagia on treatment choices, health outcomes, and costs: a randomized controlled trial. , 2002, JAMA.

[11]  Trudy van der Weijden,et al.  Assessing the Quality of Decision Support Technologies Using the International Patient Decision Aid Standards instrument (IPDASi) , 2009, PloS one.

[12]  T. Marteau,et al.  A measure of informed choice , 2001, Health expectations : an international journal of public participation in health care and health policy.

[13]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[14]  Robert J Volk,et al.  Trials of decision aids for prostate cancer screening: a systematic review. , 2007, American journal of preventive medicine.

[15]  Glyn Elwyn,et al.  Informed decision making and prostate specific antigen (PSA) testing for prostate cancer: a randomised controlled trial exploring the impact of a brief patient decision aid on men's knowledge, attitudes and intention to be tested. , 2006, Patient Education and Counseling.

[16]  Glyn Elwyn,et al.  Toward a Model for Field-Testing Patient Decision-Support Technologies: A Qualitative Field-Testing Study , 2007, Journal of medical Internet research.