Education in Health Research Methodology: Use of a Wiki for Knowledge Translation

Introduction A research-practice gap exists between what is known about conducting methodologically rigorous randomized controlled trials (RCTs) and what is done. Evidence consistently shows that pediatric RCTs are susceptible to high risk of bias; therefore novel methods of influencing the design and conduct of trials are required. The objective of this study was to develop and pilot test a wiki designed to educate pediatric trialists and trainees in the principles involved in minimizing risk of bias in RCTs. The focus was on preliminary usability testing of the wiki. Methods The wiki was developed through adaptation of existing knowledge translation strategies and through tailoring the site to the identified needs of the end-users. The wiki was evaluated for usability and user preferences regarding the content and formatting. Semi-structured interviews were conducted with 15 trialists and systematic reviewers, representing varying levels of experience with risk of bias or the conduct of trials. Data were analyzed using content analysis. Results Participants found the wiki to be well organized, easy to use, and straightforward to navigate. Suggestions for improvement tended to focus on clarification of the text or on esthetics, rather than on the content or format. Participants liked the additional features of the site that were supplementary to the text, such as the interactive examples, and the components that focused on practical applications, adding relevance to the theory presented. While the site could be used by both trialists and systematic reviewers, the lack of a clearly defined target audience caused some confusion among participants. Conclusions Participants were supportive of using a wiki as a novel educational tool. The results of this pilot test will be used to refine the risk of bias wiki, which holds promise as a knowledge translation intervention for education in medical research methodology.

[1]  L. Hartling,et al.  Social Media Use by Health Care Professionals and Trainees: A Scoping Review , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[2]  D. Rennie,et al.  SPIRIT 2013 statement: defining standard protocol items for clinical trials. , 2013, Annals of internal medicine.

[3]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[4]  D. Moher,et al.  Do health care institutions value research? A mixed methods study of barriers and facilitators to methodological rigor in pediatric randomized trials , 2012, BMC Medical Research Methodology.

[5]  J. Grimshaw,et al.  Printed educational materials: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[6]  L. Hartling,et al.  StaR Child Health: Developing Evidence-Based Guidance for the Design, Conduct, and Reporting of Pediatric Trials , 2012, Pediatrics.

[7]  D. Moher,et al.  Standard 2: Containing Risk of Bias , 2012, Pediatrics.

[8]  France Légaré,et al.  Wikis and Collaborative Writing Applications in Health Care: A Scoping Review , 2013, Journal of medical Internet research.

[9]  J. Grimshaw,et al.  Tailored implementation for chronic diseases (TICD): A project protocol , 2011, Implementation science : IS.

[10]  A. Giaccone,et al.  Quality of Reporting of Neonatal and Infant Trials in High-Impact Journals , 2011, Pediatrics.

[11]  Elena Parmelli,et al.  Local opinion leaders: effects on professional practice and health care outcomes. , 2011, The Cochrane database of systematic reviews.

[12]  C. Tishler,et al.  Pediatric Drug-Trial Recruitment: Enticement Without Coercion , 2011, Pediatrics.

[13]  A. Pratkanis,et al.  The Science of Social Influence : Advances and Future Progress , 2011 .

[14]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[15]  W. Shrank,et al.  Online Social Networking by Patients with Diabetes: A Qualitative Evaluation of Communication with Facebook , 2011, Journal of General Internal Medicine.

[16]  B. Vandermeer,et al.  A descriptive analysis of a representative sample of pediatric randomized controlled trials published in 2007 , 2010, BMC pediatrics.

[17]  B. Vandermeer,et al.  Controlled Trials in Children: Quantity, Methodological Quality and Descriptive Characteristics of Pediatric Controlled Trials Published 1948-2006 , 2010, PloS one.

[18]  R. Scherer,et al.  Assessment of Risk of Bias Among Pediatric Randomized Controlled Trials , 2010, Pediatrics.

[19]  P. McGrath,et al.  Assessing the quality of randomized controlled trials examining psychological interventions for pediatric procedural pain: recommendations for quality improvement. , 2010, Journal of pediatric psychology.

[20]  Michele Tarsilla Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[21]  I. Choonara,et al.  A systematic review of paediatric randomised controlled drug trials published in 2007 , 2010, Archives of Disease in Childhood.

[22]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials , 2010, BMC medicine.

[23]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomized trials , 2010, Obstetrics and gynecology.

[24]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[25]  D. Moher,et al.  CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials , 2010, Journal of pharmacology & pharmacotherapeutics.

[26]  Lisa Hartling,et al.  Risk of bias versus quality assessment of randomised controlled trials: cross sectional study , 2009, BMJ : British Medical Journal.

[27]  Fredric Wolf,et al.  Continuing education meetings and workshops: effects on professional practice and health care outcomes. , 2009, The Cochrane database of systematic reviews.

[28]  C. Hawn Take two aspirin and tweet me in the morning: how Twitter, Facebook, and other social media are reshaping health care. , 2009, Health affairs.

[29]  D. Cook,et al.  Internet-based learning in the health professions: a meta-analysis. , 2008, JAMA.

[30]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[31]  Sylvain Rheims,et al.  Greater Response to Placebo in Children Than in Adults: A Systematic Review and Meta-Analysis in Drug-Resistant Partial Epilepsy , 2008, PLoS medicine.

[32]  E. Cohen,et al.  Beyond the therapeutic orphan: children and clinical trials , 2008 .

[33]  Sergio Sismondo,et al.  Pharmaceutical company funding and its consequences: a qualitative systematic review. , 2008, Contemporary clinical trials.

[34]  J. Grimshaw,et al.  Printed educational materials: effects on professional practice and health care outcomes. , 2008, The Cochrane database of systematic reviews.

[35]  G. Guyatt,et al.  Systematic reviewers neglect bias that results from trials stopped early for benefit. , 2007, Journal of clinical epidemiology.

[36]  J. Hilden,et al.  Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. , 2007, International journal of epidemiology.

[37]  P. Kannus,et al.  Hip protectors for preventing hip fracture. , 2007, JAMA.

[38]  K. Mulpuri,et al.  A Quality Assessment of Randomized Clinical Trials in Pediatric Orthopaedics , 2007, Journal of pediatric orthopedics.

[39]  Robert B. Cialdini,et al.  Using social norms as a lever of social influence. , 2007 .

[40]  Steve Wheeler,et al.  Wikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and education , 2006, BMC medical education.

[41]  B. Welk,et al.  Randomized controlled trials in pediatric urology: room for improvement. , 2006, The Journal of urology.

[42]  Gordon H Guyatt,et al.  Randomized trials stopped early for benefit: a systematic review. , 2005, JAMA.

[43]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[44]  Michael Fordis,et al.  Neurobehavioral Performance of Residents After Heavy Night Call Versus After Alcohol Ingestion , 2005, Journal of the American Medical Association (JAMA).

[45]  S. Flottorp,et al.  Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. , 2005, The Cochrane database of systematic reviews.

[46]  K. Anand,et al.  Neonatal Research and the Validity of Informed Consent Obtained in the Perinatal Period , 2004, Journal of Perinatology.

[47]  B. Djulbegovic,et al.  Pharmaceutical industry sponsorship and research outcome and quality: systematic review , 2003, BMJ : British Medical Journal.

[48]  C. Gross,et al.  Scope and impact of financial conflicts of interest in biomedical research: a systematic review. , 2003, JAMA.

[49]  Everett M. Rogers,et al.  Diffusion of innovations (5. ed.) , 2003 .

[50]  P. Butow,et al.  Pediatricians' attitudes toward randomized controlled trials involving children. , 2002, The Journal of pediatrics.

[51]  E. Skarsgard,et al.  The role of prospective randomized clinical trials in pediatric surgery: state of the art? , 2001, Journal of pediatric surgery.

[52]  Jeremy M. Grimshaw,et al.  Changing Provider Behavior: An Overview of Systematic Reviews of Interventions , 2001, Medical care.

[53]  Jennifer Preece,et al.  Lurker demographics: counting the silent , 2000, CHI.

[54]  N Freemantle,et al.  Printed educational materials: effects on professional practice and health care outcomes. , 2000, The Cochrane database of systematic reviews.

[55]  John W. Creswell,et al.  Qualitative Inquiry and Research Design: Choosing Among Five Approaches , 1966 .

[56]  J. Creswell Qualitative inquiry and research design: Choosing among five approaches, 2nd ed. , 2007 .

[57]  E. Rogers,et al.  Diffusion of Innovations , 1964 .