Evaluation of email alerts in practice: Part 1. Review of the literature on clinical emailing channels.

RATIONALE Methods to systematically assess electronic knowledge resources by health professionals may enhance evaluation of these resources, knowledge exchange between information users and providers, and continuing professional development. We developed the Information Assessment Method (IAM) to document health professional perspectives on the relevance, cognitive impact, potential use and expected health outcomes of information delivered by (push) or retrieved from (pull) electronic knowledge resources. However, little is known about push communication in health sciences, and what we propose to call clinical emailing channels (CECs). CECs can be understood as a communication infrastructure that channels clinically relevant research knowledge, email alerts, from information providers to the inboxes of individual practitioners. AIMS In two companion papers, our objectives are to (part 1) explore CEC evaluation in routine practice, and (part 2) examine the content validity of the cognitive component of IAM. METHODS The present paper (part 1) critically reviews the literature in health sciences and four disciplines: communication, information studies, education and knowledge translation. Our review addresses the following questions. What are CECs? How are they assessed? RESULTS The review contributes to better define CECs, and proposes a 'push-pull-acquisition-cognition-application' evaluation framework, which is operationalized by IAM. CONCLUSION Compared with existing evaluation tools, our review suggests IAM is comprehensive, generic and systematic.

[1]  Amit X. Garg,et al.  Application of Information Technology: McMaster PLUS: A Cluster Randomized Clinical Trial of an Intervention to Accelerate Clinical Use of Evidence-based Information from Digital Libraries , 2006, J. Am. Medical Informatics Assoc..

[2]  M. Fung,et al.  An Internet‐based learning portfolio in resident education: the KOALA™ multicentre programme , 2000, Medical education.

[3]  S. Straus,et al.  Lost in knowledge translation: Time for a map? , 2006, The Journal of continuing education in the health professions.

[4]  Systematic reviews and original articles differ in relevance, novelty, and use in an evidence-based service for physicians: PLUS project. , 2008, Journal of clinical epidemiology.

[5]  Guilherme Del Fiol,et al.  Research Paper: Effectiveness of Topic-specific Infobuttons: A Randomized Controlled Trial , 2008, J. Am. Medical Informatics Assoc..

[6]  P. Mazmanian,et al.  Use of personal digital assistants (PDAs) in reflection on learning and practice , 2007, The Journal of continuing education in the health professions.

[7]  M. Schwartz,et al.  Electronic delivery of research summaries for academic generalist doctors: a randomised trial of an educational intervention , 2005, Medical education.

[8]  Julie E. Kendall,et al.  Information Delivery Systems: An Exploration of Web Pull and Push Technologies , 1999, Commun. Assoc. Inf. Syst..

[9]  Pierre Pluye,et al.  Case Report: Impact of Research-based Synopses Delivered as Daily E-mail: A Prospective Observational Study , 2008, J. Am. Medical Informatics Assoc..

[10]  Farah Magrabi,et al.  Protocol for the Quick Clinical study: a randomised controlled trial to assess the impact of an online evidence retrieval system on decision-making in general practice , 2006, BMC Medical Informatics Decis. Mak..

[11]  Jessie McGowan,et al.  Just-in-Time Information Improved Decision-Making in Primary Care: A Randomized Controlled Trial , 2008, PloS one.

[12]  Sobral An appraisal of medical students’ reflection‐in‐learning , 2000, Medical education.

[13]  Josh Peterson,et al.  A Web‐based Compendium of Clinical Questions and Medical Evidence to Educate Internal Medicine Residents , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[14]  Bruce K. Berger,et al.  Public relation(ship)s or private controls? Practitioner perspectives on the uses and benefits of new technologies , 2003 .

[15]  David Kember,et al.  Development of a Questionnaire to Measure the Level of Reflective Thinking , 2000 .

[16]  Todd Dorman,et al.  The Reported Validity and Reliability of Methods for Evaluating Continuing Medical Education: A Systematic Review , 2008, Academic medicine : journal of the Association of American Medical Colleges.

[17]  D. Bell,et al.  Instruments for evaluating education in evidence-based practice: a systematic review. , 2006, JAMA.

[18]  Jason S. Wrench,et al.  The Relationship between Computer-Mediated-Communication Competence, Apprehension, Self-Efficacy, Perceived Confidence, and Social Presence , 2007 .

[19]  Robyn Tamblyn,et al.  Assessing the impact of clinical information-retrieval technology in a family practice residency. , 2005, Journal of evaluation in clinical practice.

[20]  Joan C. Bartlett,et al.  Seven reasons why health professionals search clinical information-retrieval technology (CIRT): toward an organizational model. , 2007, Journal of evaluation in clinical practice.

[21]  K. Mann,et al.  Reflection and reflective practice in health professions education: a systematic review , 2009, Advances in health sciences education : theory and practice.

[22]  Chi-Ren Shyu,et al.  Design and evaluation of a personal digital assistant- based alerting service for clinicians. , 2004, Journal of the Medical Library Association : JMLA.

[23]  Lorenzo Cantoni,et al.  PUSH COMMUNICATION SERVICES: A SHORT HISTORY, A CONCRETE EXPERIENCE AND SOME CRITICAL REFLECTIONS , 2001 .

[24]  Continuing medical education should be offered by both e-mail and regular mail: a survey of Ontario anesthesiologists , 2004, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[25]  Paul B. Kantor,et al.  Studying the value of library and information services. Part II. Methodology and taxonomy , 1997 .

[26]  Sandeep Krishnamurthy,et al.  A Comprehensive Analysis of Permission Marketing , 2006, J. Comput. Mediat. Commun..

[27]  P. Pluye,et al.  How information retrieval technology may impact on physician practice: an organizational case study in family medicine. , 2004, Journal of evaluation in clinical practice.

[28]  Andreas Veglis Comparison of Alternative Channels in Cross Media Publishing , 2008 .

[29]  Pierre Pluye,et al.  IAM: A Comprehensive and Systematic Information Assessment Method for Electronic Knowledge Resources , 2009 .

[30]  Marjolein Heijne-Penninga,et al.  Influence of open‐ and closed‐book tests on medical students' learning approaches , 2008, Medical education.

[31]  Janke Cohen-Schotanus,et al.  The development of a scale to measure personal reflection in medical practice and education , 2007, Medical teacher.

[32]  Roland M. Grad,et al.  Impact of clinical information-retrieval technology on physicians: A literature review of quantitative, qualitative and mixed methods studies , 2005, Int. J. Medical Informatics.

[33]  K Skinner,et al.  Developing a Tool to Measure Knowledge Exchange Outcomes , 2007, Canadian Journal of Program Evaluation.

[34]  C. Adair,et al.  Knowledge transfer and exchange: review and synthesis of the literature. , 2007, The Milbank quarterly.

[35]  R. Gold,et al.  A systematic review of evaluation in formal continuing medical education , 2007, The Journal of continuing education in the health professions.