Striving for evidence in e-health evaluation: Lessons from health technology assessment

Evaluation is crucial to the integration of e-health applications into the health-care system and their ultimate sustainability. However, e-health evaluation is often criticized for the poor quality of research design, the lack of common outcome indicators and the absence of an agreed theory. Health technology assessment (HTA) could offer a sound methodological basis for e-health evaluation. However, there have been major concerns about the applicability of the HTA approach to the evaluation of e-health initiatives. Evaluators - and decision makers - must accept that telehealth evaluation may serve different purposes for different stakeholders, and therefore concede that no single evaluation framework or methodology, even the randomized controlled trial, is totally objective. To address the complex environment of telehealth evaluation, a participatory strategy is useful, whereby stakeholders are involved in the study design and definition of evaluation questions at each phase. This will also build confidence between the evaluation team and the stakeholders, facilitating informed decision making through an integrated knowledge mobilization activity.

[1]  D. Hailey,et al.  Study quality and evidence of benefit in recent assessments of telemedicine , 2004, Journal of telemedicine and telecare.

[2]  Penny Jennett,et al.  The need for economic evaluation of telemedicine to evolve: the experience in Alberta, Canada. , 2004, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[3]  R. Scott,et al.  Policy implications associated with the socioeconomic and health system impact of telehealth: a case study from Canada. , 2004, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[4]  T. Cradduck,et al.  The national initiative for telehealth guidelines. , 2004, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[5]  R. Scott,et al.  The socio-economic impact of telehealth: A systematic review , 2003, Journal of telemedicine and telecare.

[6]  Mark Leys,et al.  Health care policy: qualitative evidence and health technology assessment. , 2003, Health policy.

[7]  Elske Ammenwerth,et al.  Evaluation of health information systems - problems and challenges , 2003, Int. J. Medical Informatics.

[8]  Carl May,et al.  Health technology assessment in its local contexts: studies of telehealthcare. , 2003, Social science & medicine.

[9]  B. Rush,et al.  National Telehealth Outcome Indicators Project [NTOIP] - Project Information Document and a Synthesis of Telehealth Outcomes Literature , 2003 .

[10]  Carl May,et al.  Normative models of health technology assessment and the social production of evidence about telehealth care. , 2003, Health policy.

[11]  Arto Ohinmaa,et al.  RECENT STUDIES ON ASSESSMENT OF TELEMEDICINE: SYSTEMATIC REVIEW OF STUDY QUALITY AND EVIDENCE OF BENEFIT , 2003 .

[12]  V. Lemieux Le système de santé au Québec : organisations, acteurs et enjeux , 2003 .

[13]  John N Lavis,et al.  Examining the role of health services research in public policymaking. , 2002, The Milbank quarterly.

[14]  Gary L. Kreps,et al.  Evaluating new health information technologies: expanding the frontiers of health care delivery and health promotion. , 2002, Studies in health technology and informatics.

[15]  R. Wootton,et al.  What constitutes success in telehealth? , 2001, Journal of telemedicine and telecare.

[16]  Stuart S. Blume,et al.  Technology Assessment and the Sociopolitics of Health Technologies , 2000, Journal of health politics, policy and law.

[17]  J. Mitchell Increasing the cost-effectiveness of telemedicine by embracing e-health , 2000, Journal of telemedicine and telecare.

[18]  J. Eisenberg,et al.  Ten lessons for evidence-based technology assessment. , 1999, JAMA.

[19]  R. Scott,et al.  The value of an evaluation framework for telehealth initiatives. , 1999, Studies in health technology and informatics.

[20]  E. Tangalos,et al.  "A Telemedicine Primer: Understanding the Issues" , 1996 .

[21]  J. Greene Stakeholder participation in evaluation design: Is it worth the effort? , 1987 .