Evaluation practices of a major Canadian telehealth provider: lessons and future directions for the field.

The objective of this study was to assess the quality of Capital Health (Edmonton Area)'s telehealth evaluation practices. We conducted a comprehensive background literature review examining the current state of the art in telehealth evaluation. Using the Clinical, Human and Organizational, Educational, Administrative, Technical, and Social (CHEATS) evaluation framework, we examined 77 documents pertaining to 17 different pilot and continuing telehealth projects in Capital Health's Regional Telehealth Program. Capital Health's practices meet and reflect current standards in the field of telehealth evaluation. Strongest areas are Clinical, Technical, and Administrative evaluation, while Social and Human and Organizational evaluation are in need of the most development. Variation in quality and quantity of evaluation measures also makes direct comparisons between projects difficult. The CHEATS framework is both theoretically and practically appropriate for planning and conducting telehealth evaluations. Capital Health plans to adopt CHEATS to improve the quality of its future telehealth evaluation evidence.

[1]  E. Miller,et al.  Solving the disjuncture between research and practice: telehealth trends in the 21st century. , 2007, Health policy.

[2]  A Hasman,et al.  Maturity of teledermatology evaluation research: a systematic literature review , 2007, The British journal of dermatology.

[3]  R. Wootton,et al.  A systematic review of successes and failures in home telehealth: preliminary results , 2006 .

[4]  J. Grigsby,et al.  Alternatives to randomized controlled trials in telemedicine , 2006, Journal of telemedicine and telecare.

[5]  W. Hersh,et al.  Diagnosis, access and outcomes: Update of a systematic review of telemedicine services , 2006, Journal of telemedicine and telecare.

[6]  Elsa Marziali,et al.  A Systematic Review of Practice Standards and Research Ethics in Technology-Based Home Health Care Intervention Programs for Older Adults , 2005, Journal of aging and health.

[7]  Marie-Pierre Gagnon,et al.  Striving for evidence in e-health evaluation: Lessons from health technology assessment , 2005, Journal of telemedicine and telecare.

[8]  David Hailey The need for cost-effectiveness studies in telemedicine , 2005, Journal of telemedicine and telecare.

[9]  J. Grigsby,et al.  The evaluation of telemedicine and health services research. , 2005, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[10]  T. Reardon,et al.  Research findings and strategies for assessing telemedicine costs. , 2005, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[11]  R. Bashshur,et al.  Telemedicine effects: Cost, quality, and access , 1995, Journal of Medical Systems.

[12]  Donald M Hilty,et al.  Clinical and Educational Telepsychiatry Applications: A Review , 2004, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[13]  Lanis L Hicks,et al.  A comprehensive model for evaluating telemedicine. , 2004, Studies in health technology and informatics.

[14]  The reality of applying an assessment guideline to a telemedicine mental health programme , 2003, Journal of telemedicine and telecare.

[15]  Pamela Whitten,et al.  Telemedicine from the Payor Perspective , 2003 .

[16]  Carl May,et al.  Normative models of health technology assessment and the social production of evidence about telehealth care. , 2003, Health policy.

[17]  E. Miller,et al.  The technical and interpersonal aspects of telemedicine: effects on doctor–patient communication , 2003, Journal of telemedicine and telecare.

[18]  Kim Dunn,et al.  Outcomes and methods in telemedicine evaluation. , 2003, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[19]  E. Hughes,et al.  Using the Australian and New Zealand Telehealth Committee framework to evaluate telehealth: Identifying conceptual gaps , 2002, Journal of telemedicine and telecare.

[20]  E. Miller,et al.  Telemedicine and doctor–patient communication: a theoretical framework for evaluation , 2002, Journal of telemedicine and telecare.

[21]  Nicola T. Shaw,et al.  'CHEATS': a generic information communication technology (ICT) evaluation framework , 2002, Comput. Biol. Medicine.

[22]  D. Hailey,et al.  Systematic review of evidence for the benefits of telemedicine , 2002, Journal of telemedicine and telecare.

[23]  Paul Wallace,et al.  Implementation of Telemedicine: The Problem of Evaluation , 2002, Journal of telemedicine and telecare.

[24]  F S Mair,et al.  Factors Influencing the Evaluation of Telehealth Interventions: Preliminary Results from a Qualitative Study of Evaluation Projects in the UK , 2002, Journal of telemedicine and telecare.

[25]  R. Roine,et al.  Assessing telemedicine: a systematic review of the literature. , 2001, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[26]  E. Miller,et al.  Telemedicine and doctor-patient communication: an analytical survey of the literature , 2001, Journal of telemedicine and telecare.

[27]  T. Stensgaard,et al.  Telemedicine in Greenland — The Creation of an Evaluation Plan , 2001, Journal of telemedicine and telecare.

[28]  Douglas A. Perednia,et al.  Evaluating psychosocial aspects of telemedicine and telehealth systems. , 2000 .

[29]  M Rigby,et al.  Putting the ‘tele’ into health-care effectively , 2000, Journal of telemedicine and telecare.

[30]  P Yellowlees,et al.  Practical evaluation of telemedicine systems in the real world , 1998, Journal of telemedicine and telecare.

[31]  S. Gallivan,et al.  Telemedicine: evaluation or stagnation. , 1997, Studies in health technology and informatics.

[32]  S K Mun,et al.  Health systems evaluation of telemedicine: a staged approach. , 1996, Telemedicine journal : the official journal of the American Telemedicine Association.

[33]  D. Filiberti,et al.  A telemedicine transaction model. , 1995, Telemedicine journal : the official journal of the American Telemedicine Association.

[34]  O Wigertz,et al.  Evaluation of decision support systems in medicine. , 1991, Computer methods and programs in biomedicine.