Limitations of patient satisfaction studies in telehealthcare: a systematic review of the literature.

The objective of this study is to provide a systematic review of studies on patient satisfaction with telemedicine. The review included empirical studies that investigated patient satisfaction with that telemedicine service. The search strategy involved matching at least one of 11 'telemedicine' terms with one of 5 'satisfaction' terms. The following databases were searched: Telemedicine Information Exchange (TIE) database, MEDLINE, Science Citation Index (SCI), Social Science Citation Index (SSCI), Psycinfo, and Citation Index of Nursing and Allied Health (CINAHL). A highly structured instrument was used for data extraction. The review included 93 studies. Telepsychiatry represents the largest portion of these studies (25%), followed by multispecialty care (14%), nursing (11%), and dermatology (8%). Real-time videoconferencing was used in 88% of these studies. Only 19 (20%) included an independent control group, including 9 (10%) randomized control trial (RCT) studies. One third of studies were based on samples of less than 20 patients, and only 21% had samples of over 100 patients. Aspects of patient satisfaction most commonly assessed were: professional-patient interaction, the patient's feeling about the consultation, and technical aspects of the consultation. Only 33% of the studies included a measure of preference between telemedicine and face-to-face consultation. Almost half the studies measured only 1 or 2 dimensions of satisfaction. Reported levels of satisfaction with telemedicine are consistently greater than 80%, and frequently reported at 100%. Progression of telemedicine services from "trial" status to routine health service must be supported by improved research into patients' satisfaction with telemedicine. Further investigation of factors that influence patient acceptance of telemedicine is indicated.

[1]  R. Shih,et al.  Telemedicine in the emergency department: a randomized controlled trial , 1999, Journal of telemedicine and telecare.

[2]  T E Kottke,et al.  The Pine Ridge-Mayo National Aeronautics and Space Administration telemedicine project: program activities and participant reactions. , 1996, Mayo Clinic proceedings.

[3]  T R Willemain,et al.  Comparison of television and telephone for remote medical consultation. , 1975, The New England journal of medicine.

[4]  P A Jennett,et al.  Evaluation of a Distance Consulting Service Based on Interactive Video and Integrated Computerized Technology , 1995, Journal of telemedicine and telecare.

[5]  P Wallace,et al.  Virtual outreach: a telemedicine pilot study using a cluster-randomized controlled design , 1999, Journal of telemedicine and telecare.

[6]  A. Aronson,et al.  Telemedicine and the diagnosis of speech and language disorders. , 1997, Mayo Clinic proceedings.

[7]  John E. Stollerman,et al.  A telecommunications system for monitoring and counseling patients with hypertension. Impact on medication adherence and blood pressure control. , 1996, American journal of hypertension.

[8]  Judith A. Hall,et al.  What patients like about their medical care and how often they are asked: a meta-analysis of the satisfaction literature. , 1988, Social science & medicine.

[9]  R. D'Souza Telemedicine for intensive support of psychiatric inpatients admitted to local hospitals , 2000, Journal of telemedicine and telecare.

[10]  T. Mccain,et al.  Patient satisfaction with telemedicine in a prison environment , 1999, Journal of telemedicine and telecare.

[11]  L A Blackmon,et al.  Consumer satisfaction with telemedicine child psychiatry consultation in rural Kentucky. , 1997, Psychiatric services.

[12]  A. Holtan Patient reactions to specialist telemedicine consultations-a sociological approach , 1998, Journal of telemedicine and telecare.

[13]  J. Motto,et al.  Satisfaction of forensic psychiatric patients with remote telepsychiatric evaluation. , 2000, Psychiatric services.

[14]  C. Kwolek,et al.  Telemedicine in Vascular Surgery: Does it Work? , 2001, The American surgeon.

[15]  I. Winblad,et al.  The feasibility of telemedicine for orthopaedic outpatient clinicsa randomized controlled trial , 2000, Journal of telemedicine and telecare.

[16]  P Whitten,et al.  Patients' perceptions of a telemedicine specialty clinic , 2000, Journal of telemedicine and telecare.

[17]  M. Peyrot,et al.  Telehealth in the Federal Bureau of Prisons: Inmates' perceptions. , 2000 .

[18]  A Allen,et al.  Patient satisfaction with teleoncology: a pilot study. , 1995, Telemedicine journal : the official journal of the American Telemedicine Association.

[19]  G. C. Pascoe,et al.  Patient satisfaction in primary health care: a literature review and analysis. , 1983, Evaluation and program planning.

[20]  R M Brecht,et al.  The University of Texas Medical Branch--Texas Department of Criminal Justice Telemedicine Project: findings from the first year of operation. , 1996, Telemedicine journal : the official journal of the American Telemedicine Association.

[21]  P. Yellowlees,et al.  Telepsychiatry: ‘tele’ yes, but what about the ‘psychiatry’? , 1997, Journal of telemedicine and telecare.

[22]  Vivian L. West,et al.  Patient Satisfaction with Telemedicine , 2000 .

[23]  V. Curran,et al.  A study of rural women's satisfaction with a breast cancer self-help network , 1999, Journal of telemedicine and telecare.

[24]  J. Belmont,et al.  Pediatric cardiology: auscultation from 280 miles away. , 1992, Kansas medicine : the journal of the Kansas Medical Society.

[25]  D. Morin,et al.  Evaluation of telenursing outcomes: satisfaction, self-care practices, and cost savings. , 2000, Public health nursing.

[26]  G. Rosenthal,et al.  The use of patient perceptions in the evaluation of health-care delivery systems. , 1997, Medical care.

[27]  Y. Chae,et al.  The reliability and acceptability of telemedicine for patients with schizophrenia in Korea , 2000, Journal of telemedicine and telecare.

[28]  Ching-Yu Chen,et al.  Implementation and evaluation of a multifunctional telemedicine system in NTUH , 2001, Int. J. Medical Informatics.

[29]  William F. Mason,et al.  Telemedicine in Nova Scotia: report of a pilot study. , 1998, Telemedicine journal : the official journal of the American Telemedicine Association.

[30]  T. Nesbitt,et al.  Development of a telemedicine program: a review of 1,000 videoconferencing consultations. , 2000, The Western journal of medicine.

[31]  L Mannion,et al.  Telepsychiatry: an island pilot project , 1998, Journal of telemedicine and telecare.

[32]  Griffiths,et al.  Comparison of teleconsultations and face‐to‐face consultations: preliminary results of a United Kingdom multicentre teledermatology study , 1998, The British journal of dermatology.

[33]  J P Watson,et al.  A Comparison of Communication Modes in Adult Psychiatry , 1995, Journal of telemedicine and telecare.

[34]  A. Raskin,et al.  Evaluation of a Portable Low Cost Videophone System in the Assessment of Depressive Symptoms and Cognitive Function in Elderly Medically Ill Veterans , 2001, Journal of Nervous and Mental Disease.

[35]  Seung Hee Ho,et al.  Patient satisfaction with telemedicine in home health services for the elderly , 2001, Int. J. Medical Informatics.

[36]  Robert Kevin Grigsby,et al.  Sickle cell telemedicine and standard clinical encounters: a comparison of patient satisfaction. , 1999, Telemedicine journal : the official journal of the American Telemedicine Association.

[37]  R. Wootton,et al.  Randomised controlled trial of telemedicine for new neurological outpatient referrals , 2001, Journal of neurology, neurosurgery, and psychiatry.

[38]  J Tonetti,et al.  Feasibility of orthopaedic teleconsulting in a geriatric rehabilitation service , 1998, Journal of telemedicine and telecare.

[39]  M E McConnell,et al.  Interactive telecardiology for the evaluation of heart murmurs in children. , 1999, Telemedicine journal : the official journal of the American Telemedicine Association.

[40]  P. Mclaren,et al.  Telepsychiatry in an inner-city community psychiatric service , 1996, Journal of Telemedicine and Telecare.

[41]  D. Dossetor,et al.  A child and adolescent psychiatric outreach service for rural New South Wales: A telemedicine pilot study , 1999, Journal of paediatrics and child health.

[42]  J. Sitzia,et al.  Patient satisfaction: a review of issues and concepts. , 1997, Social science & medicine.

[43]  D. Locker,et al.  Theoretical and methodological issues in sociological studies of consumer satisfaction with medical care. , 1978, Social science & medicine.

[44]  S. Reis,et al.  Telemedicine in primary care in Israel , 1998, Journal of Telemedicine and Telecare.

[45]  C. May,et al.  Evaluation of new technologies in health-care systems: what’s the context? , 2000 .

[46]  D. Eedy,et al.  Patient satisfaction with realtime teledermatology in Northern Ireland , 1998, Journal of telemedicine and telecare.

[47]  M. Avis,et al.  Satisfying solutions? A review of some unresolved issues in the measurement of patient satisfaction. , 1995, Journal of advanced nursing.

[48]  G C Burke,et al.  The technical performance and clinical feasibility of telecolposcopy. , 2000, The Journal of family practice.

[49]  Y. Pao,et al.  Telemedicine in critical care: an experiment in health care delivery. , 1977, JACEP.

[50]  B. Boulanger,et al.  Telemedicine: a solution to the followup of rural trauma patients? , 2001, Journal of the American College of Surgeons.

[51]  J. Kvedar,et al.  Teledermatology in a capitated delivery system using distributed information architecture: design and development. , 1999, Telemedicine journal : the official journal of the American Telemedicine Association.

[52]  N A Blackwell,et al.  Telemedicine ophthalmology consultation in remote Queensland , 1997, The Medical journal of Australia.

[53]  R L Bratton,et al.  Telemedicine applications in primary care: a geriatric patient pilot project. , 2000, Mayo Clinic proceedings.

[54]  Elsie Hui,et al.  Telepsychiatry in psychogeriatric service: a pilot study , 2001, International journal of geriatric psychiatry.

[55]  P H Clarke,et al.  A referrer and patient evaluation of a telepsychiatry consultation–liaison service in South Australia , 1997, Journal of telemedicine and telecare.

[56]  J. Grigsby,et al.  Analytic framework for evaluation of telemedicine. , 1995, Telemedicine journal : the official journal of the American Telemedicine Association.

[57]  S. Pedersen,et al.  Tele-endoscopic otorhinolaryngological examination: preliminary study of patient satisfaction. , 1995, Telemedicine journal : the official journal of the American Telemedicine Association.

[58]  J. L. Huston,et al.  Patient satisfaction with multispecialty interactive teleconsultations , 1997, Journal of telemedicine and telecare.

[59]  N. Taffinder,et al.  Sigmoidoscopy in a nurse-practitioner community clinic using telemedicine , 1999, Journal of telemedicine and telecare.

[60]  J. Rosser,et al.  Evaluation of the effectiveness of portable low-bandwidth telemedical applications for postoperative followup: initial results. , 2000, Journal of the American College of Surgeons.

[61]  C. Made,et al.  Tele-otolaryngology consultations between two rural primary-care centres in southern Lapland and the University Hospital of Umeå , 1999, Journal of telemedicine and telecare.

[62]  E. Lemaire,et al.  Low-bandwidth, Internet-based videoconferencing for physical rehabilitation consultations , 2001, Journal of telemedicine and telecare.

[63]  M Isohanni,et al.  Psychiatric inpatient care planning via telemedicine , 2000, Journal of telemedicine and telecare.

[64]  J. Lepistö,et al.  A prospective study of teleconferencing for orthopaedic consultations , 1999, Journal of telemedicine and telecare.

[65]  P T Dick,et al.  Participant satisfaction and comfort with multidisciplinary pediatric telemedicine consultations. , 1999, Journal of pediatric surgery.

[66]  Judith A. Hall,et al.  Meta-analysis of satisfaction with medical care: description of research domain and analysis of overall satisfaction levels. , 1988, Social science & medicine.

[67]  D. J. Berry,et al.  Clinical consultations using store-and-forward telemedicine technology. , 1999, Mayo Clinic proceedings.

[68]  T S Nesbitt,et al.  Patient satisfaction with telemedicine consultation in primary care: comparison of ratings of medical and mental health applications. , 1998, Telemedicine journal : the official journal of the American Telemedicine Association.

[69]  A F Jerant,et al.  Patients' perceptions regarding home telecare. , 2000, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[70]  R F Davies,et al.  The Ottawa telehealth project. , 1998, Telemedicine journal : the official journal of the American Telemedicine Association.

[71]  M C Davis,et al.  Teleradiology in rural imaging centres , 1997, Journal of telemedicine and telecare.

[72]  F. del Nogal,et al.  Patient satisfaction with a home televisiting service based on interactive television over a cable network , 2000, Journal of telemedicine and telecare.

[73]  P Jacklin,et al.  Joint teleconsultations (virtual outreach) versus standard outpatient appointments for patients referred by their general practitioner for a specialist opinion: a randomised trial , 2002, The Lancet.

[74]  Y. Gul,et al.  Realtime remote consultation in the outpatient clinic—experience at a teaching hospital , 1999, Journal of telemedicine and telecare.

[75]  I. Bowns,et al.  Patient satisfaction in telemedicine , 2000 .

[76]  A. Juutinen,et al.  The application of teleophthalmology in examining patients with glaucoma: a pilot study. , 1999, Journal of glaucoma.

[77]  L. Schopp,et al.  Telehealth and neuropsychological assessment: New opportunities for psychologists. , 2000 .

[78]  W A Hargreaves,et al.  Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. , 2000, Archives of family medicine.

[79]  H White,et al.  A prospective satisfaction study and cost analysis of a pilot child telepsychiatry service in Newfoundland , 2001, Journal of telemedicine and telecare.

[80]  I H Kunkler,et al.  A pilot study of tele-oncology in Scotland , 1998, Journal of telemedicine and telecare.

[81]  P. Wallace,et al.  Can telemedicine be used to improve communication between primary and secondary care? , 1996, BMJ.

[82]  P. Aarnio,et al.  User satisfaction with teleconsultations for surgery , 2000, Journal of telemedicine and telecare.

[83]  L. Baer,et al.  Applicability of telemedicine for assessing patients with schizophrenia: acceptance and reliability. , 1997, The Journal of clinical psychiatry.

[84]  J. Woo,et al.  A Telemedicine System As a Care Modality for Dementia Patients in Korea , 2000, Alzheimer disease and associated disorders.

[85]  V L Phillips,et al.  A feasibility study of video-based home telecare for clients with spinal cord injuries , 1998, Journal of telemedicine and telecare.

[86]  R. Wootton,et al.  User satisfaction with realtime teleneurology , 1999, Journal of telemedicine and telecare.

[87]  H White,et al.  A randomized, controlled trial of child psychiatric assessments conducted using videoconferencing , 2000, Journal of telemedicine and telecare.

[88]  R. Grol,et al.  Quality judgements by patients on general practice care: a literature analysis. , 1994, Social science & medicine.

[89]  D. Peck,et al.  The consistency of neuropsychological assessments performed via telecommunication and face to face , 2000, Journal of telemedicine and telecare.

[90]  P. Whitten,et al.  Systematic review of studies of patient satisfaction with telemedicine , 2000, BMJ : British Medical Journal.

[91]  A nursing application of telecommunications. Measurement of satisfaction for patients and providers. , 2001, Journal of gerontological nursing.

[92]  B. Johnston,et al.  Outcomes of the Kaiser Permanente Tele-Home Health Research Project. , 2000, Archives of family medicine.

[93]  H. Mekhjian,et al.  Effectiveness of telemedicine in the outpatient pulmonary clinic. , 1998, Telemedicine journal : the official journal of the American Telemedicine Association.

[94]  D. Hailey,et al.  Evaluation of a telepsychiatry pilot project , 1999, Journal of telemedicine and telecare.

[95]  M. Rogers,et al.  Home Monitoring Service Improves Mean Arterial Pressure in Patients with Essential Hypertension , 2001, Annals of Internal Medicine.

[96]  J L Lebow,et al.  Consumer Assessments of the Quality of Medical Care , 1974, Medical care.

[97]  S. Wallace,et al.  The virtual mole clinic: preliminary results from the Plymouth skin cancer screening study using telemedicine. , 1999, Medical informatics and the Internet in medicine.

[98]  A. Stewart,et al.  The measurement and meaning of patient satisfaction. , 1978, Health & medical care services review.

[99]  A. Allen,et al.  Home health visits using a cable television network: user satisfaction. , 1996, Journal of telemedicine and telecare.

[100]  S Harvey,et al.  Telemedicine in rural care. Part 1: Developing and evaluating a nurse-led initiative. , 2001, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[101]  J. Mckinlay,et al.  Teledermatology in the Highlands of Scotland , 1996, Journal of telemedicine and telecare.

[102]  E. Hui,et al.  The role of telenursing in the provision of geriatric outreach services to residential homes in Hong Kong , 2001, Journal of telemedicine and telecare.

[103]  J W Burnett,et al.  Teledermatology and in-person examinations: a comparison of patient and physician perceptions and diagnostic agreement. , 1998, Archives of dermatology.

[104]  Philip R. Magaletta,et al.  Advancing psychology services through telehealth in the Federal Bureau of Prisons. , 1998 .

[105]  J. Sinacore,et al.  A Comparative Study of Seven Measures of Patient Satisfaction , 1995, Medical care.

[106]  J E Ware,et al.  Methods For Measuring Patient Satisfaction With Specific Medical Encounters , 1988, Medical care.

[107]  Psychological impact of a remote psychometric consultation with hospitalized elderly people , 1997, Journal of telemedicine and telecare.

[108]  P. Whitten,et al.  Home telenursing in Kansas: Patients’ perceptions of uses and benefits , 1997, Journal of telemedicine and telecare.

[109]  D Allen,et al.  Evaluation of the use and usefulness of telephone consultations in one general practice. , 1992, The British journal of general practice : the journal of the Royal College of General Practitioners.