Validity of the Model for Assessment of Telemedicine: A Delphi study

Introduction In 2009, the Model for Assessment of Telemedicine (MAST) was developed within the MethoTelemed project as a framework for description of the effectiveness of telemedicine applications. The goal was for the assessments to be used as basis for decision-making in healthcare systems. Since then, MAST has been used in many European telemedicine studies and is now the most widely used model for assessment of telemedicine. The aim of this study was to assess the face validity of MAST. Methods A modified Delphi process was carried out and included a workshop with a sample of healthcare decision makers. A total of 56 decision makers and experts in telemedicine were invited and 19 persons participated in the two Delphi rounds. Thirteen hospitals or regional health authorities from 12 European countries and six research organisations were represented in the final sample. The participants were asked to assess the importance of the different domains and topics in MAST on a 0–3 Likert scale. Results All respondents completed the two rounds. Based on the answers, the face validity of all MAST domains was confirmed, since all domains were considered moderately or highly important by more than 80% of the respondents. Discussion Even though the study confirmed the validity of MAST, a number of supplements and improvements regarding study design and data collection were suggested. When considering the results it should be noticed that the sample size was small and larger studies are needed to confirm the results.

[1]  Knud Bonnet Yderstraede,et al.  A qualitative study of the key factors in implementing telemedical monitoring of diabetic foot ulcer patients , 2015, Int. J. Medical Informatics.

[2]  J. Grigsby,et al.  The evaluation of telemedicine and health services research. , 2005, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[3]  Niilo Saranummi,et al.  Telemonitoring and Mobile Phone-Based Health Coaching Among Finnish Diabetic and Heart Disease Patients: Randomized Controlled Trial , 2015, Journal of medical Internet research.

[4]  J. Sloand,et al.  Remote Monitoring of Chronic Diseases: A Landscape Assessment of Policies in Four European Countries , 2016, PloS one.

[5]  Richard E Scott,et al.  Telehealth outcomes: a synthesis of the literature and recommendations for outcome indicators. , 2007, Journal of telemedicine and telecare.

[6]  Victoria Wade,et al.  Theoretical frameworks in telemedicine research , 2017, Journal of telemedicine and telecare.

[7]  Alison Bowes,et al.  Early telemedicine training and counselling after hospitalization in patients with severe chronic obstructive pulmonary disease: a feasibility study , 2015, BMC Medical Informatics and Decision Making.

[8]  I. Durand-zaleski,et al.  Efficacy and cost effectiveness of telemedicine for improving access to care in the Paris region: study protocols for eight trials , 2015, BMC Health Services Research.

[9]  Samuel DiGangi,et al.  Assessing unidimensionality: A comparison of Rasch modeling, Parallel analysis, and TETRAD , 2007 .

[10]  C Hsu,et al.  THE DELPHI TECHNIQUE: MAKING SENSE OF CONSENSUS PRACTICAL ASSESSMENT , 2007 .

[11]  C. Donaldson,et al.  Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used , 2016, Pilot and Feasibility Studies.

[13]  M. Campbell,et al.  What is a pilot or feasibility study? A review of current practice and editorial policy , 2010, BMC medical research methodology.

[14]  Charles Stangor,et al.  Research methods for the behavioral sciences , 1997 .

[15]  Paul Joseph Green,et al.  The content of a college-level outdoor leadership course for land-based outdoor pursuits in the pacific northwest : a Delphi consensus , 1981 .

[16]  S. Newman,et al.  Assessment of Patients’ Perception of Telemedicine Services Using the Service User Technology Acceptability Questionnaire , 2016, International journal of integrated care.

[17]  P. Bower,et al.  An organisational analysis of the implementation of telecare and telehealth: the whole systems demonstrator , 2012, BMC Health Services Research.

[18]  B. G Ludwig,et al.  Predicting the future: Have you considered using the Delphi methodology , 1997 .

[19]  M. Bech,et al.  The effect of real-time teleconsultations between hospital-based nurses and patients with severe COPD discharged after an exacerbation , 2013, Journal of telemedicine and telecare.

[20]  B. Rush,et al.  National Telehealth Outcome Indicators Project [NTOIP] - Project Information Document and a Synthesis of Telehealth Outcomes Literature , 2003 .

[21]  Mickael Bech,et al.  A MODEL FOR ASSESSMENT OF TELEMEDICINE APPLICATIONS: MAST , 2012, International Journal of Technology Assessment in Health Care.

[22]  J. Ockene,et al.  Social desirability bias in dietary self-report may compromise the validity of dietary intake measures. , 1995, International journal of epidemiology.

[23]  Chia-Chien Hsu,et al.  The Delphi Technique: Making Sense of Consensus , 2007 .

[24]  Alison Bowes,et al.  Effectiveness of telemedicine: A systematic review of reviews , 2010, Int. J. Medical Informatics.

[25]  A. V. D. Ven,et al.  Group Techniques for Program Planning , 1975 .

[26]  Jeremy C. Wyatt,et al.  The case for randomized controlled trials to assess the impact of clinical information systems , 2011, J. Am. Medical Informatics Assoc..

[27]  J. Kvedar,et al.  “Real-World” Practical Evaluation Strategies: A Review of Telehealth Evaluation , 2014, JMIR research protocols.

[28]  Rashid Bashshur,et al.  Telemedicine evaluation. , 2005, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[29]  J. Clemensen,et al.  Telemedicine in Neonatal Home Care: Identifying Parental Needs Through Participatory Design , 2016, JMIR research protocols.

[30]  Kjeld Møller Pedersen,et al.  Cost-effectiveness of telemonitoring of diabetic foot ulcer patients , 2018, Health Informatics J..

[31]  Milada Cvancarova Småstuen,et al.  A Low-Intensity Mobile Health Intervention With and Without Health Counseling for Persons With Type 2 Diabetes, Part 1: Baseline and Short-Term Results From a Randomized Controlled Trial in the Norwegian Part of RENEWING HEALTH , 2014, JMIR mHealth and uHealth.

[32]  NepalSurya,et al.  A Framework for Telehealth Program Evaluation , 2014 .

[33]  Surya Nepal,et al.  A framework for telehealth program evaluation. , 2014, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[34]  Jens Lauritsen,et al.  A Randomized Controlled Trial Comparing Telemedical and Standard Outpatient Monitoring of Diabetic Foot Ulcers , 2015, Diabetes Care.

[35]  Lynn Chenoweth,et al.  Validation of a clinical leadership qualities framework for managers in aged care: a Delphi study. , 2015, Journal of clinical nursing.

[36]  Astrid Grøttland,et al.  ASSESSMENT OF MAST IN EUROPEAN PATIENT-CENTERED TELEMEDICINE PILOTS , 2015, International Journal of Technology Assessment in Health Care.

[37]  John Hansen,et al.  Cost-Utility Analysis of a Cardiac Telerehabilitation Program: The Teledialog Project , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[38]  Finn Børlum Kristensen,et al.  The HTA Core Model: A novel method for producing and reporting health technology assessments , 2009, International Journal of Technology Assessment in Health Care.

[39]  F. Timmins.  Nursing Research Generating and Assessing Evidence for Nursing Practice , 2013 .