Evaluation and selection of mobile health (mHealth) applications using AHP and fuzzy TOPSIS

Abstract mHealth is an innovative, mobile application based system, which has the ability to assist people to manage their health better. With the increasing number of mHealth applications, it is very difficult to choose the ideal application. As of now, very limited studies have been carried out on mHealth application selection. To fill the existing research gaps, this study endeavours to develop a model for mHealth application selection by adopting a combined approach of AHP and fuzzy TOPSIS. The hierarchical model has been developed using factors identified from literature review and expert opinions. The ambiguity in comparing different mHealth applications has been handled by applying fuzzy set theory. The AHP has been used to determine the weights of criteria and sub-criteria, and the fuzzy-TOPSIS method has been used to obtain the final ranking of the applications. The applicability of the proposed model has been discussed through a numerical case example. The sensitivity analysis has been carried out by changing the weights of the criteria. In this study, user satisfaction, functionality, easy to learn and use, and information quality, have come out as important factors in mHealth application selection. The proposed method will help users as well as medical practitioners to select the proper mHealth application in this digital world.

[1]  Su-Chao Chang,et al.  Nursing students' behavioral intention to use online courses: a questionnaire survey. , 2008, International journal of nursing studies.

[2]  Shahriar Akter,et al.  Service quality of mHealth platforms: development and validation of a hierarchical model using PLS , 2010, Electron. Mark..

[3]  Steve Drew,et al.  Using the Technology Acceptance Model in Understanding Academics' Behavioural Intention to Use Learning Management Systems , 2014 .

[4]  H.-J. Zimmermann.  Fuzzy set theory , 2010 .

[5]  Zeshui Xu,et al.  An interactive method for fuzzy multiple attribute group decision making , 2007, Inf. Sci..

[6]  Katrien G. Luijkx,et al.  The human dimension of modular care provision: Opportunities for personalization and customization , 2013 .

[7]  Orlando Durán,et al.  Computer-aided machine-tool selection based on a Fuzzy-AHP approach , 2008, Expert Syst. Appl..

[8]  Tianhong Zhang,et al.  Mobile health in China: current status and future development. , 2014, Asian journal of psychiatry.

[9]  Sachin S. Kamble,et al.  Fuzzy multi-criteria decision analysis for environmentally conscious solid waste treatment and disposal technology selection , 2019, Technology in Society.

[10]  Yushi Li,et al.  Trust between physicians and patients in the e-health era , 2016 .

[11]  F. Yaghmaie,et al.  AN AHP FRAMEWORK FOR HOSPITAL INFORMATION SYSTEMS' EVALUATION: THE CASE OF TEHRAN PRIVATE HOSPITALS , 2013 .

[12]  A V Shekdar,et al.  Health-care waste management in India. , 2001, Journal of environmental management.

[13]  Manoj Kumar Tiwari,et al.  Global supplier selection: a fuzzy-AHP approach , 2008 .

[14]  Eric Bergman,et al.  Information appliance design at Sun Microsystems , 2000, CHI Extended Abstracts.

[15]  A. Mosadeghrad.  Factors Influencing Healthcare Service Quality , 2014, International journal of health policy and management.

[16]  Gülçin Büyüközkan,et al.  A combined fuzzy AHP and fuzzy TOPSIS based strategic analysis of electronic service quality in healthcare industry , 2012, Expert Syst. Appl..

[17]  Seongcheol Kim,et al.  A multi-criteria approach toward discovering killer IoT application in Korea , 2016 .

[18]  D. Luxton,et al.  mHealth data security: the need for HIPAA-compliant standardization. , 2012, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[19]  Seetharaman Hariharan,et al.  Managing healthcare performance in analytical framework , 2008 .

[20]  Deng Yong.  Plant location selection based on fuzzy TOPSIS , 2006 .

[21]  R. Fitzpatrick,et al.  Impact of patient-reported outcome measures on routine practice: a structured review. , 2006, Journal of evaluation in clinical practice.

[22]  Artur Ziviani,et al.  AToMS: A Ubiquitous Teleconsultation System for Supporting AMI Patients with Prehospital Thrombolysis , 2011, International journal of telemedicine and applications.

[23]  Federica Lucivero,et al.  The lifestylisation of healthcare? ‘Consumer genomics’ and mobile health as technologies for healthy lifestyle , 2015, Applied & translational genomics.

[24]  Chung-Hsing Yeh,et al.  A survey analysis of service quality for domestic airlines , 2002, Eur. J. Oper. Res..

[25]  Qingxiong Ma,et al.  The Role of Internet Self-Efficacy in the Acceptance of Web-Based Electronic Medical Records , 2005, J. Organ. End User Comput..

[26]  Thomas L. Saaty,et al.  On the invalidity of fuzzifying numerical judgments in the Analytic Hierarchy Process , 2007, Math. Comput. Model..

[27]  Qing Zhu,et al.  Status and trends of mobile-health applications for iOS devices: A developer's perspective , 2011, J. Syst. Softw..

[28]  Semih Onüt,et al.  Transshipment site selection using the AHP and TOPSIS approaches under fuzzy environment. , 2008, Waste management.

[29]  Emre Sezgin,et al.  A Literature Review on Attitudes of Health Professionals towards Health Information Systems: From e-Health to m-Health , 2014 .

[30]  Serkan Yavuz,et al.  Weapon selection using the AHP and TOPSIS methods under fuzzy environment , 2009, Expert Syst. Appl..

[31]  Ingoo Han,et al.  The Impact of Customer Trust and Perception of Security Control on the Acceptance of Electronic Commerce , 2003, Int. J. Electron. Commer..

[32]  Evangelos Grigoroudis,et al.  The assessment of user-perceived web quality: Application of a satisfaction benchmarking approach , 2008, Eur. J. Oper. Res..

[33]  Julian K. Ayeh.  Travellers' acceptance of consumer-generated media: An integrated model of technology acceptance and source credibility theories , 2015, Comput. Hum. Behav..

[34]  Gin-Shuh Liang,et al.  Using fuzzy MCDM to select partners of strategic alliances for liner shipping , 2005, Inf. Sci..

[35]  Zeynep D. U. Durmusoglu,et al.  Assessment of techno-entrepreneurship projects by using Analytical Hierarchy Process (AHP) , 2018 .

[36]  Drakoulis Martakos,et al.  A utility-based fuzzy TOPSIS method for energy efficient network selection in heterogeneous wireless networks , 2012, Appl. Soft Comput..

[37]  Peter F. Luckett,et al.  Effects of Feedback and Task Predictability onTask Learning and Judgment Accuracy , 1999 .

[38]  Ying-Ming Wang,et al.  Fuzzy TOPSIS method based on alpha level sets with an application to bridge risk assessment , 2006, Expert Syst. Appl..

[39]  Michaela Striteska,et al.  Review and Comparison of Performance Measurement Systems , 2012 .

[40]  Mark R. Lehto,et al.  User acceptance of YouTube for procedural learning: An extension of the Technology Acceptance Model , 2013, Comput. Educ..

[41]  D. Ben-Zeev,et al.  Mobile health (mHealth) for mental health in Asia: objectives, strategies, and limitations. , 2014, Asian journal of psychiatry.

[42]  Taho Yang,et al.  Multiple-attribute decision making methods for plant layout design problem , 2007 .

[43]  Gülçin Büyüközkan,et al.  Selection of the strategic alliance partner in logistics value chain , 2008 .

[44]  B. B. Zaidan,et al.  Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS , 2015, J. Biomed. Informatics.

[45]  E. Carvajal-Trujillo,et al.  Online purchasing tickets for low cost carriers: An application of the unified theory of acceptance and use of technology (UTAUT) model , 2014 .

[46]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[47]  John Ingham,et al.  Why do people use information technology? A critical review of the technology acceptance model , 2003, Inf. Manag..

[48]  Su-Chao Chang,et al.  An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry , 2008, Int. J. Medical Informatics.

[49]  Tugrul U. Daim,et al.  Technology assessment for clean energy technologies: The case of the Pacific Northwest , 2009 .

[50]  Charles Scawthorn,et al.  Fuzzy AHP-based multicriteria decision making systems using particle swarm optimization , 2012, Expert Syst. Appl..

[51]  Ting-Yu Chen,et al.  The interval-valued fuzzy TOPSIS method and experimental analysis , 2008, Fuzzy Sets Syst..

[52]  C. Flavián,et al.  Perceived e‐service quality (PeSQ) , 2007 .

[53]  Gwo-Hshiung Tzeng,et al.  Improving Sustainable Mobile Health Care Promotion: A Novel Hybrid MCDM Method , 2019, Sustainability.

[54]  Chia-Chi Sun,et al.  A performance evaluation model by integrating fuzzy AHP and fuzzy TOPSIS methods , 2010, Expert Syst. Appl..

[55]  Jamil Razmak,et al.  Comparing Canadian physicians and patients on their use of e-health tools , 2017 .

[56]  Anastasia Papazafeiropoulou,et al.  An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit) , 2008, Int. J. Medical Informatics.

[57]  Harry Bouwman,et al.  An assessment of advanced mobile services acceptance: Contributions from TAM and diffusion theory models , 2008, Inf. Manag..

[58]  Simon Fong,et al.  Using Medical History Embedded in Biometrics Medical Card for User Identity Authentication: Data Representation by AVT Hierarchical Data Tree , 2012, Journal of biomedicine & biotechnology.

[59]  Audie A Atienza,et al.  Mobile health technology evaluation: the mHealth evidence workshop. , 2013, American journal of preventive medicine.

[60]  Bradley N. Doebbeling,et al.  Research Paper: VA QUERI Informatics Paper Information Technology for Clinical Guideline Implementation: Perceptions of Multidisciplinary Stakeholders , 2004, J. Am. Medical Informatics Assoc..

[61]  Tugrul U. Daim,et al.  Adoption factors of electronic health record systems , 2019, Technology in Society.

[62]  Bernard Kamsu-Foguem,et al.  Telemedicine and mobile health with integrative medicine in developing countries , 2014 .

[63]  Harri Kiljander,et al.  Evolution and usability of mobile phone interaction styles , 2004 .

[64]  Mohammad Nazir,et al.  User acceptance of information technology: factors, theories and applications , 2014 .

[65]  C. Zopounidis,et al.  Strategic performance measurement in a healthcare organisation: A multiple criteria approach based on balanced scorecard , 2012 .

[66]  Joel J. P. C. Rodrigues,et al.  Mobile-health: A review of current state in 2015 , 2015, J. Biomed. Informatics.

[67]  Kristin Braa,et al.  From Pilot to Scale: towards a mHealth Typology for Low Resource Contexts , 2012, ECIS.

[68]  Stephen Gardner,et al.  A novel implementation of signature, encryption and authentication (SEA) protocol on mobile patient monitoring devices. , 2008, Technology and health care : official journal of the European Society for Engineering and Medicine.

[69]  E. Karsak,et al.  Fuzzy multi-criteria decision-making procedure for evaluating advanced manufacturing system investments , 2001 .

[70]  I-Chiu Chang,et al.  Physicians' acceptance of pharmacokinetics-based clinical decision support systems , 2007, Expert Syst. Appl..

[71]  G Eysenbach,et al.  The role of e-health and consumer health informatics for evidence-based patient choice in the 21st century. , 2001, Clinics in dermatology.

[72]  Jan Marco Leimeister,et al.  Determinants of physicians' technology acceptance for e-health in ambulatory care , 2012, Int. J. Medical Informatics.

[73]  Metin Dagdeviren,et al.  Decision making in equipment selection: an integrated approach with AHP and PROMETHEE , 2008, J. Intell. Manuf..

[74]  James G Kahn,et al.  'Mobile' health needs and opportunities in developing countries. , 2010, Health affairs.

[75]  Jun Guo,et al.  Rank B2C e-commerce websites in e-alliance based on AHP and fuzzy TOPSIS , 2011, Expert Syst. Appl..

[76]  Rita Samiolo,et al.  Performance measurement in global governance: Ranking and the politics of variability , 2016 .

[77]  Cengiz Kahraman,et al.  Fuzzy multi-criteria evaluation of industrial robotic systems , 2007, Comput. Ind. Eng..

[78]  Chihiro Watanabe,et al.  The co-evolution process of technological innovation—An empirical study of mobile phone vendors and telecommunication service operators in Japan , 2007 .

[79]  Da Ruan,et al.  Fuzzy group decision-making for facility location selection , 2003, Inf. Sci..

[80]  Metin Dağdeviren,et al.  Developing a fuzzy analytic hierarchy process (AHP) model for behavior-based safety management , 2008, Inf. Sci..

[81]  Elizabeth M. Borycki,et al.  Developing a framework for meaningful use of personal health records (PHRs) , 2014 .

[82]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[83]  Sai S. Nudurupati,et al.  State of the art literature review on performance measurement , 2011, Comput. Ind. Eng..

[84]  Tien-Chin Wang,et al.  Application of TOPSIS in evaluating initial training aircraft under a fuzzy environment , 2007, Expert Syst. Appl..

[85]  Naveen Donthu,et al.  Developing a Scale to Measure the Perceived Quality of an Internet Shopping Site (PQISS) , 2015 .

[86]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[87]  Gülçin Büyüközkan,et al.  A two phase multi-attribute decision-making approach for new product introduction , 2007, Inf. Sci..

[88]  Shyi-Ming Chen,et al.  Evaluating weapon systems using fuzzy arithmetic operations , 1996, Fuzzy Sets Syst..

[89]  Jen-Her Wu,et al.  Mobile computing acceptance factors in the healthcare industry : A structural equation model , 2006 .

[90]  Tugrul U. Daim,et al.  Infrastructure and Service Integration as a Key Process in Technology Management , 2015 .

[91]  Jumin Park,et al.  Public satisfaction with the healthcare system performance in South Korea: Universal healthcare system. , 2016, Health policy.

[92]  Hadi Hayati,et al.  Determining the entitlement to structural indicators of health by means of fuzzy AHP and TOPSIS: a case study in Sistan and Baluchestan, Iran , 2015 .

[93]  Elena Simona Lohan,et al.  Location Based Services Analysis Through Analytical Hierarchical Processes: An e-Health-Based Case Study , 2017 .

[94]  Ching-Hsue Cheng,et al.  Evaluating the best main battle tank using fuzzy decision theory with linguistic criteria evaluation , 2002, Eur. J. Oper. Res..

[95]  Jen-Her Wu,et al.  What drives mobile commerce?: An empirical evaluation of the revised technology acceptance model , 2005, Inf. Manag..

[96]  Chung-Hsing Yeh,et al.  A survey and optimization-based evaluation of development strategies for the air cargo industry , 2007 .

[97]  Ying-Chyi Chou,et al.  Human resources for science and technology: Analyzing competitiveness using the analytic hierarchy process , 2008 .

[98]  Anol Bhattacherjee,et al.  Understanding Changes in Belief and Attitude Toward Information Technology Usage: A Theoretical Model and Longitudinal Test , 2004, MIS Q..

[99]  Da Ruan,et al.  Measuring flexibility of computer integrated manufacturing systems using fuzzy cash flow analysis , 2004, Inf. Sci..

[100]  Deo Shao,et al.  A Proposal of a Mobile Health Data Collection and Reporting System for the Developing World , 2012 .

[101]  Azham Hussain,et al.  A Systematic Review of Usability Challenges and Testing in Mobile Health , 2015 .

[102]  Da Ruan,et al.  A fuzzy preference‐ranking model for a quality evaluation of hospital web sites , 2006, Int. J. Intell. Syst..

[103]  Morteza Pakdin Amiri,et al.  Project selection for oil-fields development by using the AHP and fuzzy TOPSIS methods , 2010, Expert Syst. Appl..

[104]  Ing-Long Wu,et al.  The adoption of mobile healthcare by hospital's professionals: An integrative perspective , 2011, Decis. Support Syst..

[105]  P. Anand Raj,et al.  Ranking alternatives with fuzzy weights using maximizing set and minimizing set , 1999, Fuzzy Sets Syst..

[106]  Lara Khansa,et al.  Health information technologies for patients with diabetes , 2016 .

[107]  J. A. Oliveira,et al.  The Impact of mHealth Interventions: Systematic Review of Systematic Reviews , 2018, JMIR mHealth and uHealth.

[108]  R. Shroff,et al.  Analysis of the technology acceptance model in examining students' behavioural intention to use an e-portfolio system , 2011 .

[109]  Evangelos Triantaphyllou,et al.  Development and evaluation of five fuzzy multiattribute decision-making methods , 1996, Int. J. Approx. Reason..

[110]  David L. Olson,et al.  Comparison of weights in TOPSIS models , 2004, Math. Comput. Model..

[111]  Roman Yudkin.  Popularity of mobile devices brings risk. , 2012, Health management technology.

[112]  José Manuel Ortega Egea,et al.  Explaining physicians' acceptance of EHCR systems: An extension of TAM with trust and risk factors , 2011, Comput. Hum. Behav..

[113]  Wen-Hwa Liao,et al.  Applying analytic hierarchy process to assess healthcare-oriented cloud computing service systems , 2016, SpringerPlus.

[114]  Q. B. Chung,et al.  Using the analytic hierarchy process as a clinical engineering tool to facilitate an iterative, multidisciplinary, microeconomic health technology assessment , 2003, Comput. Oper. Res..

[115]  Chen-Tung Chen,et al.  A fuzzy approach for supplier evaluation and selection in supply chain management , 2006 .

[116]  Marios S. Pattichis,et al.  High efficiency video coding for ultrasound video communication in m-health systems , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[117]  Eric C. Pan,et al.  Organizational framework for health information technology , 2013, Int. J. Medical Informatics.

[118]  Žarko Rađenović,et al.  Integrated AHP-TOPSIS Method for the Assessment of Health Management Information Systems Efficiency , 2017 .

[119]  Gary G Bennett,et al.  Use of RE-AIM to address health inequities: Application in a low-income community health center-based weight loss and hypertension self-management program , 2013, Translational behavioral medicine.

[120]  Seyed Mostafa Hosseini,et al.  Performance Analysis of Hospital Managers Using Fuzzy AHP and Fuzzy TOPSIS: Iranian Experience , 2015, Global journal of health science.

[121]  Liwen Liu,et al.  Application of the Entropy Weight and TOPSIS Method in Safety Evaluation of Coal Mines , 2011 .

[122]  Nancy C. Goodwin,et al.  Functionality and usability , 1987, CACM.

[123]  Sung Youl Park,et al.  An Analysis of the Technology Acceptance Model in Understanding University Students' Behavioral Intention to Use e-Learning , 2009, J. Educ. Technol. Soc..

[124]  C. Kahraman,et al.  Fuzzy multi-attribute selection among transportation companies using axiomatic design and analytic h , 2005 .

[125]  T. Saaty,et al.  Why the magic number seven plus or minus two , 2003 .

[126]  Liang Zhou,et al.  A Data Encryption Solution for Mobile Health Apps in Cooperation Environments , 2013, Journal of medical Internet research.

[127]  H. F. van Tuijl,et al.  Performance management in healthcare: performance indicator development, task uncertainty, and types of performance indicators. , 2009, Social science & medicine.

[128]  Marcos A. Simplício,et al.  Mobile health in emerging countries: A survey of research initiatives in Brazil , 2013, Int. J. Medical Informatics.

[129]  Mohammad Valipour Khatir,et al.  Elucidation of structural relationships of SWOT: A mixed method approach based on FMADM for formulating science and technology strategies , 2019, Technology in Society.

[130]  Wendy L. Currie,et al.  A cross-national analysis of eHealth in the European Union: Some policy and research directions , 2014, Inf. Manag..

[131]  Cláudio de Souza,et al.  Incorporation of Telehealth Resources in Belo Horizonte's SAMU: Qualifying and Improving Care , 2009, 2009 International Conference on eHealth, Telemedicine, and Social Medicine.