Using a Structured Approach to Evaluate ICT4D: Healthcare Delivery in Uganda

Using a case from the healthcare delivery sector, we demonstrate how a structured evaluation approach can facilitate the measurement of actual ICT contributions in various contexts. Typically, such are intricate due to the complexities inherent in the environments, making it difficult to evaluate the relationship between ICT and the benefits it intends to achieve to a reasonable degree. The approach suggested in this paper tries to partly remedy some of these complications, by facilitating qualitative data elicitations, aggregation, analysis and evaluation. To make this computationally meaningful, a decision support tool for handling numerically imprecise information is used for the data analysis and evaluation details. The results of this indicate that such an approach makes at least some meaningful input for practitioners and policymakers. In comparison to the qualitative in‐depth approaches this approach facilitates a one‐point in time assessment, which is less resource intensive, but provides prompt and substantial insight on the development performance of ICT4D initiatives. A similar approach would also be applicable to different sectors, and can utilize a broader scope of criteria, as well as incorporate views from several categories of stakeholders.

[1]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[2]  Julie Li,et al.  A Sociotechnical Approach to Evaluating the Impact of ICT on Clinical Care Environments , 2010, The open medical informatics journal.

[3]  K Hansson,et al.  A framework for evaluation of flood management strategies. , 2008, Journal of environmental management.

[4]  Helena Grunfeld,et al.  The contribution of information and communicationtechnologies for development (ICT4D) projects tocapabilities, empowerment and sustainability :a case study of iREACH in Cambodia , 2011 .

[5]  Nils Urbach,et al.  The Updated DeLone and McLean Model of Information Systems Success , 2012 .

[6]  Adam Blake,et al.  Boundary Objects to Guide Sustainable Technology‐Supported Participatory Development for Poverty Alleviation in the Context of Digital Divides , 2012, Electron. J. Inf. Syst. Dev. Ctries..

[7]  M. Denscombe The Good Research Guide: for small-scale social research projects , 1998 .

[8]  S. Manikandan,et al.  Measures of central tendency: Median and mode , 2011, Journal of pharmacology & pharmacotherapeutics.

[9]  Love Ekenberg,et al.  State-of-the-Art Prescriptive Criteria Weight Elicitation , 2012, Adv. Decis. Sci..

[10]  Caroline Malthus The good research guide: for small-scale social research projects , 2017 .

[11]  Love Ekenberg,et al.  Transparent Public Decision Making: Discussion and Case Study in Sweden , 2010 .

[12]  Love Ekenberg,et al.  The DecideIT Decision Tool , 2003, ISIPTA.

[13]  Mona Riabacke,et al.  A Prescriptive Approach to Eliciting Decision Information , 2012 .

[14]  Geoff Royston,et al.  Meeting global health challenges through operational research and management science. , 2011, Bulletin of the World Health Organization.

[15]  Florence Nameere Kivunike,et al.  Quantitative Scenario-Based Assessment of Contextual Factors for ICT4D Projects: Design and Implementation in a Web Based Tool , 2014, WorldCIST.

[16]  K. Toyama,et al.  What Constitutes Good ICTD Research , 2009 .

[17]  Silja Renooij,et al.  Evaluation of a verbal-numerical probability scale , 2003, Int. J. Approx. Reason..

[18]  Marc Nyssen,et al.  Evaluating the Impact of ICT-tools on Health Care Delivery in Sub-Saharan Hospitals , 2013, MedInfo.

[19]  Rainu Kaushal,et al.  A system dynamics evaluation model: implementation of health information exchange for public health reporting. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[20]  Joyojeet Pal,et al.  ICTD state of the union: Where have we reached and where are we headed , 2009, 2009 International Conference on Information and Communication Technologies and Development (ICTD).

[21]  James S. Dyer,et al.  Maut — Multiattribute Utility Theory , 2005 .

[22]  Robert T. Clemen,et al.  Making Hard Decisions with DecisionTools , 2013 .

[23]  Christine Nadel,et al.  Case Study Research Design And Methods , 2016 .

[24]  Robert W Snow,et al.  The effect of mobile phone text-message reminders on Kenyan health workers' adherence to malaria treatment guidelines: a cluster randomised trial , 2011, The Lancet.

[25]  Güney Gürsel,et al.  A new approach in the evaluation of hospital information systems , 2014 .

[26]  John Powell,et al.  Impacts of e-health on the outcomes of care in low- and middle-income countries: where do we go from here? , 2012, Bulletin of the World Health Organization.

[27]  Love Ekenberg,et al.  Computing upper and lower bounds in interval decision trees , 2007, Eur. J. Oper. Res..

[28]  Shahriar Akter,et al.  Development and validation of an instrument to measure user perceived service quality of mHealth , 2013, Inf. Manag..

[29]  Love Ekenberg,et al.  Distribution of expected utility in decision trees , 2007, Int. J. Approx. Reason..

[30]  Yogesh Kumar Dwivedi,et al.  Information Systems Theory: Explaining and Predicting Our Digital Society [EDITED BOOK], , 2012 .

[31]  Eddie Mukooyo,et al.  Strengthening district-based health reporting through the district health management information software system: the Ugandan experience , 2014, BMC Medical Informatics and Decision Making.

[32]  Love Ekenberg,et al.  Developing criteria for the evaluation of the ICT contribution to social and economic development , 2013 .

[33]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[34]  Love Ekenberg,et al.  Using a Software Tool for Public Decision Analysis: The Case of Nacka Municipality , 2007, Decis. Anal..

[35]  Comisión Europea,et al.  The global information society: a statistical view , 2008 .