Impact Assessment of ICT-for-Development Projects: A Compendium of Approaches

Billions of US dollars are invested each year by the public, NGO and private sectors in information-and-communication-technologies-for-development (ICT4D) projects such as telecentres, village phone schemes, e-health and e-education projects, e-government kiosks, etc.Yet we have very little sense of the effect of that investment. Put simply, there is far too little impact assessment of ICT4D projects.In part that reflects a lack of political will and motivation. But in part it also reflects a lack of knowledge about how to undertake impact assessment of ICT4D.This Compendium aims to address that lack of knowledge. It presents a set of frameworks that can be used by ICT4D practitioners, policy-makers and consultants to understand the impact of informatics initiatives in developing countries.The Compendium is arranged into three parts:Overview ? explains the basis for understanding impact assessment of ICT4D projects, and the different assessment frameworks that can be used.Frameworks ? summarises a series of impact assessment frameworks, each one drawing from a different perspective.Bibliography ? a tabular summary of real-world examples of ICT4D impact assessment.

[1]  R. Duncombe.  Using the Livelihoods Framework to Analyze ICT Applications for Poverty Reduction through Microenterprise , 2007 .

[2]  K. G. Rajalekshmi.  E-governance services through telecenters: The role of human intermediary and issues of trust , 2007 .

[3]  David Brown,et al.  Managing Project-Based IS Initiatives in the Vocational and Technical Education Sector of Developing Asian Countries: A Soft Systems Approach to Identifying the Role of Information and Information Systems , 2007, AMCIS.

[4]  Hannah Beardon,et al.  ICT for development: Empowerment or exploitation? , 2004 .

[5]  Jakob Svensson,et al.  The Power of Information: Evidence from a Newspaper Campaign to Reduce Capture , 2004 .

[6]  C. Avgerou.  Recognising Alternative Rationalities in the Deployment of Information Systems , 2000, Electron. J. Inf. Syst. Dev. Ctries..

[7]  Stan Karanasios,et al.  Exploring the Internet Use of Small Tourism Enterprises: Evidence from a Developing Country , 2006, Electron. J. Inf. Syst. Dev. Ctries..

[8]  Roberto Hernandez and Yerina Mugica.  What Works: PRODEM FFP's multilingual smart ATMs for microfinance , 2003 .

[9]  Michael L. Best,et al.  Social Impact and Diffusion of Telecenter Use: A Study from the Sustainable Access in Rural India Project , 2007, J. Community Informatics.

[10]  L. Lefebvre,et al.  Information and telecommunication technologies : the impact of their adoption on small and medium sized enterprises , 1996 .

[11]  R. Overå.  Networks, distance, and trust: Telecommunications Development and changing trading practices in Ghana , 2006 .

[12]  Shafika Isaacs,et al.  The NEPAD e-Schools Demonstration Project: A Work in Progress: A Public Report , 2007 .

[13]  Georgios A. Dafoulas,et al.  Investigating Cultural Differences in Virtual Software Teams , 2002, Electron. J. Inf. Syst. Dev. Ctries..

[14]  Ricardo Ramirez,et al.  Measuring the impact of telecommunication services on rural and remote communities , 2005 .

[15]  Richard Heeks,et al.  Development Informatics Working Paper Series Failure, Success and Improvisation of Information Systems Projects in Developing Countries A. Introduction: Defining and Measuring Success and Failure.....................................2 C. Explaining Developing Country Information Systems Success and F , 2022 .

[16]  Michele Cocchiglia,et al.  Regional Information Centres in Azerbaijan: A Preliminary Evaluation , 2004, Electron. J. Inf. Syst. Dev. Ctries..

[17]  Richard Heeks,et al.  Researching ICT-Based Enterprise for Women in Developing Countries: A Gender Perspective , 2010 .

[18]  London WC2A 2AE , 2000 .

[19]  J. Bertrand,et al.  Systematic review of the effectiveness of mass communication programs to change HIV/AIDS-related behaviors in developing countries. , 2005, Health education research.

[20]  S. Cummings,et al.  Gender and ICTs for Development: A Global Sourcebook , 2005 .

[21]  N. Scott,et al.  The Economic Impact of Telecommunications on Rural Livelihoods and Poverty Reduction: a Study of Rural Communities in India (Gujarat), Mozambique and Tanzania. Summary Report. , 2005 .

[22]  Yingqin Zheng,et al.  Inequality of what? Social exclusion in the e-society as capability deprivation , 2008, Inf. Technol. People.

[23]  Liwen Vaughan,et al.  The Contribution of Information to Business Success: A LISREL Model Analysis of Manufacturers in Shanghai , 1999, Inf. Process. Manag..

[24]  Chat Garcia Ramilo,et al.  Gender evaluation methodology for internet and ICTs : a learning tool for change and empowerment [Arabic version] , 2005 .

[25]  Ali Ndiwalana,et al.  ICT usage and its impact on profitability of SMEs in 13 African Countries , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[26]  Anand Chand,et al.  The impact of ICT on rural development in Solomon Islands: the PFnet case , 2005 .

[27]  C. Soriano.  Exploring the ICT and Rural Poverty Reduction Link: Community Telecenters and Rural Livelihoods in Wu'an, China , 2007, Electron. J. Inf. Syst. Dev. Ctries..

[28]  Bryan Hattingh,et al.  The competitive advantage , 2007 .

[29]  Shirin Madon.  Evaluating e-governance projects in India: a focus on micro-level implementation , 2005 .

[30]  Leigh L. Linden,et al.  Computer-assisted learning: Evidence from a randomized experiment , 2011 .

[31]  Odame Hh,et al.  Gender and ICTs for development: a global sourcebook. , 2005 .

[32]  A. Whyte.  Telecentre research framework for Acacia , 1998 .

[33]  Richard Heeks.  Sustainability and the Future of eDevelopment , 2005 .

[34]  Patricia G. Lange.  :The Cell Phone: An Anthropology of Communication , 2007 .

[35]  Paul Ulrich.  Poverty Reduction Through Access to Information and Communication Technologies in Rural Areas: An Analysis of the Survey Results from the Social Impact Assessment Conducted by the Chinese Ministry of Science & Technology and the United Nations Development Program: , 2004, Electron. J. Inf. Syst. Dev. Ctries..

[36]  Michel J. Menou,et al.  Measuring the Impact of Information on Development , 1993 .

[37]  Richard Heeks,et al.  Using Competitive Advantage Theory to Analyze IT Sectors in Developing Countries: A Software Industry Case Analysis , 2007 .

[38]  Craig Standing,et al.  An interpretive approach to evaluating information systems: A content, context, process framework , 2006, Eur. J. Oper. Res..

[39]  Radha Vasudevan,et al.  Changed governance or computerized governance? Computerized property transfer processes in Tamil Nadu (India) , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[40]  Wendy Griswold,et al.  Glamour and Honor: Going Online and Reading in West African Culture , 2007 .

[41]  D. Richardson,et al.  Grameen Telecom’s Village Phone Programme in Rural Bangladesh: a Multi-Media Case Study Final Report , 2000 .

[42]  Dániel Füleki,et al.  The Cserénfa experiment , 2006, J. Community Informatics.

[43]  Gail Ridley,et al.  A Preliminary Evaluation of Online Access Centres: Promoting Micro E‐Business Activity in Small, Isolated Communities , 2001 .

[44]  Rahul De.  The Impact of Indian E-Government Initiatives , 2006 .

[45]  Susanne Schech,et al.  Wired for change: the links between ICTs and development discourses , 2002 .

[46]  Susie Jolly,et al.  Supporting resources collection , 2004 .

[47]  Dominique Meekers,et al.  The impact on condom use of the "100% Jeune" social marketing program in Cameroon. , 2005, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[48]  R. Gómez,et al.  Comparing Approaches: Telecentre Evaluation Experiences in Asia and Latin America , 2001, Electron. J. Inf. Syst. Dev. Ctries..

[49]  Erwin A. Alampay.  Analysing Socio‐Demographic Differences in the Access & Use of ICTs in the Philippines Using the Capability Approach , 2006, Electron. J. Inf. Syst. Dev. Ctries..

[50]  Richard Heeks,et al.  Researching ICT-Based Enterprise in Developing Countries: Analytical Tools and Models , 2008 .

[51]  Joyojeet Pal,et al.  Rural Telecenter Impact Assessments and the Political Economy of ICT of Development (ICT4D) - eScholarship , 2005 .

[52]  Paul S. Licker,et al.  A Gift from the Gods? Components of Information Technological Fatalism, Determinism in Several Cultures , 2002, Electronic Journal of Information Systems in Developing Countries.

[53]  W M,et al.  Table of Contents , 2020 .

[54]  Jean Tague-Sutcliffe,et al.  Measuring the impact of information on development: a LISREL-based study of small businesses in Shanghai , 1997 .

[55]  Ritu Dangwal,et al.  A Model of How Children Acquire Computing Skills from Hole-in-the-Wall Computers in Public Places , 2005 .

[56]  Sidney Ruth Schuler,et al.  Rural credit programs and women's empowerment in Bangladesh , 1996 .

[57]  Stein Kristiansen,et al.  A Rural‐Urban Digital Divide? , 2007, Electron. J. Inf. Syst. Dev. Ctries..

[58]  Kuttayan Annamalai and Sachin Rao.  What Works: ITC's E-Choupal and Profitable Rural Transformation , 2003 .

[59]  J. Donner.  Microentrepreneurs and Mobiles: An Exploration of the Uses of Mobile Phones by Small Business Owners in Rwanda , 2004 .

[60]  Alemayehu Molla,et al.  Evaluating digital inclusion projects: a livelihood approach , 2007, Int. J. Knowl. Learn..

[61]  Norma L. Miller.  Measuring the Contribution of Infoplazas to Internet Penetration and Use in Panama , 2004 .

[62]  Sarah Parkinson,et al.  Using a Sustainable Livelihoods Approach to Assessing the Impact of ICTs in Development , 2007, J. Community Informatics.

[63]  Richard Heeks,et al.  Benchmarking eGovernment: Improving the National and International Measurement, Evaluation and Comparison of eGovernment , 2008 .

[64]  A. Janvry,et al.  The Impact of Farmer Field Schools on Knowledge and Productivity: A Study of Potato Farmers in the Peruvian Andes , 2003, Economic Development and Cultural Change.

[65]  M. Porter.  How Competitive Forces Shape Strategy , 1989 .

[66]  Thomas Molony,et al.  ‘I Don’t Trust the Phone; It Always Lies’ , 2007 .

[67]  Richard Heeks,et al.  Information Systems for Public Sector Management Working Paper Series Why Health Care Information Systems Succeed or Fail Why Health Care Information Systems Succeed or Fail , 2022 .

[68]  Harekrishna Misra,et al.  Citizen Centric ICT Initiatives for Rural Development in Indian Context: A Framework , 2006, AMCIS.

[69]  Michael L. Best,et al.  Comparing Urban and Rural Telecenters Costs , 2001, Electron. J. Inf. Syst. Dev. Ctries..

[70]  Sundeep Sahay,et al.  Participation through communicative action: A case study of GIS for addressing land/water development in India , 2003 .

[71]  Jonathan Miller,et al.  Monitoring and Evaluation of ICT in Education Projects A Handbook for Developing Countries , 2005 .

[72]  Birgitte Jallov,et al.  Assessing community change: development of a ‘bare foot’ impact assessment methodology , 2005 .

[73]  Akhtar Badshah,et al.  Connected for development : information kiosks and sustainability , 2005 .

[74]  Lawrence R. Frey,et al.  Communication for Social Change , 2007 .

[75]  M. Porter,et al.  The Competitive Advantage of Nations. , 1990 .

[76]  P. Hunt.  True Stories: Telecentres in Latin America & the Caribbean , 2001, Electron. J. Inf. Syst. Dev. Ctries..