Transparent Estimation of Internet Penetration from Network Observations

The International Telecommunications Union (ITU) and the Organization for Economic Cooperation and Development (OECD) provide Internet penetration statistics, which are collected from official national sources worldwide, and they are widely used to inform policy-makers and researchers about the expansion of digital technologies. Nevertheless, these statistics are derived with methodologies, which are often opaque and inconsistent across countries. Even more, regimes may have incentives to misreport such statistics. In this work, we make a first attempt to evaluate the consistency of the ITU/OECD Internet penetration statistics with an alternative indicator of Internet penetration, which can be measured with a consistent methodology across countries and relies on public data. We compare, in particular, the ITU and OECD statistics with measurements of the used IPv4 address space across countries and find very high correlations ranging between 0.898 and 0.978 for all years between 2006 and 2010. We also observe that the level of consistency drops for less developed or less democratic countries. Besides, we show that measurements of the used IPv4 address space can serve as a more timely Internet penetration indicator with sub-national granularity, using two large developing countries as case studies.

[1]  K. Gleditsch,et al.  Expanded Trade and GDP Data , 2002 .

[2]  Michael L. Best,et al.  The Internet and Democracy , 2009 .

[3]  Banji Oyelaran-Oyeyinka,et al.  Internet diffusion in sub-Saharan Africa: A cross-country analysis , 2005 .

[4]  Rodrigo Garcia-Verdú,et al.  Poor Numbers: How We Are Misled by African Development Statistics and What to Do about It , 2013 .

[5]  kc claffy,et al.  Geocompare: a comparison of public and commercial geolocation databases - Technical Report , 2011 .

[6]  Alberto Dainotti,et al.  Errata for: Estimating internet address space usage through passive measurements (SIGCOMM CCR (Vol. 44, Issue 1, January, 2014) , 2014, CCRV.

[7]  Nils B. Weidmann,et al.  Empowering activists or autocrats? The Internet in authoritarian regimes , 2015 .

[8]  Kristian Skrede Gleditsch,et al.  The Geography of the International System: The CShapes Dataset , 2010 .

[9]  L. Röller,et al.  Telecommunications Infrastructure and Economic Development: a Simultaneous Approach Forschungsschwerpunkt Marktprozeß Und Unter- Nehmensentwicklung Research Area Market Processes and Corporate Development Abstract Telecommunications Infrastructure and Economic Development: a Simultaneous Approach * , 1996 .

[10]  M. Mittelmark Millenium Development Goals. , 2009, Global health promotion.

[11]  W. Lehr,et al.  Running on Empty: The Challenge of Managing Internet Addresses , 2008 .

[12]  H. Milner The Digital Divide , 2006 .

[13]  J. Groshek The Democratic Effects of the Internet, 1994—2003 , 2009 .

[14]  Keegan W. Wade,et al.  The Internet and Democracy: Global Catalyst or Democratic Dud? , 2005 .

[15]  M. Getz NATIONAL RESEARCH AND EDUCATION NETWORK , 1990 .