Quantifying the Data Deluge and the Data Drought

The world’s big data capacity can be understood in terms of the world’s storage capacity, and the telecommunication capacity to access this storage (‘the cloud’). In order to do this we mainly follow the methodology of what has become the standard reference in estimating the world’s technological information capacity: Hilbert and Lopez (2011). This methodology has been adopted by others, including by the 2012 ITU report on “Measuring the Information Society” (Chapter 5; ITU, 2012). It shows that the world’s technological capacity to store information has increased with a compound annual growth rate of 31 % during the three decades between 1986 and 2014 (from 2.6 exabytes to 4.6 zettabytes), while the world’s installed telecommunication capacity has grown with a compound annual growth rate of 35 % during the same period, from 7.5 petabites to 25 exabits).

[1]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[2]  David Clark,et al.  Understanding Broadband Speed Measurements , 2010 .

[3]  Martin Hilbert,et al.  Info Capacity| How to Measure the World’s Technological Capacity to Communicate, Store and Compute Information? Part I: Results and Scope , 2012 .

[4]  Martin Hilbert,et al.  How much of the global information and communication explosion is driven by more, and how much by better technology? , 2014, J. Assoc. Inf. Sci. Technol..

[5]  Martin Hilbert,et al.  A review of large-scale 'How much information?' inventories: variations, achievements and challenges , 2015, Inf. Res..

[6]  Martin Hilbert,et al.  How to Measure "How Much Information"? Theoretical, Methodological, and Statistical Challenges for the Social Sciences Introduction , 2012 .

[7]  Lennard G. Kruger,et al.  The National Broadband Plan , 2010 .

[8]  Wang-Bae Kim,et al.  The Adoption and Use of the Internet in South Korea , 2006, J. Comput. Mediat. Commun..

[9]  Martin Hilbert,et al.  How much information is there in the “information society”? , 2012 .

[10]  Martin Hilbert,et al.  The World’s Technological Capacity to Store, Communicate, and Compute Information , 2011, Science.

[11]  Martin Hilbert,et al.  What Is the Content of the World's Technologically Mediated Information and Communication Capacity: How Much Text, Image, Audio, and Video? , 2014, Inf. Soc..

[12]  Martin Hilbert,et al.  Technological information inequality as an incessantly moving target: The redistribution of information and communication capacities between 1986 and 2010 , 2014, J. Assoc. Inf. Sci. Technol..

[13]  Martin Hilbert,et al.  Info Capacity| How to Measure the World’s Technological Capacity to Communicate, Store and Compute Information? Part II: Measurement Unit and Conclusions , 2012 .