Sorry, Wrong Number: The Use and Misuse of Numerical Facts in Analysis and Media Reporting of Energy Issues*

▪ Abstract Students of public policy sometimes envision an idealized policy process where competent data collection and incisive analysis on both sides of a debate lead to reasoned judgments and sound decisions. Unfortunately, numbers that prove decisive in policy debates are not always carefully developed, credibly documented, or correct. This paper presents four widely cited examples of numbers in the energy field that are either misleading or wrong. It explores the origins of these numbers, how they missed the mark, and how they have been misused by both analysts and the media. In addition, it describes and uses a three-stage analytical process for evaluating such statistics that involves defining terms and boundaries, assessing underlying data, and critically analyzing arguments.

[1]  Bruce Nordman,et al.  Electricity used by office equipment and network equipment in the US , 2002 .

[2]  Ernst Worrell Turning Numbers into Knowledge, Mastering the Art of Problem Solving , 2002 .

[3]  S. Swaminathan,et al.  Review of power quality applications of energy storage systems , 1997 .

[4]  End Use Annual energy review , 1984 .

[5]  T. S. Perry Fueling the Internet [computer power consumption] , 2001 .

[6]  Ann H. Carlson Power Struggle , 1968, Nature.

[7]  Cobb Wm,et al.  The Power of Growth. , 1964 .

[8]  M. Blazek,et al.  Tale of two cities: environmental life cycle assessment for telecommunications systems: Stockholm, Sweden and Sacramento, CA , 1999, Proceedings of the 1999 IEEE International Symposium on Electronics and the Environment (Cat. No.99CH36357).

[9]  Math Bollen,et al.  Understanding Power Quality Problems: Voltage Sags and Interruptions , 1999 .

[10]  Joseph H. Eto,et al.  Efficiency improvements in US Office equipment: Expected policy impacts and uncertainties , 1995 .

[11]  John L. Read,et al.  Factors affecting pitfall capture rates of small ground vertebrates in arid South Australia. I. The influence of weather and moon phase on capture rates of reptiles , 2001 .

[12]  Richard E. Brown,et al.  Energy Use and Power Levels in New Monitors and Personal Computers , 2002 .

[13]  Richard F. Mast,et al.  Resource appraisal of undiscovered oil and gas resources in the William O. Douglas Arctic Wildlife Range , 1980 .

[14]  C.A. Forbes,et al.  The solid fuel-cell future , 1993, IEEE Spectrum.

[15]  B. Hayes American Scientist , 1988 .

[16]  Jonathan G. Koomey,et al.  Electricity Use in California: Past Trends and Present Usage Patterns , 2003 .

[17]  W. Wayt Gibbs the arctic oil & wildlife refuge. , 2001 .

[18]  Carrie A. Webber,et al.  Scoping study on trends in the economic value of electricity reliability to the U.S. economy , 2001 .

[19]  A. Christiansen,et al.  Arctic National Wildlife Refuge, Alaska, coastal plain resource assessment : report and recommendation to the Congress of the United States and final legislative environmental impact statement , 1987 .

[20]  Richard E. Brown,et al.  Electricity used by office equipment and network equipment in the U.S.: Detailed report and appendices , 2001 .

[21]  Sumner Starrfield,et al.  The long hot summer , 1990, Nature.

[22]  Joel Best,et al.  Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists , 2001 .

[23]  Anwr Assessment Team The oil and gas resource potential of the Arctic National Wildlife Refuge 1002 Area, Alaska , 1999 .

[24]  J. Osborn,et al.  Reliability of the U.S. electric system -- Recent trends and current issues , 2002 .

[25]  Carol Warrell,et al.  Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists , 2003 .

[26]  W M Cobb The Power of Growth. , 1964, Journal of the National Medical Association.

[27]  J. Koomey Rebuttal to testimony on 'Kyoto and the internet: The energy implications of the digital economy' - eScholarship , 2000 .