The Wisdom of Crowds: Learning from Administrators’ Predictions of Citizen Perceptions

Public agencies use surveys to solicit feedback from citizens and targeted customer groups, but many experts question whether the results of these surveys are valuable. This paper explores how a recent innovation in citizen surveys—asking public administrators to predict how citizens will respond to survey questions—may be used to increase that value and, at the same time, provide additional data of interest on its own account. The innovation is explored through two surveys: (1) a public opinion poll of Georgia residents conducted by the authors for the Georgia Department of Transportation in January 2004, and (2) a brief survey of that agency’s administrators asking for their predictions of public opinion. The prediction process appeared to increase the agency’s interest in the resident survey. The findings document the frequent superiority of groups—what Surowiecki terms “the wisdom of crowds”—over individuals in predicting public opinion.

[1]  Gary T. Henry,et al.  Citizen Ratings of Public and Private Service Quality: A Comparative Perspective , 1994 .

[2]  D. Swindell,et al.  The Case For The Inexperienced User , 2003 .

[3]  Brian Stipak,et al.  Citizen Satisfaction With Urban Services: Potential Misuse as a Performance Indicator , 1979 .

[4]  Evan M. Berman,et al.  Dealing with Cynical Citizens , 1997 .

[5]  Carol H. Weiss,et al.  Improving Responsiveness@@@Customer Surveys for Agency Managers: What Managers Need to Know , 1997 .

[6]  Janet M. Kelly,et al.  The Dilemma of the Unsatisfied Customer in a Market Model of Public Administration , 2005 .

[7]  Philip B. Coulter,et al.  Subjective and Objective Measures of Police Service Delivery , 1983 .

[8]  R. Parks Linking Objective and Subjective Measures of Performance , 1984 .

[9]  James Surowiecki The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations Doubleday Books. , 2004 .

[10]  Thomas I. Miller,et al.  Citizen surveys : how to do them, how to use them, what they mean : a special report on designing, conducting, and understanding citizen surveys , 2000 .

[11]  David Swindell,et al.  A Multiple–Indicator Approach to Municipal Service Evaluation: Correlating Performance Measurement and Citizen Satisfaction across Jurisdictions , 2002 .

[12]  Paul A. Sabatier,et al.  The Devil Shift: Perceptions and Misperceptions of Opponents , 1987 .

[13]  Lisa M. V. Gulick,et al.  Drivers and Consequences of Citizen Satisfaction: An Application of the American Customer Satisfaction Index Model to New York City , 2004 .

[14]  David Swindell,et al.  Linking Citizen Satisfaction Data to Performance Measures: A Preliminary Evaluation , 2000 .

[15]  Julia Melkers,et al.  What Do Administrators Think Citizens Think? Administrator Predictions as an Adjunct to Citizen Surveys. , 1998 .

[16]  Michael Quinn Patton,et al.  Utilization-Focused Evaluation , 1979 .

[17]  M. J. Licari,et al.  The Condition of Community Streets and Parks: A Comparison of Resident and Nonresident Evaluations , 2005 .