Measuring Street Cleanliness: A Comparison of New York City’s Scorecard and Results from a Citizen Survey

Public administrators at the local level often rely on citizen surveys to measure the outcomes or accomplishments of their service delivery efforts. However, many remain skeptical about the value of survey-based measures of local government performance, in large part because of the low empirical correlation between objective and subjective performance measures reported in the literature. Using data from New York City’s street cleanliness scorecard, a well-established outcome measure, combined with responses from more than 4,000 respondents to a citizen survey, the authors find a clear and consistent correlation between the scorecard and citizen ratings of street cleanliness in their neighborhoods. Moreover, the street cleanliness scorecard is a much stronger predictor of citizen ratings than demographic factors, trust in government, or contextual effects. These results demonstrate that citizen judgments about government performance can correspond closely with more objectively measured outcomes—and that citizen surveys can provide valid and useful performance measures, at least for some local government services.

[1]  K. Webb,et al.  Obtaining Citizen Feedback: The Application of Citizen Surveys to Local Governments. , 1973 .

[2]  R. Parks Linking Objective and Subjective Measures of Performance , 1984 .

[3]  D. Swindell,et al.  Service Quality Variation across Urban Space: First Steps Toward a Model of Citizen Satisfaction , 2002 .

[4]  Brian Stipak Local Governments' Use of Citizen Surveys , 1980 .

[5]  David Swindell,et al.  Linking Citizen Satisfaction Data to Performance Measures: A Preliminary Evaluation , 2000 .

[6]  Van Ryzin,et al.  Expectations, performance, and citizen satisfaction with urban services , 2004 .

[7]  Thomas I. Miller,et al.  Citizen surveys : how to do them, how to use them, what they mean : a special report on designing, conducting, and understanding citizen surveys , 2000 .

[8]  Brian Stipak,et al.  Citizen Satisfaction With Urban Services: Potential Misuse as a Performance Indicator , 1979 .

[9]  Rodney E. Hero,et al.  Explaining Citizen Evaluations of Urban Services , 1985 .

[10]  Gregg G. Van Ryzin,et al.  Explaining the Race Gap in Satisfaction with Urban Services , 2004 .

[11]  Philip B. Coulter,et al.  Subjective and Objective Measures of Police Service Delivery , 1983 .

[12]  David Lowery,et al.  Citizen Satisfaction with Local Governance: A Test of Individual, Jurisdictional, and City-Specific Explanations , 1990, The Journal of Politics.

[13]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[14]  David Swindell,et al.  A Multiple–Indicator Approach to Municipal Service Evaluation: Correlating Performance Measurement and Citizen Satisfaction across Jurisdictions , 2002 .

[15]  Sanford Labovitz,et al.  The Assignment of Numbers to Rank Order Categories , 1970 .

[16]  M. Glaser,et al.  Local government performance through the eyes of citizens , 2000 .

[17]  Lisa M. V. Gulick,et al.  Drivers and Consequences of Citizen Satisfaction: An Application of the American Customer Satisfaction Index Model to New York City , 2004 .

[18]  G. Gibson,et al.  Some Observations on J-R Curves , 1985 .

[19]  S. Percy In Defense of Citizen Evaluations as Performance Measures , 1986 .

[20]  Jeffrey L. Brudney,et al.  Urban Policy Making and Subjective Service Evaluations: Are They Compatible? , 1982 .

[21]  Harry P. Hatry,et al.  Performance Measurement: Getting Results , 2007 .

[22]  Sanford Labovitz,et al.  Some Observations on Measurement and Statistics , 1967 .

[23]  Harry P. Hatry,et al.  How Effective Are Your Community Services?: Procedures for Measuring Their Quality , 1992 .

[24]  J. Kelly Citizen Satisfaction and Administrative Performance Measures , 2003 .

[25]  M. J. Licari,et al.  The Condition of Community Streets and Parks: A Comparison of Resident and Nonresident Evaluations , 2005 .

[26]  W. Lyons,et al.  The Politics of Dissatisfaction: Citizens, Services and Urban Institutions , 1992 .

[27]  Jae-On Kim,et al.  Multivariate Analysis of Ordinal Variables , 1975, American Journal of Sociology.

[28]  Elaine Morley,et al.  Comparative Performance Measurement , 2001 .