Conceptualizing and Measuring Democracy

A comprehensive and integrated framework for the analysis of data is offered and used to assess data sets on democracy. The framework first distinguishes among three challenges that are sequentially addressed: conceptualization, measurement, and aggregation. In turn, it specifies distinct tasks associated with these challenges and the standards of assessment that pertain to each task. This framework is applied to the data sets on democracy most frequently used in current statistical research, generating a systematic evaluation of these data sets. The authors’ conclusion is that constructors of democracy indices tend to be quite self-conscious about methodological issues but that even the best indices suffer from important weaknesses. More constructively, the article’s assessment of existing data sets on democracy identifies distinct areas in which attempts to improve the quality of data on democracy might fruitfully be focused.

[1]  R. J. Mokken,et al.  A Theory and Procedure of Scale Analysis: With Applications in Political Research , 1971 .

[2]  Stephen K. White,et al.  Between Facts and Norms: Contributions to a Discourse Theory of Law and Democracy@@@The Cambridge Companion to Habermas , 1997 .

[3]  R. Gastil,et al.  The Comparative Survey of Freedom: Experiences and Suggestions , 1990 .

[4]  Michael Saward,et al.  The Terms of Democracy , 1991 .

[5]  Michael Coppedge,et al.  Measuring Polyarchy , 1990 .

[6]  J. Foweraker,et al.  Measuring Liberal Democratic Performance: An Empirical and Conceptual Critique , 2000 .

[7]  Kenneth A. Bollen,et al.  Liberal Democracy: Validity and Method Factors in Cross-National Measures , 1993 .

[8]  Friedrich A. von Hayek,et al.  The Constitution of Liberty , 1961 .

[9]  Kenneth A. Bollen,et al.  Political Democracy: Conceptual and Measurement Traps , 1990 .

[10]  T. Vanhanen,et al.  Prospects of Democracy: A study of 172 countries , 1984 .

[11]  A. Abbott.  Sequence analysis: new methods for old ideas , 1995 .

[12]  Frank J. Goodnow,et al.  The rise and growth of American politics , 1899 .

[13]  T. Landman.  Issues and Methods in Comparative Politics: An Introduction , 2000 .

[14]  A. Przeworski,et al.  The logic of comparative social inquiry , 1970 .

[15]  M. Gasiorowski,et al.  An Overview of the Political Regime Change Dataset , 1996 .

[16]  Zachary Elkins,et al.  Gradations of Democracy? Empirical Tests of Alternative Conceptualizations , 2000 .

[17]  S. Huntington.  The Third Wave: Democratization in the Late Twentieth Century , 1991 .

[18]  J. Schumpeter.  Capitalism, Socialism and Democracy , 1943 .

[19]  William G. Jacoby.  Data Theory and Dimensional Analysis , 1991 .

[20]  Ted Robert Gurr,et al.  Transitions to Democracy: Tracking Democracy''s Third Wave with the Polity III Data , 1996 .

[21]  Michael D. Ward,et al.  Double Take , 1997 .

[22]  H. Pitkin.  The Concept of Representation , 1969 .

[23]  W. B. Gallie.  Essentially Contested Concepts , 1994, The Importance of Language.

[24]  Kenneth A. Bollen,et al.  Issues in the Comparative Measurement of Political Democracy , 1980 .

[25]  R. Dahl.  A Preface to Democratic Theory , 1956 .

[26]  David Collier,et al.  DEMOCRACY AND DICHOTOMIES: A Pragmatic Approach to Choices about Concepts , 1999 .

[27]  J. Mackie,et al.  The Conduct of Inquiry: Methodology for Behavioural Science , 1965 .

[28]  William G. Jacoby.  Levels of measurement and political research: An optimistic view , 1999 .

[29]  J. Austin Ranney.  The Doctrine of Responsible Party Government, Its Origins and Present State. , 1982 .

[30]  Gretchen Casper,et al.  Correlation Versus Interchangeability: The Limited Robustness of Empirical Findings on Democracy Using Highly Correlated Data Sets , 2003, Political Analysis.

[31]  A. Hadenius.  Democracy and Development , 1992 .

[32]  J. Bohman,et al.  Survey Article: The Coming of Age of Deliberative Democracy , 1998 .

[33]  D. Collier,et al.  Measurement Validity: A Shared Standard for Qualitative and Quantitative Research , 2001, American Political Science Review.

[34]  C. George Benello,et al.  The Case for Participatory Democracy: Some Prospects for a Radical Society , 1972 .

[35]  Sven Steinmo,et al.  Structuring politics : historical institutionalism in comparative analysis , 1992 .

[36]  Kenneth A. Bollen,et al.  Political Rights and Political Liberties in Nations: An Evaluation of Human Rights Measures, 1950 to 1984 , 1986 .

[37]  Michael Coppedge,et al.  Thickening Thin Concepts and Theories: Combining Large N and Small in Comparative Politics , 1999 .

[38]  Kenneth A. Bollen,et al.  Subjective Measures of Liberal Democracy , 2000 .

[39]  Z. F. Arat,et al.  Democracy and human rights in developing countries , 1991 .

[40]  Arend Lijphart.  Patterns of Democracy , 1999 .

[41]  Michael Bernhard,et al.  Economic Performance, Institutional Intermediation, and Democratic Survival , 2001, The Journal of Politics.

[42]  José Antonio Cheibub,et al.  Classifying political regimes , 1996 .

[43]  R. Dahl,et al.  Democracy and Its Critics , 1990 .

[44]  Frank J. Goodnow,et al.  Politics and administration , 1900 .

[45]  Axel Hadenius,et al.  Democracy and Development by Axel Hadenius , 1992 .

[46]  Stephen L. Elkin.  Democracy and Deliberation: New Directions for Democratic Reform , 1991 .

[47]  James Mahoney,et al.  Comparative Historical Analysis in the Social Sciences , 2004, Perspectives on Politics.

[48]  Terry Nichols Clark,et al.  The New Political Culture , 1998 .

[49]  Louis Guttman,et al.  Louis Guttman on theory and methodology : selected writings , 1994 .

[50]  Ian Shapiro,et al.  The State of Democratic Theory , 2003 .

[51]  Benjamin R. Barber,et al.  The Conquest of Politics: Liberal Philosophy in Democratic Times , 1989, American Political Science Review.

[52]  David Beetham,et al.  Defining and measuring democracy , 1994 .

[53]  T. Vanhanen.  A New Dataset for Measuring Democracy, 1810-1998 , 2000 .

[54]  C. B. Macpherson,et al.  The life and times of liberal democracy , 1978 .

[55]  L. Guttman.  What is Not What in Statistics , 1977 .

[56]  David Beetham,et al.  Democracy and Human Rights , 1999 .

[57]  Will H. Moore,et al.  The Transformation of the Western State: The Growth of Democracy, Autocracy, and State Power Since 1800 , 1990 .

[58]  J. Pocock,et al.  The Machiavellian Moment: Florentine Political Thought and the Atlantic Republican Tradition . By Pocock J. G. A.. (Princeton, N.J.: Princeton University Press, 1975. Pp. 602. $22.50, cloth; $11.50, paper.) , 1977 .