Selection Bias in Comparative Research: The Case of Incomplete Data Sets

Selection bias is an important but often neglected problem in comparative research. While comparative case studies pay some attention to this problem, this is less the case in broader cross?national studies, where this problem may appear through the way the data used are generated. The article discusses three examples: studies of the success of newly formed political parties, research on protest events, and recent work on ethnic conflict. In all cases the data at hand are likely to be afflicted by selection bias. Failing to take into consideration this problem leads to serious biases in the estimation of simple relationships. Empirical examples illustrate a possible solution (a variation of a Tobit model) to the problems in these cases. The article also discusses results of Monte Carlo simulations, illustrating under what conditions the proposed estimation procedures lead to improved results.

[1]  Arend Lijphart,et al.  THRESHOLDS AND PAYOFFS IN LIST SYSTEMS OF PROPORTIONAL REPRESENTATION , 1977 .

[2]  O. Fillieule.  Police Records and the National Press in France. Issues in the Methodology of Data-Collection from Newspapers , 1996 .

[3]  G. King,et al.  Unifying Political Methodology: The Likelihood Theory of Statistical Inference , 1989 .

[4]  John O. Brehm.  The Phantom Respondents , 1993 .

[5]  Karl G. Jöreskog,et al.  Selectivity Problems in Quasi-Experimental Studies , 1983 .

[6]  D. Bloom,et al.  Correcting for Truncation Bias Caused by a Latent Truncation Variable , 1984 .

[7]  Ruth C. Silva,et al.  Making votes count , 1963 .

[8]  T. Gurr.  Minorities at risk: A global view of ethnopolitical conflicts , 1994 .

[9]  Christopher H. Achen.  The Statistical Analysis of Quasi-Experiments , 2023 .

[10]  Michael E. Alvarez,et al.  Democracy and Development: Political Institutions and Well-Being in the World, 1950–1990 , 2000 .

[11]  D. Relles,et al.  Tools for intuition about sample selection bias and its correction , 1997 .

[12]  J. Fearon.  Ethnic Structure and Cultural Diversity around the World: A Cross-National Data Set on Ethnic Groups 1 , 2002 .

[13]  John D. McCarthy,et al.  Images of protest: Dimensions of selection bias in media coverage of Washington demonstrations, 1982 and 1991 , 1996 .

[14]  S. Hug.  The emergence of new political parties from a game theoretic perspective , 1996 .

[15]  Ferdinand Müller-Rommel.  Grüne Parteien in Westeuropa , 1993 .

[16]  John D. Robertson,et al.  Formation and Success of New Parties , 1985 .

[17]  Gary Goertz,et al.  The Methodology of Necessary Conditions , 2000 .

[18]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[19]  S. Hug.  Altering party systems , 2001 .

[20]  Frank S. Cohen,et al.  Proportional Versus Majoritarian Ethnic Conflict Management in Democracies , 1997 .

[21]  S. Hug.  Studying the Electoral Success of New Political Parties , 2000 .

[22]  John O. Brehm.  The Phantom Respondents: Opinion Surveys and Political Representation , 1993 .

[23]  James D. Fearon,et al.  Counterfactuals and Hypothesis Testing in Political Science , 1991, World Politics.

[24]  W. Moore,et al.  Ethnopolitical Rebellion: A Cross-Sectional Analysis of the 1980s with Risk Assessments for the 1990s , 1997 .

[25]  Douglas Dion,et al.  Evidence and Inference in the Comparative Case StudyEvidence and Inference in the Comparative Case Study , 1998 .

[26]  G. Maddala.  Limited-dependent and qualitative variables in econometrics: Introduction , 1983 .

[27]  J. Heckman.  The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models , 1976 .

[28]  B. Geddes.  How the Cases You Choose Affect the Answers You Get: Selection Bias in Comparative Politics , 1990, Political Analysis.

[29]  Richard Breen,et al.  Regression Models: Censored, Sample Selected, or Truncated Data , 1996 .

[30]  Langche Zeng,et al.  Analyzing Censored and Sample-Selected Data with Tobit and Heckit Models , 1999, Political Analysis.

[31]  D. Relles,et al.  Theory Testing in a World of Constrained Research Design , 1990 .

[32]  Ivars Peterson,et al.  Making votes count , 1963 .

[33]  S. Hug.  Altering Party Systems: Strategic Behavior and the Emergence of New Political Parties in Western Democracies , 2001 .

[34]  Ingram Olkin,et al.  Incomplete data in sample surveys , 1985 .

[35]  Ferdinand Müller-Rommel.  Grüne Parteien in Westeuropa : Entwicklungsphasen und Erfolgsbedingungen , 1993 .

[36]  José Barranco,et al.  Validity and Systematicity of Newspaper Data in Event Analysis , 1999 .

[37]  S. Hug,et al.  Correcting for Selection Bias in Social Movement Research , 1998 .

[38]  Herbert P. Kitschelt.  Left-Libertarian Parties: Explaining Innovation in Competitive Party Systems , 1988, World Politics.

[39]  John Brehm,et al.  Alternative Corrections for Sample Truncation: Applications to the 1988, 1990, and 1992 Senate Election Studies , 1999, Political Analysis.

[40]  Ian S. Lustick.  History, Historiography, and Political Science: Multiple Historical Records and the Problem of Selection Bias , 1996, American Political Science Review.