Nominal comparability is not enough: (In-)equivalence of construct validity of cross-national measures of educational attainment in the European Social Survey

Abstract Educational attainment is a core social background variable covered in each and every survey of individuals. Since educational institutions and qualifications are difficult to compare across countries, cross-national surveys pose a particular challenge to the measurement of educational attainment. This study performs a comparative construct validation of a number of cross-national measures of education using the European Social Survey. The measures comprise two versions of the International Standard Classification of Education (ISCED), the education scheme developed in the project ‘Comparative Analysis of Social Mobility in Industrial Nations’ (CASMIN) and hypothetical as well as actual years of education . The first ISCED measure corresponds to the well-known main ISCED levels. The second one, the European Survey Version of ISCED (ES-ISCED) developed for this study, represents an effort to reflect different types of education within levels of education by considering ISCED sub-dimensions, most importantly ‘programme orientation’. Using linear regression models, it is shown how much explanatory power educational attainment loses when different cross-national variables are used, as compared to country-specific educational attainment variables (CSEVs), and how these losses vary across measures and countries. The dependent variable used for the construct validation is social status as measured by the International Socio-Economic Index (ISEI). Results suggest that harmonisation always entails some loss of explanatory power for at least a few countries. However, there are clear performance differences between the comparable measures in terms of both the average amount of losses as well as the distribution of losses across countries. The use of actual years of education as well as the levels-only ISCED strongly attenuates the education-social status association on average, but also to very different degrees across countries. CASMIN and ES-ISCED fare considerably better: they show the lowest losses of explanatory power and the lowest variation of losses across countries. Hypothetical years of education lie in between. Some practical implications are then proposed, e.g. on how to implement cross-national measures of educational attainment in international surveys.

[1]  A. Przeworski,et al.  The logic of comparative social inquiry , 1970 .

[2]  Stefani Scherer,et al.  The CASMIN Educational Classification in International Comparative Research , 2003 .

[3]  D. Treiman,et al.  The Process of Status Attainment in the United States and Great Britain , 1975, American Journal of Sociology.

[4]  A. B. Sørensen,et al.  Processes of Allocation to Open and Closed Positions in Social Structure , 1983 .

[5]  Michael Braun,et al.  Measurement of Education in Comparative Research , 1997 .

[6]  Jürgen H. P. Hoffmeyer-Zlotnik,et al.  Methodological aspects in cross-national research , 2005 .

[7]  Silke L. Schneider.  Confusing credentials: the cross-nationally comparable measurement of educational attainment , 2009 .

[8]  Peter M. Blau,et al.  The American Occupational Structure , 1967 .

[9]  Y. Shavit,et al.  From school to work: a comparative study of educational qualifications and occupational destinations , 1999 .

[10]  Harry B. G. Ganzeboom,et al.  Internationally Comparable Measures of Occupational Status for the 1988 International Standard Classification of Occupations , 1996 .

[11]  D. Treiman.  Occupational Prestige in Comparative Perspective , 1977 .

[12]  Scientific.  International Standard Classification of Education, ISCED 1997 , 2003 .

[13]  W. Müller.  Education and Youth Integration into European Labour Markets , 2005 .

[14]  D. Weakliem.  The Effects of Education on Political Opinions: An International Study , 2002 .

[15]  Jürgen H. P. Hoffmeyer-Zlotnik,et al.  Advances in cross-national comparison : a European working book for demographic and socio-economic variables , 2003 .

[16]  A. C. Kerckhoff,et al.  Problems with international measures of education , 1999 .

[17]  P. Scheepers,et al.  Education, Religiosity and Moral Attitudes: Explaining Cross-National Effect Differences , 2002 .

[18]  D. Treiman,et al.  Educational Expansion and Educational Achievement in Comparative Perspective , 2003 .

[19]  Walter Müller,et al.  Schein oder Sein: Bildungsdisparitäten in der europäischen Statistik. Eine Illustration am Beispiel Deutschlands , 2008 .

[20]  M. Huisman,et al.  Health inequalities according to educational level in different welfare regimes: a comparison of 23 European countries. , 2008, Sociology of health & illness.

[21]  H. Domański,et al.  EDUCATIONAL HOMOGAMY IN 22 EUROPEAN COUNTRIES , 2007 .

[22]  R. Wong.  Stratification in Higher Education: A Comparative Study , 2008 .

[23]  Herbert L. Smith,et al.  Scaling via Models for the Analysis of Association: Social Background and Educational Careers in France , 1987 .

[24]  Silke L. Schneider.  Measuring Educational Attainment in Cross-National Surveys : The Case of the European Social Survey ∗ , 2007 .

[25]  Andreas Schleicher,et al.  Piaac: A New Strategy for Assessing Adult Competencies , 2008 .

[26]  R. Luijkx,et al.  Nonpersistent Inequality in Educational Attainment: Evidence from Eight European Countries1 , 2009, American Journal of Sociology.

[27]  K. Slomczynski,et al.  Systems of Distribution and a Sense of Equity: A Multilevel Analysis of Meritocratic Attitudes in Post-industrial Societies , 2007 .

[28]  S. Steinmann,et al.  Educational reform in France, West-Germany and the United Kingdom: updating the CASMIN educational classification , 1999 .

[29]  Silke L. Schneider.  The International Standard Classification of Education (ISCED-97) : An Evaluation of Content and Criterion Validity for 15 European Countries , 2008 .

[30]  J. Smyth,et al.  The Origins of the International Standard Classification of Education , 2008 .

[31]  N. Dragano,et al.  Education and health in 22 European countries. , 2006, Social science & medicine.

[32]  D. Treiman,et al.  A standard international socio-economic index of occupational status , 1992 .

[33]  M. Kohn,et al.  Cross-national research in sociology , 1989 .

[34]  J. Goldthorpe,et al.  Intergenerational Class Mobility in Three Western European Societies: England, France and Sweden , 1979 .

[35]  J. Goodman.  The Economic Returns of Education: An Assessment of Alternative Models. , 1979 .

[36]  Harley Frazis.  Human capital, signaling, and the pattern of returns to education , 2002 .

[37]  E. Saar,et al.  Transition from Educational System to Labour Market in the European Union , 2008 .

[38]  Jürgen H. P. Hoffmeyer-Zlotnik,et al.  Measuring Demographic and Socio-Economic Variables in Cross-National Research , 2003 .

[39]  John H. Goldthorpe,et al.  The Constant Flux: A Study of Class Mobility in Industrial Societies. , 1993 .

[40]  H. Blossfeld,et al.  Persistent Inequality: Changing Educational Attainment in Thirteen Countries , 1994 .

[41]  A. C. Kerckhoff,et al.  Toward an Improved Measure of Educational Attainment in Social Stratification Research , 2002 .

[42]  Anthony F. Heath,et al.  THE GLOBALIZATION OF PUBLIC OPINION RESEARCH , 2005 .