Towards an integrated analysis of bias in cross-cultural assessment

A central methodological aspect of cross-cultural assessment is the interpretability of intergroup differences: Do scores obtained by subjects from different cultural groups have the same psychological meaning? Equivalence (or the absence of bias) is required in making valid cross-cultural comparisons. As cross-cultural comparisons are becoming increasingly popular and important, the problem of bias and its detection is receiving increased attention from researchers. Three kinds of bias are discussed and illustrated, namely construct bias, method bias, and item bias (or differential item functioning). Methods to identify bias are reviewed. An overview is given of common sources of each kind of bias. It is argued that an integrated treatment of all forms of bias is needed to enhance the validity of cross-cultural comparisons. The predominant focus on item bias techniques has the unfortunate implication that construct and method bias are examined insufficiently.

[1]  Norman S. Endler,et al.  Interactional psychology and personality , 1976 .

[2]  H. Triandis Basic Research in the Context of Applied Research in Personality and Social Psychology , 1978 .

[3]  R. Serpell How specific are perceptual skills? A cross-cultural study of pattern reproduction. , 1979, British journal of psychology.

[4]  Hilda Wing Practice Effects with Traditional Mental Test Items , 1980 .

[5]  Comparison of Procedures for Detecting test-Item Bias with both Internal and External Ability Criteria , 1981 .

[6]  B. Whiting,et al.  Handbook of cross-cultural human development , 1981 .

[7]  G. J. Mellenbergh Contingency Table Models for Assessing Item Bias , 1982 .

[8]  R. Sternberg Implicit theories of intelligence. creativity, and wisdom , 1985 .

[9]  Roy S. Malpass,et al.  Making inferences from cross-cultural data. , 1986 .

[10]  M. Daal,et al.  The Trainuility of Formal Thinking: A Cross-Cultural Comparison , 1986 .

[11]  Dorothy T. Thayer,et al.  Differential Item Performance and the Mantel-Haenszel Procedure. , 1986 .

[12]  I. M. Kendall,et al.  Human abilities in cultural context: Test performance of blacks in Southern Africa , 1988 .

[13]  J. Berry,et al.  Human abilities in cultural context: Cultural responses to ability measurement , 1988 .

[14]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[15]  Harry C. Triandis,et al.  Effects of Culture and Response Format on Extreme Response Style , 1989 .

[16]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[17]  Y. Poortinga,et al.  Testing Across Cultures , 1991 .

[18]  R. Hambleton Advances in the Detection of Differentially Functioning Test Items. , 1993 .

[19]  Journeys into cross-cultural psychology : Selected papers from the eleventh international conference of the International Association for Cross-Cultural Psychology held in Liège, Belgium , 1994 .

[20]  H. Wainer,et al.  Differential Item Functioning. , 1994 .

[21]  Fons J. R. Vijver,et al.  Item bias : Where psychology and methodology meet , 1994 .

[22]  Pamela Ramser,et al.  Journeys into cross-cultural psychology , 1994 .

[23]  R. Hambleton Guidelines for adapting educational and psychological tests: A progress report. , 1994 .

[24]  A Bibliometric Analysis of the Journal of Cross-Cultural Psychology , 1995 .

[25]  R. Serpell,et al.  Robert Serpell. The Significance of Schooling: Life-Journeys in an African Society . Cambridge: Cambridge University Press, 1993. xv + 345 pp. Illustrations. Tables. Figures. Appendices. Chapter Notes. Bibliography. Index. Maps. $59.95. Cloth. , 1995, African Studies Review.

[26]  David Y. F. Ho,et al.  Filial piety and its psychological consequences. , 1996 .

[27]  F.J.R. van de Vijver,et al.  Methods and Data Analysis for Cross-Cultural Research , 1997 .