Measurement equivalence in the conduct of a global organizational survey across countries in six cultural regions

This study examined the measurement equivalence of a global organizational survey measuring six work climate factors as administered across 25 countries (N = 31, 315) in all regions of the world (West Europe, East Europe, North America, Latin America, South America, Middle East, Africa and Asia-Pacific). Across all countries, the survey instrument exhibited 'form equivalence' and 'metric equivalence', suggesting that respondents completed the survey using the same frame-of-reference and interpreted the rating scale intervals similarly. Schwartz's (1994, 1999, 2004) cultural value theory was then used for grouping the countries in cultural regions, and to anticipate measurement equivalence of the data from the survey within and between these regions. Results showed partial support for Schwartz's theory. The English-speaking region was the only region where empirical evidence for 'scalar equivalence' was found. No support was found for the prediction that measurement equivalence would be higher among countries that are part of cultural regions with a small cultural distance than among countries that are part of cultural regions with a large cultural distance. However, the use of a common language in a particular cultural region reduced the bias present in the cross-country comparison within that region.

[1]  James K. Harter,et al.  Business-unit-level relationship between employee satisfaction, employee engagement, and business outcomes: a meta-analysis. , 2002, The Journal of applied psychology.

[2]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[3]  J. Slocum,et al.  Do cultural differences affect job satisfaction , 1971 .

[4]  Fritz Drasgow,et al.  Applications of item response theory to analysis of attitude scale translations. , 1982 .

[5]  Bengt Muthén,et al.  Latent Variable Analysis: Growth Mixture Modeling and Related Techniques for Longitudinal Data , 2004 .

[6]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[7]  Paul E. Spector,et al.  Locus of Control and Well-Being at Work: How Generalizable are Western Findings? , 2002 .

[8]  T. Little Mean and Covariance Structures (MACS) Analyses of Cross-Cultural Data: Practical and Theoretical Issues. , 1997, Multivariate behavioral research.

[9]  Paul E. Spector,et al.  A cross‐cultural comparison of job satisfaction dimensions in the United States and Singapore , 1986 .

[10]  John B. Campbell,et al.  Extreme Response Style in Cross-Cultural Research , 1974 .

[11]  Richard G. Netemeyer,et al.  Scaling Procedures: Issues and Applications , 2003 .

[12]  Robert E. Ployhart,et al.  Applications of Mean and Covariance Structure Analysis: Integrating Correlational and Experimental Approaches , 2004 .

[13]  E. Kevin Kelloway,et al.  Structural equation modelling in perspective. , 1995 .

[14]  David Watkins,et al.  The Issue Of Measurement Invariance Revisited , 2003 .

[15]  Allen I. Kraut,et al.  Organizational surveys : tools for assessment and change , 1996 .

[16]  C. Ross,et al.  Socially-desirable response and acquiescence in a cross-cultural survey of mental health. , 1984, Journal of health and social behavior.

[17]  R. Vandenberg Toward a Further Understanding of and Improvement in Measurement Invariance Methods and Procedures , 2002 .

[18]  Robert J. Vandenberg,et al.  A Central Question in Cross-Cultural Research: Do Employees of Different Cultures Interpret Work-related Measures in an Equivalent Manner?: , 1994 .

[19]  S. Schwartz Beyond individualism/collectivism: New cultural dimensions of values. , 1994 .

[20]  L. J. Williams,et al.  Exploratory and confirmatory factor analysis: guidelines, issues, and alternatives , 1997 .

[21]  O. Shenkar,et al.  Cultural distance revisited: Towards a more rigorous conceptualization and measurement of cultural differences , 2001 .

[22]  S. Schwartz A Theory of Cultural Values and Some Implications for Work , 1999 .

[23]  Bryan S. Schaffer,et al.  A Review of Cross-Cultural Methodologies for Organizational Research: A Best- Practices Approach , 2003 .

[24]  R. Schwarzer,et al.  The assessment of optimistic self-beliefs: Comparison of the Chinese, Indonesian, Japanese, and Korean versions of the general self-efficacy scale , 1997 .

[25]  Gregory L. Candell,et al.  Cross-Language and Cross-Cultural Comparisons in Scale Translations , 1986 .

[26]  T. Judge,et al.  Employee attitudes and job satisfaction , 2004 .

[27]  J. Everett,et al.  Response Styles in a Cross-Cultural Managerial Study , 1984 .

[28]  David Chan,et al.  EMPLOYEE ATTITUDE SURVEYS IN A MULTINATIONAL ORGANIZATION: CONSIDERING LANGUAGE AND CULTURE IN ASSESSING MEASUREMENT EQUIVALENCE , 1999 .

[29]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[30]  Isabella C. M. Cunningham,et al.  The Ipsative Process to Reduce Response Set Bias , 1977 .

[31]  F.J.R. van de Vijver,et al.  Methods and Data Analysis for Cross-Cultural Research , 1997 .

[32]  Joseph Soeters,et al.  Comparing cultures : dimensions of culture in a comparative perspective , 2004 .

[33]  M. Zax,et al.  Cultural influences on response style: comparisons of Japanese and American college students. , 1967, The Journal of social psychology.

[34]  Y. Poortinga,et al.  Response Styles in Rating Scales , 2004 .

[35]  W. Meredith Measurement invariance, factor analysis and factorial invariance , 1993 .

[36]  G. Hofstede,et al.  Culture′s Consequences: International Differences in Work-Related Values , 1980 .

[37]  Cheri Ostroff The Effects of Climate and Personal Influences on Individual Behavior and Attitudes in Organizations , 1993 .

[38]  P. Warr,et al.  Copyright © The British Psychological Society Unauthorised use and reproduction in any form (including the internet and other electronic means) is prohibited without prior permission from the Society. , 2005 .

[39]  F. Drasgow Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are the central issues , 1984 .

[40]  Charles Hampden-Turner,et al.  Riding the waves of culture : understanding cultural diversity in global business , 1998 .

[41]  Irvine Clarke,et al.  Extreme response style in cross-cultural research: An empirical investigation. , 2000 .

[42]  F. Strodtbeck,et al.  Variations in value orientations. , 1961 .

[43]  R. Green,et al.  Cross-Cultural Examination of the Fishbein Behavioral Intentions Model , 1991 .

[44]  Bert Weijters Response styles in consumer research , 2006 .

[45]  Anne-Wil Harzing,et al.  Does the Use of English-language Questionnaires in Cross-national Research Obscure National Differences? , 2005 .

[46]  Arthur G. Bedeian,et al.  The Measurement Equivalence of Web-Based and Paper-and-Pencil Measures of Transformational Leadership , 2006 .

[47]  A. Kimball Romney,et al.  Variations in value orientations. , 1961 .

[48]  D. Chan,et al.  Detection of Differential Item Functioning on the Kirton Adaption-Innovation Inventory Using Multiple-Group Mean and Covariance Structure Analyses , 2000, Multivariate behavioral research.

[49]  Y. Aharoni Cultures and Organizations: Software of the Mind , 1992 .

[50]  Young Ik Cho,et al.  The Relation Between Culture and Response Styles , 2005 .

[51]  D. Gerbing,et al.  Viability of exploratory factor analysis as a precursor to confirmatory factor analysis , 1996 .

[52]  D. Magnusson Toward A Psychology of Situations : An Interactional Perspective , 1981 .

[53]  R. Brislin Back-Translation for Cross-Cultural Research , 1970 .

[54]  Fritz Drasgow,et al.  Study of the measurement bias of two standardized psychological tests. , 1987 .

[55]  Jack E. Edwards How to conduct organizational surveys : a step-by-step guide , 1997 .

[56]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[57]  William B. Stevenson,et al.  Nationality, Cultural Distance, and Expatriate Status: Effects on the Managerial Network in a Multinational Enterprise , 2001 .

[58]  A. T. Church,et al.  Cross-cultural generalizability of personality dimensions: relating indigenous and imported dimensions in two cultures. , 1996, Journal of personality and social psychology.

[59]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[60]  Lisa L. Roberts,et al.  Effects of Data Collection Method on Organizational Climate Survey Results , 2004 .

[61]  Gordon W. Cheung,et al.  Assessing Extreme and Acquiescence Response Sets in Cross-Cultural Research Using Structural Equations Modeling , 2000 .

[62]  F. J. Smith,et al.  Language, time, and person effects on attitude scale translations. , 1977 .

[63]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[64]  Michael T. Brannick,et al.  Critical comments on applying covariance structure modeling , 1995 .

[65]  Are U.S. Organizational Concepts And Measures Transferable To Another Culture? An Empirical Investigation , 1981 .

[66]  J. Baird Callicott,et al.  Issues and applications , 2005 .

[67]  H. Triandis,et al.  Etic Plus Emic Versus Pseudoetic , 1983 .

[68]  J. H. Steiger Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[69]  A. T. Church,et al.  A Cross-Cultural Study of Response Biases in Personality Measures☆ , 1999 .

[70]  J. Stanton AN EMPIRICAL ASSESSMENT OF DATA COLLECTION USING THE INTERNET , 1998 .

[71]  Christopher P. Parker,et al.  Relationships between psychological climate perceptions and work outcomes: a meta-analytic review , 2003 .

[72]  Kevin R. Murphy,et al.  Individual differences and behavior in organizations , 1996 .

[73]  Allan H. Church,et al.  Designing and using organizational surveys : a seven-step process , 2001 .

[74]  David Kaplan,et al.  The Sage handbook of quantitative methodology for the social sciences , 2004 .

[75]  Harbir Singh,et al.  The Effect of National Culture on the Choice of Entry Mode , 1988 .

[76]  Harry C. Triandis,et al.  Individualism and collectivism: Theory, method, and applications. , 1996 .

[77]  Paul E. Spector,et al.  Measurement equivalence of the German Job Satisfaction Survey used in a multinational organization: implications of Schwartz's culture model. , 2004, The Journal of applied psychology.

[78]  Cynthia M. Pavett,et al.  Management Style and Productivity in Two Cultures , 1992 .

[79]  C. Hulin,et al.  Psychometric equivalence of a translation of the job descriptive index into Hebrew , 1986 .

[80]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[81]  Lawrence R. James,et al.  Organizational climate: A review of theory and research. , 1974 .

[82]  Shalom H. Schwartz,et al.  Influences of Adaptation to Communist Rule on Value Priorities in Eastern Europe , 1997 .

[83]  Alvaro J. Arce-Ferrer An Investigation Into the Factors Influencing Extreme-Response Style , 2006 .