Construct equivalence of the OPQ32n for Black and White people in South Africa

Orientation: The construct equivalence of the Occupational Personality Questionnaire (OPQ32n) for black and white groups was investigated. Research purpose: The objective was to investigate the structural invariance of the OPQ32n for two South African population groups. Motivation for the study: The OPQ32n is often used for making a variety of personnel decisions in South Africa. Evidence regarding the suitability of personality questionnaires for use across South Africa’s various population groups is required by practitioners for selecting appropriate psychometric instruments. Research design, approach and method: Data were collected by means of a questionnaire and the results were analysed using quantitative statistical methods. The sample consisted of 248 Black and 476 White people from the SHL (South Africa) database. Structural equation modelling was used to examine the structural equivalence of the OPQ32n scale scores for these two groups. Main findings: A good fit regarding factor correlations and covariances on the 32 scales was obtained, partially supporting the structural equivalence of the questionnaire for the two groups. The analyses furthermore indicated that there was structural invariance, with the effect of the Social Desirability scale partialled out. Practical/managerial implications: The present study focused on aspects of structural equivalence only. The OPQ32n therefore passed the first hurdle in this particular context, but further investigation is necessary to provide evidence that the questionnaire is suitable for use in personnel decisions comparing the population groups. Contribution: Despite the positive findings with regard to structural equivalence and social desirability response style, it should be borne in mind that no assumptions regarding full scale equivalence can be made on the basis of the present findings.

[1]  Elize Koch.  Die evaluering van 'n eentalige toelatingstoets wat vir toelating tot hoër onderwys in 'n veeltalige konteks gebruik word , 2007 .

[2]  S. Rothmann,et al.  A PSYCHOMETRIC EVALUATION OF MEASURES OF AFFECTIVE WELL-BEING IN AN INSURANCE COMPANY , 2007 .

[3]  C. Foxcroft,et al.  Critically examining language bias in the South African adaptation of the WAIS-III , 2006 .

[4]  M. Barrick,et al.  Construct, Item, and Method Bias of Cognitive and Personality Tests in South Africa , 2005 .

[5]  P. Schaap,et al.  The construct equivalence of the job diagnostic survey for diverse South African cultural groups , 2005 .

[6]  M. Buys,et al.  The comparability of the construct validity of Schepers' Locus of Control Inventory for first and second language respondents , 2004 .

[7]  S. Rothmann,et al.  Assessment in multicultural groups : The South African case , 2004 .

[8]  Deléne Visser,et al.  Using the occupational personality questionnaire (OPQ) for measuring broad traits. , 2004 .

[9]  C. Foxcroft.  Planning a psychological test in the multicultural South African context , 2004 .

[10]  Norbert K Tanzer,et al.  Bias and equivalence , 2000 .

[11]  T. Wallis.  Psychological Tests Do Not Measure What They Claim to Measure: A Re-Evaluation of the Concept of Construct Validity , 2004 .

[12]  J. Basson,et al.  The construct equivalence of the PIB / SpEEx Motivation Index for job applicants from diverse cultural backgrounds , 2003 .

[13]  P. Schaap,et al.  The construct validity of Schepers' locus of control inventory for black and white tertiary students , 2003 .

[14]  N. Anderson,et al.  Gender and ethnic group differences on personality scales in selection: Some British data , 2002 .

[15]  G. Huysamen.  The Relevance of the New APA Standards for Educational and Psychological Testing for Employment Testing in South Africa , 2002 .

[16]  K. Leung,et al.  Personality in cultural context: methodological issues. , 2001, Journal of personality.

[17]  A. T. Church,et al.  Personality measurement in cross-cultural perspective. , 2001, Journal of personality.

[18]  Neal Schmitt,et al.  Incremental validity of situational judgment tests , 2001 .

[19]  B. Byrne.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[20]  H. Stumpf,et al.  The Five-Factor Model of Personality in South African College Students , 2000 .

[21]  R. V. Eeden,et al.  Culture as moderator variable in psychological test performance : issues and trends in South Africa , 1999 .

[22]  K. F. Mauer,et al.  The comparability of the constructs of the 16PF in the South African context , 1999 .

[23]  K. F. Mauer,et al.  Qualitative and Statistical Impacts of Home Language on Responses to the Items of the Sixteen Personality Factor Questionnaire (16PF) in South Africa , 1999 .

[24]  D. Ones,et al.  The Effects of Social Desirability and Faking on Personality and Integrity Assessment for Personnel Selection , 1998 .

[25]  Wayne F. Cascio,et al.  Applied Psychology in Human Resource Management , 1998 .

[26]  R. van Eeden,et al.  Using the South African Version of the 16PF in a Multicultural Context , 1997 .

[27]  F.J.R. van de Vijver,et al.  Methods and Data Analysis for Cross-Cultural Research , 1997 .

[28]  Helen Baron,et al.  Strengths and limitations of ipsative measurement , 1996 .

[29]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[30]  K. Geisinger.  Cross-Cultural Normative Assessment: Translation and Adaptation Issues Influencing the Normative Interpretation of Assessment Instruments. , 1994 .

[31]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[32]  Deléne Visser,et al.  The Validity of the Senior South African Individual Scale-Revised (SSAIS-R) for Different Population Groups , 1992 .

[33]  P. Saville,et al.  The reliability and validity of normative and ipsative approaches in the measurement of personality , 1991 .

[34]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[35]  Y. Poortinga.  Equivalence of cross-cultural data: an overview of basic issues. , 1989, International journal of psychology : Journal international de psychologie.

[36]  Steve Blinkhorn,et al.  Spuriouser and spuriouser: The use of ipsative personality tests , 1988 .

[37]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[38]  J. Gower,et al.  Multivariate data analysis , 1972 .

[39]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1965 .

[40]  K. G. J8reskoC,et al.  Simultaneous Factor Analysis in Several Populations , 2007 .

[41]  C. Foxcroft,et al.  PLANNING A PSYCHOLOGICAL TEST IN THE MULTICULTURAL , 2004 .

[42]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[43]  Y. Poortinga,et al.  Towards an integrated analysis of bias in cross-cultural assessment , 1997 .

[44]  W. Dunlap,et al.  Factor Analysis of Ipsative Measures. , 1994, Multivariate behavioral research.

[45]  K. Owen.  Test and Item Bias: The Suitability of the Junior Aptitude Tests as a Common Test Battery for White, Indian and Black Pupils in Standard 7. Report P-96. , 1989 .

[46]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[47]  P. Moss,et al.  Bias in test use. , 1989 .

[48]  P. Costa,et al.  Validation of the five-factor model of personality across instruments and observers. , 1987, Journal of personality and social psychology.

[49]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[50]  E. Carmines,et al.  Analyzing models with unobserved variables: analysis of covariance structures , 1981 .

[51]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[52]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.