An investigation of race and sex similarity effects in interviews: a multilevel approach to relational demography.

This research studied the effects of race and sex similarity on ratings in one-on-one highly structured college recruiting interviews (N = 708 interviewers and 12203 applicants for 7 different job families). A series of hierarchical linear models provided no evidence for similarity effects, although the commonly used D-score and analysis-of-variance-based interaction approaches conducted at the individual level of analysis yielded different results. The disparate results demonstrate the importance of attending to nested data structures and levels of analysis issues more broadly. Practically, the results suggest that organizations using carefully administered highly structured interviews may not need to be concerned about bias due to the mismatch between interviewer and applicant race or sex.

[1]  Susan T. Fiske,et al.  The Ambivalent Sexism Inventory: Differentiating hostile and benevolent sexism. , 1996 .

[2]  G. Johns.  Difference score measures of organizational behavior variables: A critique. , 1981 .

[3]  L. Barsalou.  Context-independent and context-dependent information in concepts , 1982, Memory & cognition.

[4]  N. Schmitt,et al.  Understanding pretest and posttest reactions to cognitive ability and personality tests. , 1998, The Journal of applied psychology.

[5]  J. B. Mcconahay.  Modern Racism and Modern Discrimination , 1983 .

[6]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[7]  J. B. Vancouver,et al.  Multilevel analysis of organizational goal congruence , 1994 .

[8]  S. Webber,et al.  Impact of highly and less job-related diversity on work group cohesion and performance: a meta-analysis , 2001 .

[9]  Jeffrey R. Edwards,et al.  Alternatives to difference scores as dependent variables in the study of congruence in organizational research. , 1995 .

[10]  A. Howard.  The changing nature of work , 1995 .

[11]  Jeffrey Pfeffer,et al.  Organizational demography and turnover in top-management groups. , 1984 .

[12]  Bruce J. Avolio,et al.  Race effects in performance evaluations: Controlling for ability, education, and experience. , 1991 .

[13]  Amy L. Kristof.  PERSON-ORGANIZATION FIT: AN INTEGRATIVE REVIEW OF ITS CONCEPTUALIZATIONS, MEASUREMENT, AND IMPLICATIONS , 1996 .

[14]  N. Schmitt,et al.  Reactions to cognitive ability tests: the relationships between race, test performance, face validity perceptions, and test-taking motivation. , 1997, The Journal of applied psychology.

[15]  Nathan Bennett,et al.  Cohesiveness and Organizational Citizenship Behavior: A Multilevel Analysis Using Work Groups and Individuals , 1997 .

[16]  Sarah A. Hezlett,et al.  TRAIT, RATER AND LEVEL EFFECTS IN 360‐DEGREE PERFORMANCE RATINGS , 1998 .

[17]  Charles A. O'Reilly,et al.  Being different: Relational demography and organizational attachment. , 1991 .

[18]  Todd R. Zenger,et al.  Organizational Demography: The Differential Effects of Age and Tenure Distributions on Technical Communication , 1989 .

[19]  D. Turban,et al.  Supervisor-subordinate similarity: types, effects, and mechanisms. , 1988, The Journal of applied psychology.

[20]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[21]  Denise M. Rousseau,et al.  Developing an interdisciplinary science of organizations , 1979 .

[22]  D. Chan.  Functional Relations among Constructs in the Same Content Domain at Different Levels of Analysis: A Typology of Composition Models , 1998 .

[23]  J. Edwards.  The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative , 1994 .

[24]  Sigal G. Barsade,et al.  To Your Heart's Content: A Model of Affective Diversity in Top Management Teams , 2000 .

[25]  Kurt Kraiger,et al.  A meta-analysis of ratee race effects in performance ratings. , 1985 .

[26]  A. Tsui,et al.  Beyond Simple Demographic Effects: The Importance of Relational Demography in Superior-Subordinate Dyads , 1989 .

[27]  D. A. Kenny,et al.  Consequences of violating the independence assumption in analysis of variance. , 1986 .

[28]  Warren E. Watson,et al.  Cultural diversity''s impact on interaction process and performance: Comparing homogeneous and diver , 1993 .

[29]  Robert S. Barcikowski,et al.  Statistical Power with Group Mean as the Unit of Analysis , 1981 .

[30]  Karlene H. Roberts,et al.  Hypothesized Interdependence, Assumed Independence , 1984 .

[31]  Emilie M. Roth,et al.  The effect of context on the structure of categories , 1983, Cognitive Psychology.

[32]  Robert E. Ployhart,et al.  The Estimation of Reliability in Longitudinal Models , 1998 .

[33]  H. Tajfel.  Human Groups and Social Categories: Studies in Social Psychology , 1981 .

[34]  Jennifer A. Chatman,et al.  The Influence of Demographic Heterogeneity on the Emergence and Consequences of Cooperative Norms in Work Teams , 2001 .

[35]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[36]  Arthur G. Bedeian,et al.  On the Use of the Coefficient of Variation as a Measure of Diversity , 2000 .

[37]  Michael T. Hannan,et al.  Aggregation and disaggregation in sociology , 1970 .

[38]  Ellen Ensher,et al.  Effects of Race, Gender, Perceived Similarity, and Contact on Mentor Relationships , 1997 .

[39]  Paul R. Sackett,et al.  Rater−ratee race effects on performance evaluation : challenging meta-analytic conclusions , 1991 .

[40]  John B. Nezlek,et al.  Using hierarchical linear modeling to analyze grouped data. , 1998 .

[41]  D. Byrne.  The Attraction Paradigm , 1971 .

[42]  Allan J. Lichtman,et al.  Ecological Inference , 1978 .

[43]  Deborah G. . Ancona,et al.  Demography and Design: Predictors of New Product Team Performance , 1992 .

[44]  C. M. Riordan,et al.  Relational demography within groups: Past developments, contradictions, and new directions , 2000 .

[45]  Theodore M. Newcomb,et al.  The prediction of interpersonal attraction , 1956 .

[46]  S. Jackson,et al.  Some differences make a difference: Individual dissimilarity and group heterogeneity as correlates of recruitment, promotions, and turnover. , 1991 .

[47]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[48]  J. J. Hox,et al.  Hierarchical Regression Models for Interviewer and Respondent Effects , 1994 .

[49]  K. W. Mossholder,et al.  Relational demography in supervisor- subordinate dyads: Impact on subordinate job satisfaction, burnout, and perceived procedural justice , 1997 .

[50]  James B. Shaw,et al.  The Effects of Diversity on Small Work Group Processes and Performance , 1998 .

[51]  D. Gentner,et al.  Respects for similarity , 1993 .

[52]  Barbara F. Reskin,et al.  THE DETERMINANTS AND CONSEQUENCES OF WORKPLACE SEX AND RACE COMPOSITION , 1999 .

[53]  D. Harrison,et al.  Beyond Relational Demography: Time and the Effects of Surface- and Deep-Level Diversity on Work Group Cohesion , 1998 .

[54]  I G Kreft,et al.  The Effect of Different Forms of Centering in Hierarchical Linear Models. , 1995, Multivariate behavioral research.

[55]  Thomas A. Timmerman.  Racial Diversity, Age Diversity, Interdependence, and Team Performance , 2000 .

[56]  P. Bliese.  Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. , 2000 .

[57]  Michael T. Hannan,et al.  Aggregation and disaggregation in the social sciences , 1991 .

[58]  C. M. Riordan,et al.  Demographic diversity and employee attitudes : An empirical examination of relational demography within work units , 1997 .

[59]  David A. Hofmann.  An Overview of the Logic and Rationale of Hierarchical Linear Models , 1997 .

[60]  Jiing-Lih Farh,et al.  A field study of race and age similarity effects on interview ratings in conventional and situational interviews , 1992 .

[61]  David A. Hofmann,et al.  Centering Decisions in Hierarchical Linear Models: Implications for Research in Organizations , 1998 .

[62]  Sharon R. Bird,et al.  Social Context at Work: A Multilevel Analysis of Job Satisfaction , 2000 .

[63]  N. Schmitt,et al.  Measuring and analyzing behavior in organizations : advances in measurement and data analysis , 2002 .

[64]  Laura M. Graves,et al.  Sex similarity, quality of the employment interview and recruiters' evaluation of actual applicants , 1996 .

[65]  B. Schneider.  THE PEOPLE MAKE THE PLACE , 1987 .

[66]  S. Kozlowski,et al.  Multilevel Theory, Research, and Methods in Organizations: Foundations, Extensions, and New Directions , 2000 .

[67]  D. Rousseau.  Issues of level in organizational research: Multi-level and cross-level perspectives. , 1985 .

[68]  Peter E. Kennedy.  A Guide to Econometrics , 1979 .

[69]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[70]  Laura M. Graves,et al.  THE EFFECT OF SEX SIMILARITY ON RECRUITERS' EVALUATIONS OF ACTUAL APPLICANTS: A TEST OF THE SIMILARITY‐ATTRACTION PARADIGM , 1995 .

[71]  H. S. Feild,et al.  Effects of race on interview ratings in a situational panel interview. , 1996 .

[72]  Walter C. Borman,et al.  Examination of race and sex effects on performance ratings , 1989 .

[73]  A. Tversky.  Features of Similarity , 1977 .

[74]  K. Shultz,et al.  Multilevel modeling in industrial and personnel psychology , 1998 .

[75]  P. Muchinsky,et al.  What is person-environment congruence? Supplementary versus complementary models of fit , 1987 .