Construct Validity of Three Types of Organizational Citizenship behavior: An Illustration of the Direct Product Model with Refinements

The direct product model is a new analysis tool for modeling multitrait-multimethod data. This model may avoid some of the problems associated with conventional analysis of multitrait-multimethod data by allowing for the possibility of multiplicative trait-method interactions. Based on the work of Browne (1984; 1990), we suggest several refinements in testing this model, including use of confirmatory procedures for testing model fit and implementation of a hierarchical approach to model comparisons. We provide an illustration of the refined direct product approach using a study of three types of organizational citizenship behavior. The results supply evidence for convergent and discriminant validity of the three constructs, and suggest that job incumbents, supervisors, and peers have significantly different perspectives of organizational citizenship behavior.

[1]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[2]  Dennis W. Organ,et al.  A Restatement of the Satisfaction-Performance Hypothesis , 1988 .

[3]  Lawrence R. James,et al.  Criterion models and construct validity for criteria. , 1973 .

[4]  Paul E. Spector,et al.  Estimation Problems in the Block-Diagonal Model of the Multitrait-Multimethod Matrix , 1990 .

[5]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[6]  Dennis W. Organ,et al.  COGNITIVE VERSUS AFFECTIVE DETERMINANTS OF ORGANIZATIONAL CITIZENSHIP BEHAVIOR , 1989 .

[7]  Jennifer M. George,et al.  Personality, affect, and behavior in groups. , 1990 .

[8]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[9]  Gary P. Latham,et al.  Increasing productivity through performance appraisal , 1981 .

[10]  M. Browne,et al.  The direct product model for the mtmm matrix parameterized as a second order factor analysis model , 1990 .

[11]  William R. Dillon,et al.  Offending Estimates in Covariance Structure Analysis: Comments on the Causes of and Solutions to Heywood Cases , 1987 .

[12]  Sheila M. Puffer.  Prosocial behavior, noncompliant behavior, and work performance among commission salespeople. , 1987 .

[13]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[14]  P. Sackett,et al.  The Role of Prescribed and Nonprescribed Behaviors in Estimating the Dollar Value of Performance , 1989 .

[15]  M. Coovert,et al.  Construct validity of multiple job performance measures using confirmatory factor analysis. , 1988 .

[16]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[17]  R. Cudeck.  Msultiplicative Models and MTMM Matrices , 1988 .

[18]  W. R. Dillon,et al.  An Integrative Look at the Use of Additive and Multiplicative Covariance Structure Models in the Analysis of MTMM Data , 1992 .

[19]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[20]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[21]  R. Bagozzi.  Assessing Construct Validity in Personality Research: Applications to Measures of Self-Esteem , 1993 .

[22]  Jennifer A. Chatman,et al.  Organizational commitment and psychological attachment: The effects of compliance, identification, and internalization on prosocial behavior. , 1986 .

[23]  R. Bagozzi,et al.  Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. , 1990 .

[24]  Michael D. Coovert,et al.  Construct models of task performance , 1989 .

[25]  S. J. Motowidlo,et al.  Occupational stress: its causes and consequences for job performance. , 1986, The Journal of applied psychology.

[26]  Robert J. Wherry,et al.  THE CONTROL OF BIAS IN RATINGS: A THEORY OF RATING , 1982 .

[27]  P. Suppes,et al.  Contemporary Developments in Mathematical Psychology , 1976 .

[28]  L. J. Williams.  Affective and nonaffective components of job satisfaction and organizational commitment as determinants of organizational citizenship and in-role behaviors , 1988 .

[29]  Karl G. Jöreskog,et al.  Analyzing psychological data by structural analysis of covariance matrices , 1974 .

[30]  H. Marsh.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[31]  R. Bagozzi,et al.  Multitrait-Multimethod Matrices in Consumer Research , 1991 .

[32]  A. Bedeian,et al.  AN EMPIRICAL INVESTIGATION OF SELF‐APPRAISAL‐BASED PERFORMANCE EVALUATION , 1988 .

[33]  Psychometric Properties of the Organizational Citizenship Behavior Scale , 1988 .

[34]  L. J. Williams,et al.  Job Satisfaction and Organizational Commitment as Predictors of Organizational Citizenship and In-Role Behaviors , 1991 .

[35]  H. Marsh,et al.  A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. , 1988 .

[36]  M. Browne,et al.  Single Sample Cross-Validation Indices for Covariance Structures. , 1989, Multivariate behavioral research.

[37]  R. Scholl,et al.  Referent Selection in Determining Equity Perceptions: Differential Effects on Behavioral and Attitudinal Outcomes. , 1987 .

[38]  T. S. Bateman,et al.  Job Satisfaction and the Good Soldier: The Relationship Between Affect and Employee “Citizenship” , 1983 .

[39]  Robert H. Moorman,et al.  Relationship between organizational justice and organizational citizenship behaviors : do fairness perceptions influence employee citizenship ? , 1991 .

[40]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[41]  S. J. Motowidlo,et al.  Prosocial Organizational Behaviors , 1986 .

[42]  J. P. Near,et al.  ORGANIZATIONAL CITIZENSHIP BEHAVIOR: ITS NATURE AND ANTECEDENTS , 1983 .

[43]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[44]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[45]  Scott B. MacKenzie,et al.  Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance , 1991 .

[46]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[47]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[48]  Karl E. Weick,et al.  Managerial behavior, performance, and effectiveness , 1971 .

[49]  Richard P. Bagozzi,et al.  Assessing Construct Validity in Organizational Research , 1991 .

[50]  J. H. Steiger.  Statistically based tests for the number of common factors , 1980 .