Disentangling task and contextual performance: A multitrait-multimethod approach

This study among 244 employees and their colleagues working in various sectors investigated the dimensionality of self-ratings and peer-ratings of task and contextual performance, using the scales of Goodman and Svyantek (1999). By applying the multitrait-multimethod approach, we examined the degree to which responses to performance items are influenced by the trait (task or contextual performance) and the method factors (self- or peer-ratings). Results of confirmatory factor analyses showed that while the two performance dimensions (i.e., traits) can be differentiated, responses to their items are influenced by the method factor. Specifically, peer-ratings explain more variance in task performance, while self-ratings explain more variance in contextual performance. Moreover, the measurement of task and contextual performance is invariant across self- and peer-ratings. Finally, the positive relationships between task and contextual performance on the one hand and work-related flow on the other hand are of equal strength. These findings support the validity of the performance measure but also highlight some impact of the method factors.

[1]  F. Floyd,et al.  Factor analysis in the development and refinement of clinical assessment instruments. , 1995 .

[2]  A. Furnham,et al.  Congruence in Job-Performance Ratings: A Study of 360° Feedback Examining Self, Manager, Peers, and Consultant Ratings , 1998 .

[3]  B. Byrne.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[4]  J. Suls,et al.  Flawed Self-Assessment , 2004, Psychological science in the public interest : a journal of the American Psychological Society.

[5]  M. Csíkszentmihályi.  Beyond boredom and anxiety , 1975 .

[6]  R. P. McDonald,et al.  Test Theory: A Unified Treatment , 1999 .

[7]  S. J. Motowidlo,et al.  Evidence that task performance should be distinguished from contextual performance. , 1994 .

[8]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[9]  E. Demerouti,et al.  Job resources buffer the impact of work-family conflict on absenteeism in female employees. , 2011 .

[10]  Gordon W. Cheung.  Multifaceted conceptions of self–other ratings disagreement. , 1999 .

[11]  Mohammad Muzahid Akbar,et al.  ORGANIZATIONAL CITIZENSHIP BEHAVIOR: ITS NATURE AND ANTECEDENTS , 2004 .

[12]  E. Diener,et al.  Subjective well-being. The science of happiness and a proposal for a national index. , 2000, The American psychologist.

[13]  S. Engeser,et al.  Flow, performance and moderators of challenge-skill balance , 2008 .

[14]  H. Marsh,et al.  Construct Validity of the Multidimensional Structure of Bullying and Victimization: An Application of Exploratory Structural Equation Modeling. , 2011 .

[15]  Willem Verbeke,et al.  Using the job demands‐resources model to predict burnout and performance , 2004 .

[16]  R. Arvey,et al.  Performance evaluation in work settings. , 1998, Annual review of psychology.

[17]  Nicole Fruehauf.  Flow The Psychology Of Optimal Experience , 2016 .

[18]  Douglas N. Behrman,et al.  Measuring the performance of industrial salespersons , 1982 .

[19]  Daniel J. Svyantek,et al.  Person–Organization Fit and Contextual Performance: Do Shared Values Matter☆☆☆ , 1999 .

[20]  M. Csíkszentmihályi,et al.  The Concept of Flow , 2014 .

[21]  Brian D. Blume,et al.  Individual- and organizational-level consequences of organizational citizenship behaviors: A meta-analysis. , 2009, The Journal of applied psychology.

[22]  C. R. Snyder,et al.  Handbook of positive psychology , 2002 .

[23]  A. Bakker,et al.  How job demands, resources, and burnout predict objective performance: A constructive replication , 2008, Anxiety, stress, and coping.

[24]  A. Bakker.  The work-related flow inventory: Construction and initial validation of the WOLF , 2008 .

[25]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[26]  A. Denisi,et al.  Investigation of the uses of self-reports of abilities. , 1977 .

[27]  Stephen G. West,et al.  Validity of self-evaluation of ability: A review and meta-analysis , 1982 .

[28]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[29]  Deborah E. Rupp,et al.  The mediating effects of social exchange relationships in predicting workplace outcomes from multifoci organizational justice , 2002 .

[30]  Allen I. Huffcutt,et al.  Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. , 1997 .

[31]  Scott W. Lester,et al.  The Impact of Psychological Contract Fulfillment on the Performance of In-Role and Organizational Citizenship Behaviors , 2003 .

[32]  S. Deshpande,et al.  Task Characteristics and the Experience of Optimal Flow in Human—Computer Interaction , 1994 .

[33]  N. Bolger,et al.  Diary methods: capturing life as it is lived. , 2003, Annual review of psychology.

[34]  J. Conway,et al.  Distinguishing contextual performance from task performance for managerial jobs. , 1999 .

[35]  W. Borman,et al.  A Theory of Individual Differences in Task and Contextual Performance , 1997 .

[36]  L. J. Williams,et al.  Job Satisfaction and Organizational Commitment as Predictors of Organizational Citizenship and In-Role Behaviors , 1991 .

[37]  Ronald A. Ash,et al.  Self-assessment in personnel selection. , 1977 .

[38]  H. Marsh,et al.  A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. , 1988 .

[39]  F. Chen.  Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[40]  J. Navarro,et al.  ‘Suddenly I get into the zone’: Examining discontinuities and nonlinear changes in flow experiences at work , 2012 .

[41]  D. Organ.  Organizational Citizenship Behavior: It's Construct Clean-Up Time , 1997 .

[42]  K. Schermelleh-Engel,et al.  Analyzing Multitrait- Multimethod Data A Comparison of Three Approaches , 2009 .

[43]  Chockalingam Viswesvaran,et al.  Perspectives on Models of Job Performance , 2000 .

[44]  Sarah A. Hezlett,et al.  TRAIT, RATER AND LEVEL EFFECTS IN 360‐DEGREE PERFORMANCE RATINGS , 1998 .

[45]  D. Beal,et al.  An episodic process model of affective influences on performance. , 2005, The Journal of applied psychology.

[46]  P. A. Freund,et al.  How smart do you think you are? A meta-analysis on the validity of self-estimates of cognitive ability. , 2012, Psychological bulletin.

[47]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[48]  Despoina Xanthopoulou,et al.  Working in the sky: a diary study on work engagement among flight attendants. , 2008, Journal of occupational health psychology.

[49]  Shelley E. Taylor,et al.  Illusion and well-being: a social psychological perspective on mental health. , 1988, Psychological bulletin.

[50]  Wilmar B. Schaufeli,et al.  Work engagement and financial returns: A diary study on the role of job and personal resources , 2009 .

[51]  R. Bies,et al.  Organizational Citizenship Behavior: The Good Soldier Syndrome , 1989 .

[52]  Scott B. MacKenzie,et al.  Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance , 1991 .

[53]  D. Hall.  Career development theory in organizations. , 1990 .

[54]  J. Webster,et al.  Flow in Computer-Mediated Communication , 1992 .

[55]  Elizabeth Wolfe Morrison,et al.  Role Definitions and Organizational Citizenship Behavior: The Importance of the Employee's Perspective , 1994 .

[56]  Ruut Veenhoven,et al.  Happy life-expectancy , 1996 .

[57]  Willem Verbeke,et al.  When Intelligence is (Dys)Functional for Achieving Sales Performance , 2008 .

[58]  Herbert W. Marsh,et al.  Latent variable models of multitrait-multimethod data. , 1995 .

[59]  George C. Thornton,et al.  PSYCHOMETRIC PROPERTIES OF SELF-APPRAISALS OF JOB PERFORMANCE , 1980 .

[60]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[61]  E. Demerouti.  Job characteristics, flow, and performance: the moderating role of conscientiousness. , 2006, Journal of occupational health psychology.