Job Performance as Multivariate Dynamic Criteria: Experience Sampling and Multiway Component Analysis

Questions about the dynamic processes that drive behavior at work have been the focus of increasing attention in recent years. Models describing behavior at work and research on momentary behavior indicate that substantial variation exists within individuals. This article examines the rationale behind this body of work and explores a method of analyzing momentary work behavior using experience sampling methods. The article also examines a previously unused set of methods for analyzing data produced by experience sampling. These methods are known collectively as multiway component analysis. Two archetypal techniques of multimode factor analysis, the Parallel factor analysis and the Tucker3 models, are used to analyze data from Miner, Glomb, and Hulin's (2010) experience sampling study of work behavior. The efficacy of these techniques for analyzing experience sampling data is discussed as are the substantive multimode component models obtained.

[1]  Andrew G. Miner,et al.  State mood, task performance, and behavior at work: A within-persons approach , 2010 .

[2]  Reeshad S. Dalal,et al.  A Within-Person Approach to Work Behavior and Performance: Concurrent and Lagged Citizenship-Counterproductivity Associations, and Dynamic Relationships with Affect and Overall Job Performance , 2009 .

[3]  P. Kroonenberg.  Applied Multiway Data Analysis , 2008 .

[4]  Ronald S. Landis,et al.  The Effects of Cognitive Ability and Conscientiousness on Performance Over Time: A Censored Latent Growth Model , 2007 .

[5]  D. Beal,et al.  An episodic process model of affective influences on performance. , 2005, The Journal of applied psychology.

[6]  David E. Booth,et al.  Multi-Way Analysis: Applications in the Chemical Sciences , 2005, Technometrics.

[7]  Andrew G. Miner,et al.  Experience sampling mood and its correlates at work , 2005 .

[8]  Rasmus Bro,et al.  Multi-way Analysis with Applications in the Chemical Sciences , 2004 .

[9]  Jill C. Bradley,et al.  The big five personality traits and individual job performance growth trajectories in maintenance and transitional job stages. , 2004, The Journal of applied psychology.

[10]  Frans J Oort,et al.  Three-mode analysis of multimode covariance matrices. , 2003, The British journal of mathematical and statistical psychology.

[11]  J. M. Cortina,et al.  Degradation of validity over time: a test and extension of Ackerman's model. , 2001, Psychological bulletin.

[12]  H. Kiers,et al.  Three-mode principal components analysis: choosing the numbers of components and sensitivity to local optima. , 2000, The British journal of mathematical and statistical psychology.

[13]  H. Kiers.  Towards a standardized notation and terminology in multiway analysis , 2000 .

[14]  H. Kiers,et al.  Individual differences in anxiety responses to stressful situations: a three‐mode component analysis model , 1999 .

[15]  H. Weiss,et al.  An Examination of the Joint Effects of Affective Experiences and Job Beliefs on Job Satisfaction and Variations in Affective Experiences over Time. , 1999, Organizational behavior and human decision processes.

[16]  David Chan,et al.  The Conceptualization and Analysis of Change Over Time: An Integrative Approach Incorporating Longitudinal Mean and Covariance Structures Analysis (LMACS) and Multiple Indicator Latent Growth Modeling (MLGM) , 1998 .

[17]  Kevin R. Murphy,et al.  Implications of the multidimensional nature of job performance for the validity of selection tests , 1997 .

[18]  Walter C. Borman,et al.  Task Performance and Contextual Performance: The Meaning for Personnel Selection Research , 1997 .

[19]  S. J. Motowidlo,et al.  Evidence that task performance should be distinguished from contextual performance. , 1994 .

[20]  Pieter M. Kroonenberg,et al.  The TUCKALS line: a suite of programs for three-way data analysis , 1994 .

[21]  Peter Villanova,et al.  The criterion problem: 1917–1992. , 1992 .

[22]  Henk A. L. Kiers,et al.  Hierarchical relations among three-way methods , 1991 .

[23]  John P. Campbell,et al.  MODELING JOB PERFORMANCE IN A POPULATION OF JOBS , 1990 .

[24]  K. Murphy.  Is the relationship between cognitive ability and job performance stable over time , 1989 .

[25]  Lloyd G. Humphreys,et al.  Another View of Dynamic Criteria: A Critical Reanalysis of Barrett, Caldwell, and Alexander. , 1989 .

[26]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[27]  M. Csíkszentmihályi,et al.  Validity and Reliability of the Experience‐Sampling Method , 1987, The Journal of nervous and mental disease.

[28]  Gerald V. Barrett,et al.  The Concept of Dynamic Criteria: A Critical Reanalysis. , 1985 .

[29]  C. Hulin.  Some reflections on general performance dimensions and halo rating error. , 1982 .

[30]  J. Leeuw,et al.  Principal component analysis of three-mode data by means of alternating least squares algorithms , 1980 .

[31]  L. Humphreys.  The Phenomena Are Ubiquitous-But the Investigator Must Look. , 1976 .

[32]  Charles L. Hulin,et al.  Three sources of criterion variance: Static dimensionality, dynamic dimensionality, and individual dimensionality☆ , 1972 .

[33]  C. Hulin,et al.  Two Explanations of Temporal Changes in Ability-Skill Relationships: A Literature Review and Theoretical Analysis , 1972 .

[34]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[35]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[36]  Marvin D. Dunnette,et al.  A note on the criterion. , 1963 .

[37]  R. Cattell.  The three basic factor-analytic research designs-their interrelations and derivatives. , 1952, Psychological bulletin.

[38]  R. Cattell.  “Parallel proportional profiles” and other principles for determining the choice of factors by rotation , 1944 .

[39]  H. Weiss,et al.  Affective Events Theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. , 1996 .

[40]  T. Palfai,et al.  Emotional attention, clarity, and repair : Exploring emotional intelligence using the Trait Meta-Mood Scale , 1995 .

[41]  Walter C. Borman,et al.  Job behavior, performance, and effectiveness. , 1991 .

[42]  Charles L. Hulin,et al.  Adding a Dimension: Time as a Factor in the Generalizability of Predictive Relationships , 1990 .

[43]  R. A. Harshman,et al.  Data preprocessing and the extended PARAFAC model , 1984 .

[44]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[45]  Charles L. Hulin,et al.  The measurement of satisfaction in work and retirement: A strategy for the study of attitudes. , 1969 .

[46]  E. Ghiselli.  Dimensional problems of criteria. , 1956 .