Analysis of the affect measurement conundrum in exercise psychology: II. A conceptual and methodological critique of the Exercise-induced Feeling inventory

Background and purpose: The measurement of affect in the context of exercise has become a controversial issue. To help elucidate some of the problems, the conceptual and methodological bases of the Exercise-induced Feeling Inventory (Gauvin, L., & Rejeski, W.J. (1993). The Exercise-induced Feeling Inventory: Development and initial validation. Journal of Sport & Exercise Psychology, 15 , 403.) are critiqued, emphasizing deviations from established scale development and validation guidelines. Methods: From a conceptual standpoint, the analysis concentrates on the definition of “feeling states,” the demarcation of the content domain, the decision to adopt a categorical conceptualization of affect, the notion of a universal phenomenology of exercise, and the notion of exercise-specific affect. From a methodological standpoint, emphasis is placed on the item selection and content validation methods, the exploratory structural analysis, and the application of structural equation modeling. Results and conclusions: Substantial deficiencies in conceptual groundwork and deviations from established guidelines are identified that may have important implications for the validity and utility of the EFI. © 2001 Elsevier Science Ltd. All rights reserved.

[1]  M. Lorr,et al.  Manual for the Profile of Mood States , 1971 .

[2]  Kenneth A. Bollen,et al.  Overall Fit in Covariance Structure Models: Two Types of Sample Size Effects , 1990 .

[3]  Richard P. Bagozzi,et al.  An examination of the psychometric properties of measures of negative affect in the PANAS-X scales. , 1993 .

[4]  A. Anastasi.  Psychological testing, 6th ed. , 1988 .

[5]  Educational Evaluation.  Standards for Educational and Psychological Testing , 1999 .

[6]  C. Martindale,et al.  Metaphorical equivalence of elements and temperaments: Empirical studies of Bachelard's theory of imagination. , 1988 .

[7]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[8]  E. McAuley,et al.  Self-efficacy influences feeling states associated with acute exercise. , 1994 .

[9]  Howard B. Lee,et al.  A first course in factor analysis , 1973 .

[10]  E. Simonson,et al.  Psychological aspects and physiological correlates of work and fatigue , 1977 .

[11]  W. Meredith,et al.  Component analysis in multivariate aging research. , 1992, Experimental aging research.

[12]  F. Floyd,et al.  Factor analysis in the development and refinement of clinical assessment instruments. , 1995 .

[13]  W. Jack Rejeski,et al.  Psychological Benefits of Physical Activity Are Influenced by the Social Environment , 1997 .

[14]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[15]  W. Jack Rejeski,et al.  The Exercise-Induced Feeling Inventory: Development and Initial Validation , 1993 .

[16]  Andrew L. Comrey,et al.  Common methodological problems in factor analytic studies. , 1978 .

[17]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[18]  Effects of baseline responses, in-task feelings, and duration of activity on exercise-induced feeling states in women. , 1995 .

[19]  W Revelle,et al.  Very Simple Structure: An Alternative Procedure For Estimating The Optimal Number Of Interpretable Factors. , 1979, Multivariate behavioral research.

[20]  J. Loevinger.  Objective Tests as Instruments of Psychological Theory , 1957 .

[21]  R. Gorsuch,et al.  Effects of under- and overextraction on principal axis factor analysis with varimax rotation. , 1996 .

[22]  P. Ekman,et al.  The nature of emotion: Fundamental questions. , 1994 .

[23]  Exercise psychology : the influence of physical exercise on psychological processes , 1993 .

[24]  P. Shaver,et al.  Emotion knowledge: further exploration of a prototype approach. , 1987, Journal of personality and social psychology.

[25]  P. Burke,et al.  Exploratory and confirmatory tests of the big five and Tellegen's three- and four-dimensional models. , 1994, Journal of personality and social psychology.

[26]  L. Guttman.  Some necessary conditions for common-factor analysis , 1954 .

[27]  Andrew Ortony,et al.  The Referential Structure of the Affective Lexicon , 1987, Cogn. Sci..

[28]  Robert N. Singer,et al.  Handbook of Research on Sport Psychology , 1993 .

[29]  H. Kaiser.  A second generation little jiffy , 1970 .

[30]  R. Cattell,et al.  A Comprehensive Trial Of The Scree And Kg Criteria For Determining The Number Of Factors. , 1977, Multivariate behavioral research.

[31]  Paul Kline,et al.  An easy guide to factor analysis , 1993 .

[32]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[33]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[34]  A. Tellegen.  Structures of Mood and Personality and Their Relevance to Assessing Anxiety, With an Emphasis on Self-Report , 2019, Anxiety and the Anxiety Disorders.

[35]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[36]  K. Widaman.  Common Factor Analysis Versus Principal Component Analysis: Differential Bias in Representing Model Parameters? , 1993, Multivariate behavioral research.

[37]  C. Lox,et al.  Revisiting the Measurement of Exercise-Induced Feeling States: The Physical Activity Affect Scale (PAAS) , 2000 .

[38]  W. Rejeski.  Dose–response issues from a psychosocial perspective. , 1994 .

[39]  W. Velicer,et al.  Comparison of five rules for determining the number of components to retain. , 1986 .

[40]  R. Hoyle.  Structural equation modeling: concepts, issues, and applications , 1997 .

[41]  D. Treasure,et al.  RELATIONSHIP BETWEEN SELF-EFFICACY, EXERCISE INTENSITY, AND FEELING STATES IN A SEDENTARY POPULATION DURING AND FOLLOWING AN ACUTE BOUT OF EXERCISE , 1998 .

[42]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[43]  J. Cacioppo,et al.  Inferring psychological significance from physiological signals. , 1990, The American psychologist.

[44]  Elazar J. Pedhazur,et al.  Measurement, Design, and Analysis: An Integrated Approach , 1994 .

[45]  Joan L. Duda,et al.  Advances in sport and exercise psychology measurement , 1998 .

[46]  R B Cattell,et al.  The Behavior Of Number-Of-Factors Rules With Simulated Data. , 1982, Multivariate behavioral research.

[47]  Norman Cliff,et al.  The eigenvalues-greater-than-one rule and the reliability of components. , 1988 .

[48]  P Salmon,et al.  Qualitative and quantitative effects of running on mood. , 1994, The Journal of sports medicine and physical fitness.

[49]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[50]  A. King,et al.  A Modified Exercise-induced Feeling Inventory for Chronic Training and Baseline Profiles of Participants in the Activity Counseling Trial , 1999, Journal of health psychology.

[51]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[52]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[53]  R. Gorsuch.  Exploratory factor analysis: its role in item analysis. , 1997, Journal of personality assessment.

[54]  W F Velicer,et al.  Component Analysis versus Common Factor Analysis: Some issues in Selecting an Appropriate Procedure. , 1990, Multivariate behavioral research.

[55]  R. Lazarus.  Emotion and Adaptation , 1991 .

[56]  J. Norris,et al.  A naturalistic study of the impact of acute physical activity on feeling states and affect in women. , 1996, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[57]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[58]  Jae-On Kim,et al.  Factor Analysis: Statistical Methods and Practical Issues , 1978 .

[59]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.

[60]  S. Briggs,et al.  The role of factor analysis in the development and evaluation of personality scales , 1986 .

[61]  N Cliff,et al.  Some Cautions Concerning The Application Of Causal Modeling Methods. , 1983, Multivariate behavioral research.

[62]  Peter F. Merenda,et al.  A Guide to the Proper Use of Factor Analysis in the Conduct and Reporting of Research: Pitfalls to Avoid , 1997 .

[63]  Matthias Burisch,et al.  Approaches to personality inventory construction: A comparison of merits. , 1984 .

[64]  K. Fox,et al.  A Social-Cognitive Investigation into the Mechanisms of Affect Generation in Children’s Physical Activity , 1996 .

[65]  J. Annesi,et al.  Effects of Virtual Reality-Enhanced Exercise Equipment on Adherence and Exercise-Induced Feeling States , 1997, Perceptual and motor skills.

[66]  L. Braconi.  Anastasi Anne: Psychological testing. The Macmillan Co. New York 2a ed. 1962. , 1962 .

[67]  L. Cronbach.  Essentials of psychological testing , 1960 .

[68]  Hakstian Ar,et al.  The Behavior of Number-of-Factors Rules with Simulated Data. , 1982 .

[69]  D. Veldman.  SIMPLE STRUCTURE AND THE NUMBER OF FACTORS PROBLEM. , 1974, Multivariate behavioral research.

[70]  R. Thayer.  The biopsychology of mood and arousal , 1989 .

[71]  J. Russell.  A circumplex model of affect. , 1980 .

[72]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[73]  S. Haynes,et al.  Content validity in psychological assessment: A functional approach to concepts and methods. , 1995 .

[74]  C Loehlin John,et al.  Latent variable models: an introduction to factor, path, and structural analysis , 1986 .

[75]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[76]  W F Velicer,et al.  Factors Influencing Four Rules For Determining The Number Of Components To Retain. , 1982, Multivariate behavioral research.

[77]  L. Gauvin,et al.  The Curse of Inactivity , 1997, Journal of health psychology.

[78]  P. Bentler,et al.  Evaluating model fit. , 1995 .

[79]  Robert C. MacCallum,et al.  Model specification: Procedures, strategies, and related issues. , 1995 .

[80]  R. Gorsuch,et al.  Component analysis versus common factor analysis: A Monte Carlo study. , 1989 .

[81]  L. Wheeler,et al.  Review of personality and social psychology , 1980 .

[82]  R. Larsen,et al.  Promises and problems with the circumplex model of emotion. , 1992 .

[83]  J. Norris,et al.  Effects of baseline responses, in-task feelings, and duration of activity on exercise-induced feeling states in women. , 1995, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[84]  A. Meskó,et al.  Examination of exercise-induced feeling states in four modes of exercise. , 1998 .

[85]  D. Wegener,et al.  The problem of equivalent models in applications of covariance structure analysis. , 1993, Psychological bulletin.

[86]  A. Comrey.  Factor-analytic methods of scale development in personality and clinical psychology. , 1988, Journal of consulting and clinical psychology.

[87]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[88]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[89]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[90]  H. Kaiser.  The Application of Electronic Computers to Factor Analysis , 1960 .

[91]  S. Mulaik,et al.  EVALUATION OF GOODNESS-OF-FIT INDICES FOR STRUCTURAL EQUATION MODELS , 1989 .

[92]  Anthony G. Greenwald,et al.  Applications of Covariance Structure Modeling in Psychology : Cause for Concern ? , 2001 .

[93]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[94]  Robert MacCallum,et al.  A comparison of factor analysis programs in SPSS, BMDP, and SAS , 1983 .

[95]  Howard B. Lee,et al.  A First Course in Factor Analysis 2nd Ed , 1973 .

[96]  C. Bouchard,et al.  Physical Activity, Fitness, and Health: International Proceedings and Consensus Statement , 1994 .

[97]  D. Cole.  Utility of confirmatory factor analysis in test validation research. , 1987, Journal of consulting and clinical psychology.

[98]  P. Schonemann.  Facts, Fictions, and Common Sense About Factors and Components. , 1990, Multivariate behavioral research.

[99]  Peter Burke,et al.  Exploratory and confirmatory tests of the big five and Tellegen's three- and four-dimensional models. , 1994 .

[100]  R. MacCallum,et al.  THE APPLICATION OF EXPLORATORY FACTOR ANALYSIS IN APPLIED PSYCHOLOGY: A CRITICAL REVIEW AND ANALYSIS , 1986 .

[101]  P. Ekkekakis,et al.  Measuring state anxiety in the context of acute exercise using the state anxiety inventory: an attempt to resolve the Brouhaha. , 1999 .