The Flow State Scale-2 and Dispositional Flow Scale-2: Examination of factorial validity and reliability for Japanese adults

Abstract Objective The primary purpose of this study was to examine the factorial validity and reliability of the Japanese versions of the Flow State Scale-2 and Dispositional Flow Scale-2 (JFSS-2 and JDFS-2) for use with Japanese adults. Method To accomplish the aim, a multi-staged approach was employed. Following the guidelines for test adaptation [Tanzer, N. K., & Sim, C. Q. E. (1999). Adapting instruments for use in multiple languages and cultures: A review of the ITC guidelines for test adaptations. European Journal of Psychological Assessment, 15, 258–269], the two flow scales were translated from English to Japanese and the best 36 items for each instrument was identified through two pilot studies. Employing a 9-factor 1st-order hypothesized model, the factorial validity of the JFSS-2 and JDFS-2 was tested and cross-validated with confirmatory factor analysis (CFA). In addition to internal consistency reliability for the both scales, stability was assessed over a 4-week time period for the JDFS-2. Furthermore, measurement equivalence was examined across Japanese independent samples as well as two cultural samples. Results The results of a series of CFAs revealed that the data for the JFSS-2 and JDFS-2 were represented appropriately by the hypothesized 1st-order model. For the both scales, internal consistency estimates for all factors were satisfactory, whereas the stability of single factors over time were medium to high. Measurement invariance was established across the Japanese samples as well as the cultural samples. Conclusions The findings from this study provided strong support for the validity and reliability of the JFSS-2 and JDFS-2 in assessing flow experiences in physical activity for Japanese adults. In addition, this study indicated that the Japanese versions of the flow scales are useful instruments for cross-cultural research.

[1]  D. Cooke,et al.  Psychopathy and ethnicity: structural, item, and test generalizability of the Psychopathy Checklist--Revised (PCL-R) in Caucasian and African American Participants. , 2001, Psychological assessment.

[2]  Barbara M. Byrne,et al.  Validating the Beck Depression Inventory-II for Hong Kong Community Adolescents , 2004 .

[3]  M. Csíkszentmihályi.  Beyond boredom and anxiety , 1975 .

[4]  R. Eklund,et al.  Assessing Flow in Physical Activity: The Flow State Scale-2 and Dispositional Flow Scale-2 , 2002 .

[5]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[6]  Jean F. Fournier,et al.  French translation of the Flow State Scale-2: Factor structure, cross-cultural invariance, and associations with goal attainment , 2007 .

[7]  C. R. Snyder,et al.  Handbook of positive psychology , 2002 .

[8]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[9]  S. Vlachopoulos,et al.  Factor Structure and Internal Consistency of the Greek Version of the Flow State Scale , 2000, Perceptual and motor skills.

[10]  Top-down, bottom-up, and horizontal models: the direction of causality in multidimensional, hierarchical self-concept models. , 1998, Journal of personality and social psychology.

[11]  S. West,et al.  Teacher's Corner: Testing Measurement Invariance of Second-Order Factor Models , 2005 .

[12]  M. Csíkszentmihályi,et al.  Optimal experience: Psychological studies of flow in consciousness. , 1988 .

[13]  H. Marsh,et al.  Self-Concept Contributes to Winning Gold Medals: Causal Ordering of Self-Concept and Elite Swimming Performance , 2005 .

[14]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[15]  Marta Bassi,et al.  Adolescence and the Changing Context of Optimal Experience in Time: Italy 1986–2000 , 2004 .

[16]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[17]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[18]  G. Moneta.  The Flow Model of Intrinsic Motivation in Chinese: Cultural and Personal Moderators , 2004 .

[19]  H. Marsh,et al.  Assessing Goodness of Fit: Is Parsimony Always Desirable? , 1996 .

[20]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[21]  Giovanni B. Moneta,et al.  The Flow Experience Across Cultures , 2004 .

[22]  Joan L. Duda,et al.  Advances in sport and exercise psychology measurement , 1998 .

[23]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[24]  P. Terry,et al.  Hierarchical confirmatory factor analysis of the Flow State Scale in exercise , 2000, Journal of sports sciences.

[25]  B. Byrne.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[26]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[27]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[28]  D. Chan,et al.  Detection of Differential Item Functioning on the Kirton Adaption-Innovation Inventory Using Multiple-Group Mean and Covariance Structure Analyses , 2000, Multivariate behavioral research.

[29]  M. Csíkszentmihályi,et al.  Positive psychology. An introduction. , 2000, The American psychologist.

[30]  H. Marsh,et al.  Cross-Cultural Validity of the Physical Self-Description Questionnaire: Comparison of Factor Structures in Australia, Spain, and Turkey , 2002, Research quarterly for exercise and sport.

[31]  Herbert W. Marsh,et al.  Psychological Correlates of Flow in Sport , 1998 .

[32]  Xitao Fan,et al.  Sensitivity of Fit Indexes to Misspecified Structural or Measurement Model Components: Rationale of Two-Index Strategy Revisited , 2005 .

[33]  T. Little.  Mean and Covariance Structures (MACS) Analyses of Cross-Cultural Data: Practical and Theoretical Issues. , 1997, Multivariate behavioral research.

[34]  Herbert W. Marsh,et al.  Flow experience in sport: Construct validation of multidimensional, hierarchical state and trait responses , 1999 .

[35]  M. Csíkszentmihályi,et al.  Experience Sampling Method: Measuring the Quality of Everyday Life , 2006 .

[36]  Mark L. Mitchell,et al.  Research Design Explained , 1987 .

[37]  H. Marsh,et al.  In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings , 2004 .

[38]  Norbert K Tanzer,et al.  Adapting Instruments for Use in Multiple Languages and Cultures: A Review of the ITC Guidelines for Test Adaptations , 1999 .

[39]  K. Asakawa.  Flow Experience and Autotelic Personality in Japanese College Students: How do they Experience Challenges in Daily Life? , 2004 .

[40]  N. Stavrou,et al.  Confirmatory factor analysis of the flow state scale in sports , 2004 .

[41]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[42]  Andrew J. Martin,et al.  The Psychological Performance Inventory: Is the mental toughness test tough enough? , 2004 .

[43]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[44]  H. Marsh,et al.  Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale , 1996 .

[45]  Mihaly Csikszentmihalyi,et al.  Optimal experience: The future of flow , 1988 .

[46]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[47]  Ronald K. Hambleton,et al.  Evaluating the Equivalence of Different Language Versions of a Credentialing Exam , 2003 .

[48]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .