The development and psychometric validation of a Critical Thinking Disposition Scale

Abstract This article describes the development and psychometric evaluation of a Critical Thinking Disposition Scale (CTDS). Items for the scale were generated using taxonomies of important thinking dispositions discussed in the literature. Participants comprised of two cohorts of first year undergraduate and graduate students enrolled on a programme in education. Psychometric evaluation was carried out using two studies. In Study 1, an exploratory factor analysis (n = 467) revealed a two-factor model for the scale: Critical Openness and Reflective Scepticism. In Study 2 (n = 371), a multigroup confirmatory factor analysis (MGCFA) supported the two-factor model across both undergraduate and graduate groups. Results from the MGCFA showed that both groups understood the items in a similar way, and the CTDS successfully discriminated between these theoretically different groups. Educators, psychologists and researchers may find the CTDS a useful tool for measuring individuals’ disposition to critical thinking. Immediate future research should focus on establishing the strength of relationship between the CTDS and other cognitive measures of critical thinking.

[1]  Robert H. Ennis.  Nationwide Testing of Critical Thinking for Higher Education: Vigilance Required , 2008 .

[2]  X. Koufteros.  Testing a model of pull production: a paradigm for manufacturing research using structural equation modeling , 1999 .

[3]  P. Bentler,et al.  Evaluating model fit. , 1995 .

[4]  D. Perkins,et al.  Beyond Abilities: A Dispositional Theory of Thinking. , 1993 .

[5]  C. M. Walsh,et al.  Factor Structure Stability of the California Critical Thinking Disposition Inventory across Sex and Various Students' Majors , 1997 .

[6]  Janke Cohen-Schotanus,et al.  The development of a scale to measure personal reflection in medical practice and education , 2007, Medical teacher.

[7]  Robert H. Ennis.  Critical thinking assessment , 1993 .

[8]  M. Hagger,et al.  Factorial validity and measurement invariance of the Revised Physical Self-Perception Profile (PSPP-R) in three countries , 2011, Psychology, health & medicine.

[9]  Gina J. Medsker,et al.  A Review of Current Practices for Evaluating Causal Models in Organizational Behavior and Human Resources Management Research , 1994 .

[10]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[11]  David Kember,et al.  Development of a Questionnaire to Measure the Level of Reflective Thinking , 2000 .

[12]  P. Facione.  Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction. Research Findings and Recommendations. , 1990 .

[13]  J. McPeck.  Critical Thinking and Subject Specificity: A Reply to Ennis , 1990 .

[14]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[15]  P. Schuster,et al.  Evaluation of critical thinking in a baccalaureate nursing program. , 1999, The Journal of nursing education.

[16]  H. Kaiser.  The Application of Electronic Computers to Factor Analysis , 1960 .

[17]  J. Steenkamp,et al.  Assessing Measurement Invariance in Cross-National Consumer Research , 1998 .

[18]  W. G. Perry.  Forms of Intellectual and Ethical Development in the College Years: A Scheme. Jossey-Bass Higher and Adult Education Series. , 1970 .

[19]  Jane S. Halonen.  Demystifying Critical Thinking , 1995 .

[20]  E. Glaser.  Watson-Glaser Critical Thinking Appraisal ® , 2008 .

[21]  K. Stanovich,et al.  Heuristics and Biases as Measures of Critical Thinking: Associations with Cognitive Ability and Thinking Dispositions , 2008 .

[22]  K. Stanovich,et al.  Cognitive Ability, Thinking Dispositions, and Instructional Set as Predictors of Critical Thinking. , 2007 .

[23]  J. Cacioppo,et al.  DISPOSITIONAL DIFFERENCES IN COGNITIVE MOTIVATION : THE LIFE AND TIMES OF INDIVIDUALS VARYING IN NEED FOR COGNITION , 1996 .

[24]  R. Henson,et al.  Use of Exploratory Factor Analysis in Published Research , 2006 .

[25]  R. MacCallum,et al.  Applications of structural equation modeling in psychological research. , 2000, Annual review of psychology.

[26]  A. Onwuegbuzie,et al.  Critical Thinking Disposition and Library Anxiety: Affective Domains on the Space of Information Seeking and Use in Academic Libraries , 2007 .

[27]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[28]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[29]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[30]  Matthew J. Grawitch,et al.  Work flexibility or nonwork support? Theoretical and empirical distinctions for work–life initiatives. , 2010 .

[31]  Eldad Davidov,et al.  A cross-country and cross-time comparison of the human values measurements with the second round of the European Social Survey , 2008 .

[32]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[33]  Kurt T. Taube.  Critical Thinking Ability and Disposition as Factors of Performance on a Written Critical Thinking Test. , 1995 .

[34]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[35]  Daniel A. Sass,et al.  Rotation Criteria and Hypothesis Testing for Exploratory Factor Analysis: Implications for Factor Pattern Loadings and Interfactor Correlations , 2011 .

[36]  B. Haig.  Exploratory Factor Analysis, Theory Generation, and Scientific Method , 2005, Multivariate behavioral research.

[37]  Kelly Y.L. Ku,et al.  Dispositional factors predicting Chinese students’ critical thinking performance , 2010 .

[38]  Peter M. Bentler,et al.  Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic , 2008, Psychometrika.

[39]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[40]  Robert S. Weisskirch,et al.  The American Identity Measure: Development and Validation across Ethnic Group and Immigrant Generation , 2012 .

[41]  R. Cudeck,et al.  Applications of standard error estimates in unrestricted factor analysis: significance tests for factor loadings and correlations. , 1994, Psychological bulletin.

[42]  P. Xiang,et al.  Dispositions Toward Critical Thinking: The preservice teacher's perspective , 2002 .

[43]  P. Costa,et al.  NEO inventories for the NEO Personality Inventory-3 (NEO-PI-3), NEO Five-Factor Inventory-3 (NEO-FFI-3), NEO Personality Inventory-Revised (NEO PI-R) : professional manual , 2010 .

[44]  B. Zumbo,et al.  A Test of the Age-Based Measurement Invariance and Temporal Stability of Antonovsky's Sense of Coherence Scale , 2007 .

[45]  Psychometric Properties of the California Critical Thinking Tests , 2001, Journal of Nursing Measurement.

[46]  D. Halpern.  Teaching critical thinking for transfer across domains. Dispositions, skills, structure training, and metacognitive monitoring. , 1998, The American psychologist.

[47]  Kelly Y. L. Ku,et al.  Assessing Students' Critical Thinking Performance: Urging for Measurements Using Multi-Response Format. , 2009 .

[48]  D. Annis.  Critical Thinking and Education , 1982 .

[49]  D. Russell.  In Search of Underlying Dimensions: The Use (and Abuse) of Factor Analysis in Personality and Social Psychology Bulletin , 2002 .

[50]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[51]  A. Boomsma.  Reporting Analyses of Covariance Structures , 2000 .

[52]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[53]  Minoo Alemi,et al.  The Relationship between Test Takers‟ Critical Thinking Ability and their Performance on the Reading Section of TOEFL , 2010 .

[54]  J. E. Kurtz,et al.  Personality Traits and Critical Thinking Skills in College Students , 2004, Assessment.

[55]  Joanne Profetto-McGrath,et al.  The relationship of critical thinking skills and critical thinking dispositions of baccalaureate nursing students. , 2003, Journal of advanced nursing.

[56]  H. Marsh,et al.  In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings , 2004 .

[57]  J. Horn.  A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[58]  R. Hoyle.  Structural equation modeling: concepts, issues, and applications , 1997 .

[59]  S. Noar.  The Role of Structural Equation Modeling in Scale Development , 2003 .

[60]  J. Pallant.  SPSS survival manual : a step-by-step guide to data analysis using SPSS version 15 , 2007 .

[61]  J. Kahn.  Factor Analysis in Counseling Psychology Research, Training, and Practice , 2006 .

[62]  R. P. McDonald,et al.  Principles and practice in reporting structural equation analyses. , 2002, Psychological methods.

[63]  Robert H. Ennis.  Critical Thinking Dispositions: Their Nature and Assessability , 1996 .

[64]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[65]  P. Stapleton.  A survey of attitudes towards critical thinking among Hong Kong secondary school teachers: Implications for policy change , 2011 .

[66]  Peter A. Facione,et al.  The Disposition toward Critical Thinking. , 1995 .

[67]  Lisa A. Seldomridge,et al.  California Critical Thinking Disposition Inventory: Further Factor Analytic Examination , 2007, Perceptual and motor skills.