The Construct Validity of Student Engagement: A Confirmatory Factor Analysis Approach

As institutions seek to promote student engagement on campus, the National Survey of Student Engagement (NSSE) is increasingly being used to chart progress and compare results using the Five Benchmark Scores. While recent research has begun to decompose the five benchmarks in a variety of ways; few research studies have sought to explore the underlying structure of these five benchmarks, their interdependence, and the extent to which the items do reflect those five dimensions. This study begins to address the instrument’s construct validity by submitting a single, first-time freshman cohort’s NSSE responses to a confirmatory factor analysis, and proposes as an alternative, eight “dimensions” of student engagement that fit this set of data slightly better and in a more useful way. Results have practical implications for institutions utilizing NSSE, but also contain conceptual implications pertaining to the application of these benchmarks.

[1]  J. S. Long Confirmatory Factor Analysis: A Preface to Lisrel , 1983 .

[2]  J. Long Confirmatory Factor Analysis , 1983 .

[3]  R. Linn Educational measurement, 3rd ed. , 1989 .

[4]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[5]  Book Review: Contributing to Learning: The Role of Student Affairs and Student Learning Outside the Classroom: Transcending Artificial Boundaries , 1998 .

[6]  George D. Kuh What We're Learning About Student Engagement From NSSE: Benchmarks for Effective Educational Practices , 2003 .

[7]  J. Loevinger Objective Tests as Instruments of Psychological Theory , 1957 .

[8]  E. A. Olson,et al.  The Impact of On-campus Student Growth on First-year Student Engagement and Success , 2007 .

[9]  Megan M. Palmer,et al.  Women Students at Coeducational and Women's Colleges: How Do Their Experiences Compare? , 2007 .

[10]  Jorge J. Wellmann The National Survey of Student Engagement , 2010 .

[11]  E. Pedhazur Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[12]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[13]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[14]  Amaury Nora,et al.  The construct validity of Institutional Commitment: A confirmatory factor analysis , 1993 .

[15]  Ernest T. Pascarella,et al.  How college affects students , 1991 .

[16]  D. Borsboom Educational Measurement (4th ed.) , 2009 .

[17]  Ernest T. Pascarella,et al.  Effects of Teacher Organization/Preparation and Teacher Skill/Clarity on General Cognitive Skills in College. , 1996 .

[18]  Ernest T. Pascarella How College Affects Students: Ten Directions for Future Research , 2006 .

[19]  Gary R. Pike,et al.  The relationship between self reports of college experiences and achievement test scores , 1995 .

[20]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1975 .

[21]  Joe Ludlum,et al.  Validating NSSE Against Student Outcomes: Are They Related? , 2008 .

[22]  Carol L. Colbeck,et al.  Developing Performance Indicators for Assessing Classroom Teaching Practices and Student Learning , 2001 .

[23]  Alan Gellin,et al.  The Effect of Undergraduate Student Involvement on Critical Thinking: A Meta-Analysis of the Literature 1991-2000 , 2003 .

[24]  John M. Braxton Student Success in College: Creating Conditions That Matter , 2005 .

[25]  George D. Kuh,et al.  "They shall be known by what they do": An activities-based typology of college students , 2000 .

[26]  George D. Kuh,et al.  Student Engagement and Student Learning: Testing the Linkages* , 2006 .

[27]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[28]  A. Field Discovering statistics using SPSS for Windows. , 2000 .

[29]  John C. Hayek,et al.  Institutional Selectivity and Good Practices in Undergraduate Education: How Strong is the Link? , 2006 .

[30]  G. Pike The Convergent and Discriminant Validity of NSSE Scalelet Scores , 2006 .

[31]  Tapabrata Maiti,et al.  Principles and Practice of Structural Equation Modeling (2nd ed.) , 2006 .

[32]  C. Colbeck,et al.  Learning Professional Confidence: Linking Teaching Practices, Students' Self-Perceptions, and Gender , 2000 .

[33]  J. C. Smart,et al.  Higher Education: Handbook of Theory and Research , 2001, Higher Education: Handbook of Theory and Research.

[34]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[35]  Ernest T. Pascarella,et al.  How College Affects Students: A Third Decade of Research. Volume 2. , 2005 .

[36]  A. Chickering,et al.  Seven Principles for Good Practice in Undergraduate Education , 1987, CORE.