Making the Mark: Are Grades and Deep Learning Related?

Abstract Assessing gains in learning has received increased attention as one dimension of institutional accountability both in the USA (Arum and Roksa, Academically adrift: Limited learning on college campuses, 2011) and abroad (OECD, http://www.oecd.org/document/22/0,3746,en_2649_39263238_40624662_1_1_1_1,00.html, 2013, http://www.oecd.org/edu/skills-beyond-school/AHELOFSReportVolume2.pdf, 2012). Current approaches to assessing college learning are dominated by objective tests as well as student self-reported questionnaires, such as the National Survey of Student Engagement (NSSE). This study examined how the three NSSE deep approaches to learning scales contribute to the narrative on academic rigor at a large, public research institution. Using Confirmatory Factor Analyses and Structural Equation Modeling, results showed that the three deep approaches to learning constructs were internally valid, but deep learning was not related to GPA. Findings raised questions regarding good measurement of student learning and student reward for rigorous performance.

[1]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[2]  G. Boulton‐Lewis.  Teaching for quality learning at university , 2008 .

[3]  A. Cabrera,et al.  How Sound Is NSSE?: Investigating the Psychometric Properties of NSSE at a Public, Research-Extensive Institution , 2011 .

[4]  E. Pascarella,et al.  How Robust Are the Findings of Academically Adrift? , 2011 .

[5]  H. Marsh,et al.  The Reciprocal Internal/External Frame of Reference Model , 2011 .

[6]  Deborah Nusche,et al.  Assessment of Learning Outcomes in Higher Education: A Comparative Review of Selected Practices. OECD Education Working Papers, No. 15. , 2008 .

[7]  Noel Entwistle,et al.  Reconstituting approaches to learning: A response to Webb , 1997 .

[8]  D. Murphey,et al.  Academically Adrift: Limited Learning on College Campuses , 2011 .

[9]  Vincent Tinto,et al.  Leaving College: Rethinking the Causes and Cures of Student Attrition. , 1988 .

[10]  G. Pike.  The Convergent and Discriminant Validity of NSSE Scalelet Scores , 2006 .

[11]  Bradley E. Cox,et al.  Deep Learning as an Individual, Conditional, and Contextual Influence on First-Year Student Outcomes. , 2010 .

[12]  Stephen R. Porter.  Do College Student Surveys Have Any Validity? , 2011 .

[13]  Robert M. Gonyea,et al.  Using NSSE in institutional research , 2009 .

[14]  Michael Prosser,et al.  The “How” and “What” of learning physics , 1989 .

[15]  Gregory R. Hancock,et al.  Structural equation modeling : a second course , 2006 .

[16]  Li‐fang Zhang,et al.  University Students' Learning Approaches in Three Cultures: An Investigation of Biggs's 3P Model , 2000, The Journal of psychology.

[17]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[18]  E. Pascarella,et al.  Going Deep into Mechanisms for Moral Reasoning Growth: How Deep Learning Approaches Affect Moral Reasoning Development for First-year Students , 2012 .

[19]  R. Korn,et al.  Theoretical Foundations and a Research Agenda to Validate Measures of Intercultural Effort , 2011 .

[20]  Phil Wood.  Confirmatory Factor Analysis for Applied Research , 2008 .

[21]  Stephen Parker,et al.  Inside higher education , 2009 .

[22]  N. Entwistle,et al.  Understanding Student Learning , 1983 .

[23]  D. Cohen.  Chronicle of Higher Education , 1998 .

[24]  Ernest T. Pascarella.  How College Affects Students: Ten Directions for Future Research , 2006 .

[25]  J. Osborne.  Best Practices in Quantitative Methods , 2009 .

[26]  Noel Entwistle,et al.  Approaches to learning and perceptions of the learning environment , 1991 .

[27]  Marie Schmidt,et al.  Learning to Teach in Higher Education , 1992 .

[28]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[29]  S. Schwartz,et al.  Leaving College: Rethinking the Causes and Cures of Student Attrition , 1987 .

[30]  Joe Ludlum,et al.  Validating NSSE Against Student Outcomes: Are They Related? , 2008 .

[31]  Alberto F. Cabrera,et al.  The Construct Validity of Student Engagement: A Confirmatory Factor Analysis Approach , 2009 .

[32]  Ernest T. Pascarella,et al.  How College Affects Students: A Third Decade of Research. Volume 2. , 2005 .

[33]  Alex Casillas,et al.  Third-year College Retention and Transfer: Effects of Academic Performance, Motivation, and Social Connectedness , 2008 .

[34]  Brent Bridgeman,et al.  Measuring Learning Outcomes in Higher Education , 2012 .

[35]  T. Laird,et al.  The Predictive Validity of a Measure 1 Running Head : DEEP APPROACHES TO LEARNING The Predictive Validity of a Measure of Deep Approaches to Learning , 2008 .

[36]  S. Finney.  Nonnormal and categorical data in structural equation modeling , 2013 .

[37]  A. Carle,et al.  Psychometric Properties of Three New National Survey of Student Engagement Based Engagement Scales: An Item Response Theory Analysis , 2009 .

[38]  F. Marton,et al.  ON QUALITATIVE DIFFERENCES IN LEARNING: I—OUTCOME AND PROCESS* , 1976 .

[39]  J. Tagg.  The learning paradigm college , 2003 .

[40]  Gregory R. Hancock,et al.  BEST PRACTICES IN STRUCTURAL EQUATION MODELING , 2007 .

[41]  Barbara M. Byrne,et al.  Structural equation modeling with AMOS , 2010 .

[42]  Christian Geiser,et al.  Data Analysis with Mplus , 2012 .

[43]  A. Hodges.  Making a mark , 1999, BMJ.

[44]  George D. Kuh,et al.  The Effects of Discipline on Deep Approaches to Student Learning and College Outcomes , 2008 .