Assessing Learning Gains

Over the last 30 years a range of assessment strategies have been developed aiming to effectively capture students’ learning in Higher Education and one such strategy is measuring students’ learning gains. The main goal of this study was to examine whether academic performance within modules is a valid proxy for estimating students’ learning gains. A total of 17,700 Science and Social Science students in 111 modules at the Open University UK were included in our three-level linear growth-curve model. Results indicated that for students studying in Science disciplines modules, module accounted for 33% of variance in students’ initial achievements, and 26% of variance in subsequent learning gains, whereas for students studying in Social Science disciplines modules, module accounted for 6% of variance in initial achievements, and 19% or variance in subsequent learning gains. The importance of the nature of the consistent, high quality assessments in predicting learning gains is discussed.

[1]  Mark C. Long,et al.  Why Are Men Falling Behind? Gender Gaps in College Performance and Persistence , 2010 .

[2]  Kelly E. Matthews,et al.  Perceptions of Science Graduating Students on their Learning Gains , 2014 .

[3]  T. Grandon Gill,et al.  Taking a Case Method Capstone Course Online: A Comparative Case Study. , 2015 .

[4]  L. Cronbach,et al.  How we should measure "change": Or should we? , 1970 .

[5]  Robert M. Gonyea Self‐reported data in institutional research: Review and recommendations , 2005 .

[6]  C. Mortensen,et al.  The flipped classroom stimulates greater learning and is a modern 21st century approach to teaching today's undergraduates. , 2015, Journal of animal science.

[7]  Jekaterina Rogaten,et al.  Positive and Negative Structures and Processes Underlying Academic Performance: A Chained Mediation Model , 2017 .

[8]  Nicholas A. Bowman The Development of Psychological Well-Being Among First-Year College Students , 2010 .

[9]  Matthew J. Mayhew A Multilevel Examination of the Influence of Institutional Type on the Moral Reasoning Development of First-Year Students , 2012 .

[10]  Robert L. Linn,et al.  The Determination of the Significance of Change Between Pre- and Posttesting Periods , 1977 .

[11]  William J. Browne,et al.  A User's Guide To Mlwin , 2015 .

[12]  Joanna Bull,et al.  Assessing student learning in higher education , 1997 .

[13]  Frederic M. Lord,et al.  The Measurement of Growth , 1956 .

[14]  G. Boulton‐Lewis Teaching for quality learning at university , 2008 .

[15]  K. Anders Ericsson,et al.  Why study time does not predict grade point average across college students: Implications of deliberate practice for academic performance , 2005 .

[16]  Gary R. Pike,et al.  Lies, damn lies, and statistics revisited a comparison of three methods of representing change , 1991 .

[17]  D. Ojennus,et al.  Assessment of learning gains in a flipped biochemistry classroom , 2016, Biochemistry and molecular biology education : a bimonthly publication of the International Union of Biochemistry and Molecular Biology.

[18]  Ronny Scherer,et al.  Developing a computer-based assessment of complex problem solving in Chemistry , 2014 .

[19]  Christopher W. Beck,et al.  Inquiry‐based ecology laboratory courses improve student confidence and scientific reasoning skills , 2012 .

[20]  Denise Whitelock,et al.  e-Assessment tales: what types of literature are informing day-to-day practice? , 2013 .

[21]  D. Dimitrov,et al.  Pretest-posttest designs and measurement of change. , 2003, Work.

[22]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[23]  Mark H. Salisbury,et al.  Some Complexities in the Effects of Diversity Experiences on Orientation Toward Social/Political Activism and Political Views in the First Year of College , 2012 .

[24]  R. Hake Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses , 1998 .

[25]  John T. E. Richardson,et al.  The under-attainment of ethnic minority students in UK higher education: what we know and what we don’t know , 2015 .

[26]  Denise Whitelock,et al.  Maximising Student Success with Automatic Formative Feedback for Both Teachers and Students , 2015, CAA.

[27]  Ernest T. Pascarella,et al.  Influencing Academic Motivation: The Effects of Student–Faculty Interaction , 2016 .

[28]  Frederic M. Lord,et al.  Further Problems in the Measurement of Growth , 1958 .

[29]  Julie L. Booth,et al.  Instructional Complexity and the Science to Constrain It , 2013, Science.

[30]  Dirk T. Tempelaar,et al.  In search for the most informative data for feedback generation: Learning analytics in a data-rich context , 2015, Comput. Hum. Behav..

[31]  D. Carless,et al.  Developing sustainable feedback practices , 2011 .

[32]  Denise Whitelock,et al.  The promise and potential of e-assessment for learning , 2015 .

[33]  C. Horn,et al.  Standardized Assessments and the Flow of Students Into the College Admission Pool , 2005 .

[34]  Yvonne Hodgson,et al.  Assessment and teaching of science skills: whole of programme perceptions of graduating students , 2014 .

[35]  Chun-Mei Zhao,et al.  The learning outcomes race: the value of self-reported gains in large research universities , 2012 .

[36]  Denise Whitelock,et al.  Activating Assessment for Learning: Are We on the Way with Web 2.0? , 2010 .

[37]  D P Farrington,et al.  Longitudinal research strategies: advantages, problems, and prospects. , 1991, Journal of the American Academy of Child and Adolescent Psychiatry.

[38]  John Rose-Adams,et al.  Black and minority ethnic student attainment: a survey of research and exploration of the importance of teacher and student expectations , 2014 .

[39]  Daniel Teodorescu,et al.  Leadership Development on a Diverse Campus , 2014 .

[40]  Denise Whitelock,et al.  Designing and testing visual representations of draft essays for higher education students , 2014 .

[41]  Lambert Schuwirth,et al.  Optimising new modes of assessment: in search of qualities and standards , 2004 .

[42]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[43]  D. Carless Trust, distrust and their impact on assessment reform , 2009 .

[44]  Guadalupe Anaya,et al.  COLLEGE IMPACT ON STUDENT LEARNING: Comparing the Use of Self-Reported Gains, Standardized Test Scores, and College Grades , 1999 .

[45]  Nicholas A. Bowman Can 1st-Year College Students Accurately Report Their Learning and Development? , 2010 .

[46]  Bart Rienties,et al.  The impact of learning design on student behaviour, satisfaction and performance: A cross-institutional comparison across 151 modules , 2016, Comput. Hum. Behav..

[47]  D. Boud,et al.  Aligning assessment with long‐term learning , 2006 .

[48]  Royce Sadler Book Review. Segers, M., Dochy, F. & Cascallar, E. (Eds). (2003). Optimising new modes of assessment: In search of qualities and standards. Dordrecht, Netherlands: Kluwer. , 2004 .

[49]  D. Sluijsmans,et al.  Effective peer assessment processes: Research findings and future directions , 2010 .

[50]  Dirk Ifenthaler,et al.  Cognitive, metacognitive and motivational perspectives on preflection in self-regulated online learning , 2014, Comput. Hum. Behav..

[51]  M Martin,et al.  The 'gender gap' in final examination results at Oxford University. , 2000, British journal of psychology.

[52]  Alfred K. Anderson,et al.  An Assessment of the Perception of Learning Gains of Freshmen Students in an Introductory Course in Nutrition and Food Science , 2006 .

[53]  Mark A. McDaniel,et al.  Multiyear, Multi-Instructor Evaluation of a Large-Class Interactive-Engagement Curriculum. , 2014 .

[54]  Anastasios A. Economides,et al.  The acceptance and use of computer based assessment , 2011, Comput. Educ..

[55]  Jamie L. Jensen,et al.  Improvements from a Flipped Classroom May Simply Be the Fruits of Active Learning , 2015, CBE life sciences education.

[56]  John T. E. Richardson,et al.  The attainment of White and ethnic minority students in distance education , 2012 .

[57]  S. Kalinowski,et al.  Active Learning Not Associated with Student Learning in a Random Sample of College Biology Courses , 2011, CBE life sciences education.

[58]  Lei Baoa,et al.  Theoretical comparisons of average normalized gain calculations , 2006 .

[59]  R. Hake Lessons from the Physics Education Reform Effort , 2001, physics/0106087.

[60]  Grace S Kao,et al.  Racial and Ethnic Stratification in Educational Achievement and Attainment , 2003 .

[61]  J. Stephenson Visible learning and the science of how we learn , 2014 .

[62]  David Nicol,et al.  From monologue to dialogue: improving written feedback processes in mass higher education , 2010 .

[63]  Clarissa Dirks,et al.  Teaching the Process of Science: Faculty Perceptions and an Effective Methodology , 2010, CBE life sciences education.

[64]  Trevor R Anderson,et al.  A Model of How Different Biology Experts Explain Molecular and Cellular Mechanisms , 2015, CBE life sciences education.