Theory-Based Evaluation of Instruction: Implications for Improving Student Learning Achievement in Postsecondary Education

While student global ratings of college courses historically predict learning achievement, the majority of recent U.S. college graduates lack proficiency in desired skills. Teaching and Learning Quality (TALQ), a new course evaluation instrument, was developed from extant instructional theory that promotes student learning. A survey of 193 students in 111 different courses at multiple institutions was conducted using TALQ. Results indicated strong associations among student ratings of First Principles of Instruction, academic learning time, perceptions of learning gains, satisfaction with courses, perceived mastery of course objectives, and their overall evaluation of courses and instructors. Instructors can implement the theoretically derived First Principles of Instruction by challenging students with real-world problems or tasks, activating student learning, demonstrating what is to be learned, providing feedback on student learning attempts, and encouraging student integration of learning into their personal lives.

[1]  Justin D. Baer,et al.  The Literacy of America's College Students. , 2006 .

[2]  Charles R. Emery,et al.  Return to academic standards: a critique of student evaluations of teaching effectiveness , 2003 .

[3]  Meredith D. Gall,et al.  Far West Laboratory for Educational Research and Development. , 1971 .

[4]  Byron W. Brown,et al.  Measuring the Effects of Instructional Time on Student Learning: Evidence from the Beginning Teacher Evaluation Study , 1986, American Journal of Education.

[5]  Rainer Bromme,et al.  The Nature of Time in Schools: Theoretical Concepts, Practitioner Perceptions , 1991 .

[6]  David A. Squires,et al.  Effective Schools and Classrooms: A Research-Based Perspective , 1983 .

[7]  M. David Merrill,et al.  Prescriptive Principles for Instructional Design , 2007 .

[8]  W. Arthur,et al.  Teaching Effectiveness: The relationship between reaction and learning evaluation criteria , 2003 .

[9]  P. A. Cohen Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies , 1981 .

[10]  David C. Berliner,et al.  What's all the fuss about instructional time? , 1990 .

[11]  Donald L. Kirkpatrick,et al.  Evaluating Training Programs : The Four Levels , 2009 .

[12]  M. David Merrill,et al.  A Task-Centered Instructional Strategy. , 2007 .

[13]  Philip C. Abrami,et al.  Improving Judgments About Teaching Effectiveness Using Teacher Rating Forms , 2001 .

[14]  Theodore W. Frick Analysis of Patterns in Time: A Method of Recording and Quantifying Temporal Relations in Education , 1990 .

[15]  Roger E. Kirk,et al.  Experimental design: Procedures for the behavioral sciences (3rd ed.). , 1995 .

[16]  Dennis E. Clayson,et al.  Grades and the Student Evaluation of Instruction: A Test of the Reciprocity Effect , 2006 .

[17]  M. David Merrill,et al.  First principles of instruction , 2012 .

[18]  H. Marsh Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[19]  Theodore W. Frick,et al.  Improving course evaluations to improve instruction and complex learning in higher education , 2010 .

[20]  R. Kirk Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[21]  H. G. Murray,et al.  Using Multiple Outcomes to Validate Student Ratings of Overall Teacher Effectiveness. , 1995 .

[22]  H. G. Murray,et al.  Factorial Validity of Student Ratings of Instruction , 2005 .

[23]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[24]  Kenneth A. Feldman,et al.  The association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies , 1989 .

[25]  J. Kulik Student Ratings: Validity, Utility, and Controversy , 2001 .

[26]  P. Abrami,et al.  Validity of student ratings of instruction : what we know and what we do not , 1990 .