Assessing Enhancement of Learning, Personal Learning Environment, and Student Efficacy: Alternatives to Traditional Faculty Evaluation in Higher Education

This study was informed by three bodies of important literature: (1) research on faculty teaching performance and course evaluation in higher education, (2) research on students' personal (constructivist-based) views of characteristics of teaching and learning environments, and (3) human efficacy. The article describes the development and validation of a new measure designed to assess students' perceptions of the extent to which higher education learning environment characteristics enhance students' personal learning. Results of factor analyses of the Student Assessment of Teaching and Learning (SATL) and criterion-related validity analyses are reported for 2,190 students in 145 separate classes. Criteria used for analysis are (1) measures of students' perceptions of constructivist-based, personal learning environments and students' self-efficacy beliefs, (2) course emphasis on higher-order thinking skills and personal and applied knowledge, and (3) two summative judgments of overall course quality. Implications of the findings are discussed in light of using student rating information for formative evaluation purposes and using students' reflections on personal learning as an element of assessing the quality of teaching and learning in higher education settings. This latter view is contrasted to procedures that are more traditionally used to evaluate faculty, teaching, and course characteristics.

[1]  L. M. Aleamoni.  Student rating myths versus research facts , 1987 .

[2]  John A. Centra,et al.  Reflective Faculty Evaluation: Enhancing Teaching and Determining Faculty Effectiveness. The Jossey-Bass Higher and Adult Education Series. , 1993 .

[3]  Karen S. Loup,et al.  Measuring and Linking School Professional Learning Environment Characteristics, Teacher Self and Organizational Efficacy, Receptivity to Change, and Multiple Indices of School Effectiveness. , 1994 .

[4]  Frank M. Pajares,et al.  Self-Efficacy Beliefs in Academic Settings , 1996 .

[5]  Kenneth A. Feldman,et al.  Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers , 1989 .

[6]  Development, Validity and Reliability of a New Generation of Assessments of Effective Teaching and Learning: Future Directions for the Study of Learning Environments. , 1991 .

[7]  A. Bandura.  Self-efficacy: toward a unifying theory of behavioral change. , 1977, Psychological review.

[8]  E. A. Locke,et al.  Goal setting and task performance: 1969–1980. , 1981 .

[9]  Chad D. Ellett,et al.  The development, validity, and reliability of a faculty evaluation instrument to measure generic teaching skills and perceived enhancement of student learning , 1988 .

[10]  D. Treagust,et al.  Validation and Application of the College and University Classroom Environment Inventory (CUCEI). , 1986 .

[11]  Karen S. Loup,et al.  Exploring Dimensions of Personal and Organizational Efficacy Motivation: A Study of Teachers, Social Workers, and University Faculty. , 1997 .

[12]  Barry J. Fraser,et al.  Twenty years of classroom climate work: progress and prospect , 1989 .

[13]  D. Cervone,et al.  Anchoring, Efficacy and Action: The Influence of Judgmental Heuristics on Self-Efficacy Judgments a , 1986 .

[14]  B. Fraser,et al.  A comparison of actual and preferred classroom environments as perceived by science teachers and students , 1983 .

[15]  Andrew C. Porter,et al.  Synthesis of Research on Good Teaching: Insights from the Work of the Institute for Research on Teaching. , 1988 .

[16]  David F. Treagust,et al.  Development of an instrument for assessing classroom psychosocial environment at universities and colleges , 1986 .

[17]  A. Bandura.  Social Foundations of Thought and Action , 1986 .

[18]  Brenda H. Manning,et al.  Using Portfolios to Document Teaching Excellence. , 1996 .

[19]  Kathleen M. Quinlan,et al.  The Teaching Portfolio: Capturing the Scholarship in Teaching. , 1991 .

[20]  A. Bandura.  Self-efficacy mechanism in human agency. , 1982 .

[21]  Brian J. Furio.  The relationship between instructor behaviors and student perceptions of control in the classroom , 1986 .

[22]  C. Mcrobbie,et al.  Advances in Research on Educational Learning Environments. , 1997 .

[23]  Steven D. Brown,et al.  Relation of self-efficacy beliefs to academic outcomes: A meta-analytic investigation. , 1991 .

[24]  Peter Seldin,et al.  Successful use of teaching portfolios , 1993 .

[25]  P. A. Cohen.  Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multisection Validity Studies , 1981 .

[26]  Robert P. Steel,et al.  A meta-analytic study of the effects of goal setting on task performance: 1966-1984 , 1987 .

[27]  J. Brophy.  Teacher influences on student achievement. , 1986 .

[28]  B. Fraser.  Assessment of learning environments , 1982 .

[29]  Herbert J. Walberg,et al.  Educational environments : evaluation, antecedents and consequences , 1991 .

[30]  A. Bandura.  Perceived Self-Efficacy in Cognitive Development and Functioning , 1993, Educational Psychologist.

[31]  A. Bandura,et al.  Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. , 1983 .

[32]  Albert Bandura,et al.  Exercise of personal and collective efficacy in changing societies , 1995 .

[33]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .