Students’ evaluation of teaching at a large Italian university: measurement scale validation

The paper aims to verify the measurement capacity of the tool of teaching assessment at the University of Padua, Italy. The study is part of a project of improvement of the academic education innovation and quality of academic teaching: an evaluative research approach allows, indeed, reflection on teaching practice useful to share problems and find common solutions. The focus of this work is on contents and characteristics of statistical validty and reliability of the instrument used at Padua University, in the online survey to measure students' opinions on didactic activities (first-cycle, second-cycle and single-cycle degree courses).

[1]  Héctor Grad,et al.  The dimensionality of student ratings of teaching: integration of uni‐ and multidimensional models , 2005 .

[2]  Ulrich Trautwein,et al.  Please Scroll down for Article Structural Equation Modeling: a Multidisciplinary Journal Exploratory Structural Equation Modeling, Integrating Cfa and Efa: Application to Students' Evaluations of University Teaching , 2022 .

[3]  Pieter Spooren,et al.  On the credibility of the judge: A cross-classified multilevel analysis on students’ evaluation of teaching , 2010 .

[4]  William E. Cashin,et al.  Student Ratings of Teaching : A Summary of Research and Literature , 2012 .

[5]  Bruce M. Perrin,et al.  IDEA Technical Report No. 4. Description of IDEA Standard Form Data Base. , 1978 .

[6]  F. Bassi.  Experiential Goods and Customer Satisfaction: An Application to Films , 2010 .

[7]  P. Spooren,et al.  A revalidation of the SET37 questionnaire for student evaluations of teaching , 2009 .

[8]  H. Rindermann,et al.  Generalizability of Multidimensional Student Ratings of University Instruction Across Courses and Teachers , 2001 .

[9]  Andrew Jones.  Defining quality. , 2010, The Health service journal.

[10]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[11]  Dirk Van Damme,et al.  Quality Culture in European Universities: A Bottom-Up Approach: Report on the Three Rounds of the Quality Culture Project 2002-2006 , 2006 .

[12]  P. Spooren,et al.  On the Validity of Student Evaluation of Teaching , 2013 .

[13]  Michael D. Toland,et al.  A Multilevel Factor Analysis of Students’ Evaluations of Teaching , 2005 .

[14]  鄭宇庭.  行銷硏究 : Marketing research , 2009 .

[15]  Charles A. Burdsal,et al.  Further evidence supporting the validity of both a multidimensional profile and an overall evaluation of teaching effectiveness , 2008 .

[16]  Winnie Jenkins,et al.  Adult students' perceptions of good teaching as a function of their conceptions of learning—Part 2. Implications for the evaluation of teaching , 2004 .

[17]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[18]  Gilbert A. Churchill.  A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[19]  Vernon D. Miller,et al.  The Influence of Student Sex and Instructor Sex on Student Ratings of Instructors: Results from a College of Communication , 2007 .

[20]  Herbert W. Marsh,et al.  Multiple dimensions of university teacher self-concept , 2000 .

[21]  Mark S. Litwin,et al.  How to Measure Survey Reliability and Validity , 1995 .

[22]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[23]  Kathleen M. T. Collins,et al.  Students’ Perceptions of Characteristics of Effective College Teachers: A Validity Study of a Teaching Evaluation Form Using a Mixed-Methods Analysis , 2007 .

[24]  L. Harvey.  UNDERSTANDING QUALITY , 2012 .

[25]  Tanya N. Beran,et al.  Ratings of university teacher instruction: how much do student and course characteristics really matter? , 2005 .

[26]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[27]  David Nicol,et al.  Teaching Tips: Strategies, Research, and Theory for College and University Teachers , 1994 .

[28]  Charles A. Burdsal,et al.  The Relative Merits of Different Types of Overall Evaluations of Teaching Effectiveness , 2004 .

[29]  Herbert W. Marsh,et al.  SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students' Evaluations of University Teaching. , 1982 .

[30]  D. Aaker,et al.  Chapter 2 – Marketing research , 2004 .

[31]  T. E. Dinero.  Scale development. , 1996, Journal of health & social policy.

[32]  Alenoush Saroyan,et al.  Evaluating University Teaching: Time to take stock , 2001 .

[33]  J. Centra,et al.  Is There Gender Bias in Student Evaluations of Teaching? , 2000 .

[34]  H. Marsh,et al.  Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. , 1997 .

[35]  Carmen Pozo-Muñoz,et al.  The 'Ideal Teacher'. Implications for student evaluation of teacher effectiveness , 2000 .

[36]  Omar Paccagnella,et al.  Tools for teaching assessment at Padua University: role, development and validation. PRODID Project (Teacher professional development and academic educational innovation) - Report of the Research Unit n.3 , 2015 .

[37]  L. M. Aleamoni.  Student Rating Myths Versus Research Facts from 1924 to 1998 , 1999 .

[38]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[39]  Francisco Zabaleta,et al.  The use and misuse of student evaluations of teaching , 2007 .

[40]  Dennis E. Clayson,et al.  Student Evaluations of Teaching: Are They Related to What Students Learn? , 2009 .

[41]  S. Barrie,et al.  Students’ perceptions of teaching quality in higher education: the perspective of currently enrolled students , 2007 .

[42]  F. Betoret,et al.  Evaluation of the University Teaching/Learning Process for the Improvement of Quality in Higher Education , 2003 .

[43]  D. Kember,et al.  Establishing the validity and reliability of course evaluation questionnaires , 2008 .

[44]  Gary S. Goldstein,et al.  STUDENTS’ AND INSTRUCTORS’ BELIEFS ABOUT EXCELLENT LECTURERS AND DISCUSSION LEADERS , 2006 .

[45]  Derek Cheung,et al.  Evidence of a Single Second-Order Factor in Student Ratings of Teaching Effectiveness , 2000 .

[46]  H. Marsh.  Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[47]  D. Green.  What Is Quality in Higher Education , 1993 .

[48]  P. Ramsden.  A performance indicator of teaching quality in higher education: The Course Experience Questionnaire , 1991 .