EDUCATIONAL ASSESSMENT & EVALUATION | RESEARCH ARTICLE Understanding the effect of response rate and class size interaction on students evaluation of teaching in a higher education

1 Abstract: Objective: This study aims to investigate the interaction between response rate and class size and its effects on students' evaluation of instructors and the courses offered at a higher education Institution in Saudi Arabia. Study Design: A retrospective study design was chosen. Methods: One thousand four hundred and forty four different courses belonging to all the Colleges (N = 21) located across seven different campuses of University of Dammam (UOD) were considered in this study. All the course evaluation surveys (CES) (N = 168,574) conducted during the academic year 2013-2014 were analyzed to investigate response rate and class size interaction effect on students evaluation of courses and instructors. Results: It is observed that when the class size is at the medium level, the ratings of instructors and courses increase as the response rate increases. On the contrary; when the class size is small, a high response rate is required for the evaluation of instructors and at least medium response rate is required for evaluation of courses. The study suggests that the interaction between response rate and class size is an important factor that needs to be taken into account while interpreting the students' evaluation of instruc- tors and courses. Originality: This research study examined the effect of interaction

[1]  Peter Burden,et al.  Does the use of end of semester evaluation forms represent teachers’ views of teaching in a tertiary education context in Japan? , 2008 .

[2]  Yiannis Nikolaidis,et al.  On the student evaluation of university courses and faculty members' teaching performance , 2014, Eur. J. Oper. Res..

[3]  Robert W. Hanna,et al.  Gathering faculty teaching evaluations by in‐class and online surveys: their effects on response rates and evaluations , 2004 .

[4]  C. Conle.  Moments of interpretation in the perception and evaluation of teaching , 1999 .

[5]  P. Ramsden.  A performance indicator of teaching quality in higher education: The Course Experience Questionnaire , 1991 .

[6]  Gregory B. Merrill,et al.  Are Student Evaluations of Teaching Effectiveness Valid for Measuring Student Learning Outcomes in Business Related Classes? A Neural Network and Bayesian Analyses , 2011, Research in Higher Education.

[7]  P. Spooren,et al.  On the Validity of Student Evaluation of Teaching , 2013 .

[8]  D. D. Morley,et al.  Assessing the reliability of student evaluations of teaching: choosing the right coefficient , 2014 .

[9]  L. Kogan,et al.  Student evaluations of teaching: perceptions of faculty based on gender, position, and rank , 2010 .

[10]  Judy A. Shea,et al.  Course evaluation in medical education , 2007 .

[11]  Jennifer Franklin.  Interpreting the Numbers: Using a Narrative to Help Others Read Student Evaluations of Your Teaching Accurately , 2001 .

[12]  G. Boysen,et al.  The (mis)interpretation of teaching evaluations by college faculty and administrators , 2014 .

[13]  S. Freng,et al.  Turning up the Heat on Online Teaching Evaluations: Does “Hotness” Matter? , 2009 .

[14]  D. Watkins,et al.  Stability and correlates of student evaluations of teaching at a Chinese university , 2010 .

[15]  Abdullah Al Rubaish,et al.  Using Deductions from Assessment Studies towards Furtherance of the Academic Program: An Empirical Appraisal of Institutional Student Course Evaluation , 2011 .

[16]  Ijeoma Aniedi Archibong,et al.  Towards Improved Teaching Effectiveness in Nigerian Public Universities: Instrument Design and Validation , 2011 .

[17]  Francisco Zabaleta,et al.  The use and misuse of student evaluations of teaching , 2007 .

[18]  S. Barrie,et al.  Students’ perceptions of teaching quality in higher education: the perspective of currently enrolled students , 2007 .

[19]  Duncan David Nulty,et al.  The adequacy of response rates to online and paper surveys: what can be done? , 2008 .

[20]  Tanya N. Beran,et al.  What’s the “Use” of Student Ratings of Instruction for Administrators? One University’s Experience , 2007 .

[21]  Howard K Wachtel,et al.  Student Evaluation of College Teaching Effectiveness: a brief review , 1998 .

[22]  M. M. Konting,et al.  Quality Assurance in Higher Education Institutions: Exist Survey among Universiti Putra Malaysia Graduating Students , 2009 .

[23]  B. P. Smith.  Student Ratings of Teaching Effectiveness for Faculty Groups Based on Race and Gender. , 2009 .

[24]  Rachel Johnson,et al.  The Authority of the Student Evaluation Questionnaire , 2000 .

[25]  Marija Kuzmanovic,et al.  A Conjoint-based approach to student evaluations of teaching performance , 2013, Expert Syst. Appl..

[26]  Robert Sproule,et al.  Student Evaluation of Teaching: A Methodological Critique of Conventional Practices , 2000 .

[27]  Angela R. Penny.  Changing the Agenda for Research into Students' Views about University Teaching: Four shortcomings of SRT research , 2003 .

[28]  Masood A. Badri,et al.  Identifying Potential Biasing Variables in Student Evaluation of Teaching in a Newly Accredited Business Program in the UAE. , 2006 .

[29]  W. Bozeman,et al.  The Value of Student Ratings: Perceptions of Students, Teachers, and Administrators , 2007 .

[30]  K. Ryan,et al.  How Do Student Ratings Measure Up to a New Validity Framework , 2001 .

[31]  Yesim Çapa-Aydin.  Student evaluation of instruction: comparison between in-class and online methods , 2016 .

[32]  Teck Meng Tan,et al.  Empirical investigation of the factors affecting SET results , 1997 .

[33]  John B. Best,et al.  Students' Perceptions of Course Difficulty and Their Ratings of the Instructor. , 2006 .

[34]  Jim Gleason,et al.  Using Technology-Assisted Instruction and Assessment to Reduce the Effect of Class Size on Student Outcomes in Undergraduate Mathematics Courses , 2012 .

[35]  Yining Chen,et al.  Student Evaluation of Teaching Effectiveness: An assessment of student perception and motivation , 2003 .

[36]  G. Gibbs,et al.  The Evaluation of the Student Evaluation of Educational Quality Questionnaire (SEEQ) in UK Higher Education , 2001 .

[37]  Dennis E. Clayson,et al.  Personality and the Student Evaluation of Teaching , 2006 .

[38]  Abdullah Al Rubaish,et al.  Appraisal of Using Global Student Rating Items in Quality Management of Higher Education in Saudi Arabian University , 2012 .

[39]  Ronald A. Berk,et al.  Survey of 12 Strategies to Measure Teaching Effectiveness , 2005 .

[40]  Dennis E. Clayson,et al.  Student Evaluations of Teaching: Are They Related to What Students Learn? , 2009 .

[41]  A. Subbarayalu,et al.  Appraisal of students experience survey (SES) as a measure to manage the quality of higher education in the Kingdom of Saudi Arabia: an institutional study using six sigma model , 2015 .

[42]  Jill Blackmore,et al.  Academic pedagogies, quality logics and performative universities: evaluating teaching and what students want , 2009 .

[43]  Ruth Neumann,et al.  Communicating Student Evaluation of Teaching Results: Rating Interpretation Guides (RIGs) , 2000 .