Maximising resource allocation in the teaching laboratory: understanding student evaluations of teaching assistants in a team-based teaching format

ABSTRACT Minimal research papers have investigated the use of student evaluations on the laboratory, a learning medium usually run by teaching assistants with little control of the content, delivery and equipment. Finding the right mix of teaching assistants for the laboratory can be an onerous task due to the many skills required including theoretical and practical know-how, troubleshooting, safety and class management. Using larger classes with multiple teaching assistants, a team-based teaching (TBT) format may be advantageous. A rigorous three-year study across twenty-five courses over repetitive laboratory classes is analysed using a multi-level statistical model considering students, laboratory classes and courses. The study is used to investigate the effectiveness of the TBT format, and quantify the influence each demonstrator has on the laboratory experience. The study found that TBT is effective and the lead demonstrator most influential, influencing up to 55% of the laboratory experience evaluation.

[1]  M. Butts,et al.  Statistical and Methodological Myths and Urban Legends: Doctrine, Verity and Fable in the Organizational and Social Sciences , 2008 .

[2]  Alfredo de Blas del Hoyo,et al.  ‘Learning by Doing’ Methodology Applied to the Practical Teaching of Electrical Machines , 2009 .

[3]  Andrea N. Hunt,et al.  What’s in a Name: Exposing Gender Bias in Student Ratings of Teaching , 2015, Journal of Collective Bargaining in the Academy.

[4]  Imran Rasul,et al.  Heterogeneous Class Size Effects: New Evidence from a Panel of University Students , 2009, SSRN Electronic Journal.

[5]  V. Ismet Ugursal,et al.  Student opinions and perceptions of undergraduate thermodynamics courses in engineering , 2015 .

[6]  Michael Johnson,et al.  Effects of Course and Instructor Characteristics on Student Evaluation of Teaching across a College of Engineering , 2013 .

[7]  Kenneth A. Feldman,et al.  College students' views of male and female college teachers: Part II—Evidence from students' evaluations of their classroom teachers , 1993 .

[8]  Vladimir Pavlovic,et al.  SDLDS—System for Digital Logic Design and Simulation , 2013, IEEE Transactions on Education.

[9]  T. Joiner,et al.  Factors influencing teaching evaluations in higher education. , 2006 .

[10]  Jacqueline Douglas,et al.  Measuring student satisfaction at a UK university , 2006 .

[11]  Gary I Noble,et al.  Student Experiences and Perceptions of Team-Teaching in a Large Undergraduate Class , 2006, Journal of University Teaching and Learning Practice.

[12]  Amjad Ali,et al.  Teacher evaluation: the role of gender , 2015 .

[13]  Wasim Ahmed Khan,et al.  Establishment of engineering laboratories for undergraduate and postgraduate studies , 2002 .

[14]  Michelle R. Hebl,et al.  The effect of professor ethnicity and gender on student evaluations: Judged before met. , 2010 .

[16]  Montserrat Ros,et al.  Improving the Laboratory Learning Experience: A Process to Train and Manage Teaching Assistants , 2015, IEEE Transactions on Education.

[17]  R. Shprintzen,et al.  What's in a name? , 1990, The Cleft palate journal.

[18]  Peter A. Daempfle.  An Analysis of the High Attrition Rates among First Year College Science, Math, and Engineering Majors , 2003 .

[19]  Julianne Arbuckle,et al.  Students' Perceptions of Expressiveness: Age and Gender Effects on Teacher Evaluations , 2003 .

[20]  Carmen Pozo-Muñoz,et al.  The 'Ideal Teacher'. Implications for student evaluation of teacher effectiveness , 2000 .

[21]  Kamisah Osman,et al.  Physical and psychosocial aspects of the learning environment in the science laboratory and their relationship to teacher satisfaction , 2013 .

[22]  Evaluation of persons of varying ages. , 1996, The Journal of social psychology.

[23]  D. J. Walker,et al.  The relationship between student understanding, satisfaction and performance in an Australian engineering programme , 2011 .

[24]  Frederick C. Scherr,et al.  Bias in Student Evaluations of Teacher Effectiveness. , 1990 .

[25]  Risto Lehtonen,et al.  Multilevel Statistical Models , 2005 .

[26]  Myungsup Kim,et al.  What Determines Student Evaluation Scores? A Random Effects Analysis of Undergraduate Economics Classes , 2009 .

[27]  Wen-ying Lin,et al.  Is Class Size a Bias to Student Evaluations of Faculty? A Review. , 1992 .

[28]  J. Centra,et al.  Is There Gender Bias in Student Evaluations of Teaching? , 2000 .

[29]  G. M. Stamatelosa,et al.  The role of engineering laboratories in the establishment of a quality culture in higher education in Greece , 2009 .

[30]  Francisco Zabaleta,et al.  The use and misuse of student evaluations of teaching , 2007 .

[31]  G. Howard.  On Validity , 1981 .

[32]  S. Nikolic,et al.  Relationship between learning in the engineering laboratory and student evaluations , 2015 .

[33]  M. Pellizzari,et al.  Evaluating Students' Evaluations of Professors , 2011, SSRN Electronic Journal.

[34]  David Lowe,et al.  On the viability of supporting institutional sharing of remote laboratory facilities , 2015 .

[35]  L. M. Aleamoni.  Student Rating Myths Versus Research Facts from 1924 to 1998 , 1999 .

[36]  Richard E. Plank,et al.  Perceptions of Quality of Higher Education: An Exploratory Study of High School Guidance Counselors , 1997 .

[37]  Susan A. Basow,et al.  Student evaluations of college professors: Are female and male professors rated differently? , 1987 .

[38]  D. Carless,et al.  Effective Team Teaching between Local and Native-speaking English Teachers , 2006 .

[39]  R. Oskrochi,et al.  What matters most? Predictors of student satisfaction in public health educational courses. , 2006, Public health.

[40]  Jarl K. Kampen,et al.  Asymptotic Effect of Misspecification in the Random Part of the Multilevel Model , 2004 .

[41]  J. Langlois,et al.  Maxims or myths of beauty? A meta-analytic and theoretical review. , 2000, Psychological bulletin.

[42]  Dennis Child,et al.  The essentials of factor analysis , 1970 .

[43]  G.M. Bodner,et al.  First-year engineering students' views of the nature of engineering: implications for engineering programmes , 2016 .

[44]  D. R. Kalbande,et al.  Improving Laboratory Experiences in Engineering Education , 2016 .

[45]  Version 1.3.2 Date 2013-02-28 Title Procedures for Psychological, Psychometric, and Personality Research , 2010 .

[46]  Atul M. Gonsai,et al.  A study of lab satisfaction of MCA and MSc. (IT) students of department computer science of Saurashtra University, Rajkot , 2013, 2013 IEEE International Conference in MOOC, Innovation and Technology in Education (MITE).

[47]  P. Spooren,et al.  On the Validity of Student Evaluation of Teaching , 2013 .

[48]  N.A. Pendergrass,et al.  Improving first-year engineering education , 1999, FIE'99 Frontiers in Education. 29th Annual Frontiers in Education Conference. Designing the Future of Science and Engineering Education. Conference Proceedings (IEEE Cat. No.99CH37011.

[49]  Kathleen O'Toole.  Demonstrator development: Preparing for the learning lab , 2012 .

[50]  Charles E. Lance,et al.  Statistical and methodological myths and urban legends : doctrine, verity, and fable in the organizational and social sciences , 2009 .

[51]  Sasha Nikolic.  Training laboratory: Using online resources to enhance the laboratory learning experience , 2014, 2014 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE).

[52]  Milo Koretsky,et al.  Student Perceptions of Learning in the Laboratory: Comparison of Industrially Situated Virtual Laboratories to Capstone Physical Laboratories , 2011 .

[53]  Zoltan K. Nagy,et al.  Applying Kolb's Experiential Learning Cycle for Laboratory Education , 2009 .

[54]  L. Reid,et al.  The role of perceived race and gender in the evaluation of college teaching on RateMyProfessors.Com. , 2010 .

[55]  Sasha Nikolic.  Understanding How Students Use and Appreciate Online Resources in the Teaching Laboratory , 2015, Int. J. Online Eng..

[56]  David Watkins,et al.  STUDENT RATINGS OF TERTIARY COURSES FOR ‘ALTERNATIVE CALENDAR’ PURPOSES , 1990 .

[57]  Francis J. Buckley,et al.  Team Teaching: What, Why, and How? , 1999 .

[58]  T. J. Watson.  The Role of the Laboratory in Undergraduate Engineering Education , 2005 .

[59]  Montserrat Ros,et al.  Decoding Student Satisfaction: How to Manage and Improve the Laboratory Experience , 2015, IEEE Transactions on Education.

[60]  Mirjam Moerbeek,et al.  The Consequence of Ignoring a Level of Nesting in Multilevel Analysis , 2004, Multivariate behavioral research.

[61]  Allyson Hajek,et al.  Student Perceptions of the Value of Physics Laboratories , 2011 .

[62]  E. Gary Shapiro,et al.  Effect of instructor and class characteristics on students' class evaluations , 1990 .

[63]  William J. Sawaya,et al.  Analysis of Differences in Nonteaching Factors Influencing Student Evaluation of Teaching between Engineering and Business Classrooms , 2014 .

[64]  P. Cranton,et al.  A New Look at the Effect of Course Characteristics on Student Ratings of Instruction , 1986 .

[65]  Kamilah Radin Salim.  An instrument for measuring the learning outcomes of laboratory work , 2013 .

[66]  Gregory B. Merrill,et al.  Are Student Evaluations of Teaching Effectiveness Valid for Measuring Student Learning Outcomes in Business Related Classes? A Neural Network and Bayesian Analyses , 2011, Research in Higher Education.

[67]  D. Hamermesh,et al.  Beauty in the Classroom: Professors&Apos; Pulchritude and Putative Pedagogical Productivity , 2003 .

[68]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[69]  P Doulai,et al.  Using online and multimedia resources to enhance the student learning experience in a telecommunications laboratory within an Australian university , 2015 .

[70]  Masood A. Badri,et al.  Identifying Potential Biasing Variables in Student Evaluation of Teaching in a Newly Accredited Business Program in the UAE. , 2006 .