Assessing faculty professional development in STEM higher education: Sustainability of outcomes

New faculty sustained the implementation of learner-centered courses in biology following professional development. We tested the effectiveness of Faculty Institutes for Reforming Science Teaching IV (FIRST), a professional development program for postdoctoral scholars, by conducting a study of program alumni. Faculty professional development programs are critical components of efforts to improve teaching and learning in the STEM (Science, Technology, Engineering, and Mathematics) disciplines, but reliable evidence of the sustained impacts of these programs is lacking. We used a paired design in which we matched a FIRST alumnus employed in a tenure-track position with a non-FIRST faculty member at the same institution. The members of a pair taught courses that were of similar size and level. To determine whether teaching practices of FIRST participants were more learner-centered than those of non-FIRST faculty, we compared faculty perceptions of their teaching strategies, perceptions of environmental factors that influence teaching, and actual teaching practice. Non-FIRST and FIRST faculty reported similar perceptions of their teaching strategies and teaching environment. FIRST faculty reported using active learning and interactive engagement in lecture sessions more frequently compared with non-FIRST faculty. Ratings from external reviewers also documented that FIRST faculty taught class sessions that were learner-centered, contrasting with the teacher-centered class sessions of most non-FIRST faculty. Despite marked differences in teaching practice, FIRST and non-FIRST participants used assessments that targeted lower-level cognitive skills. Our study demonstrated the effectiveness of the FIRST program and the empirical utility of comparison groups, where groups are well matched and controlled for contextual variables (for example, departments), for evaluating the effectiveness of professional development for subsequent teaching practices.

[1]  Kristin M. Ferguson,et al.  The Girl Child , 2009 .

[2]  Anne Nevgi,et al.  The effect of pedagogical training on teaching in higher education , 2007 .

[3]  Jennifer L. Momsen,et al.  What We Say is Not What We Do: Effective Evaluation of Faculty Professional Development Programs , 2011 .

[4]  M. Niewiadomska-Bugaj,et al.  Use of research-based instructional strategies in introductory physics: Where do faculty leave the innovation-decision process? , 2012 .

[5]  Peter-Marc Fortune,et al.  Are we asking the right questions? , 2007, BMJ : British Medical Journal.

[6]  Michelle K. Smith,et al.  Active learning increases student performance in science, engineering, and mathematics , 2014, Proceedings of the National Academy of Sciences.

[7]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[8]  C. Henderson,et al.  Facilitating change in undergraduate STEM instructional practices: An analytic review of the literature , 2011 .

[9]  Silvia Wen-Yu Lee,et al.  Reviewing the evidence on how teacher professional development affects student achievement , 2007 .

[10]  Laura M. Desimone,et al.  What Makes Professional Development Effective? Results From a National Sample of Teachers , 2001 .

[11]  K. A. Ericsson,et al.  Deliberate practice and acquisition of expert performance: a general overview. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[12]  Paul Ginns,et al.  Phenomenographic pedagogy and a revised Approaches to teaching inventory , 2005 .

[13]  Anne Nevgi,et al.  A follow-up study of the effect of pedagogical training on teaching in higher education , 2008 .

[14]  K. Trigwell,et al.  Development and Use of the Approaches to Teaching Inventory , 2004 .

[15]  Alfred Joseph Lizzio,et al.  University Students' Perceptions of the Learning Environment and Academic Outcomes: Implications for theory and practice , 2002 .

[16]  K. Trigwell,et al.  Relations between perceptions of the teaching environment and approaches to teaching. , 1997, The British journal of educational psychology.

[17]  Ranald Macdonald,et al.  The disjunction between lecturers' conceptions of teaching and their claimed educational practice , 1997 .

[18]  Diane Ebert-May,et al.  The Other Half of the Story: Effect Size Analysis in Quantitative Research , 2013, CBE life sciences education.

[19]  P. Petegem,et al.  The impact of instructional development in higher education: the state-of-the-art of the research , 2010 .

[20]  Graham Gibbs,et al.  The Impact Of Training Of University Teachers on their Teaching Skills, their Approach to Teaching and the Approach to Learning of their Students , 2004 .

[21]  Timothy T. Baldwin,et al.  Transfer of Training: A Meta-Analytic Review , 2010 .

[22]  Tammy M. Long,et al.  Just the Facts? Introductory Undergraduate Biology Courses Focus on Low-Level Cognitive Skills , 2010, CBE life sciences education.

[23]  D. A. Budd,et al.  Characterizing Teaching in Introductory Geology Courses: Measuring Classroom Practices , 2013 .

[24]  S. Brownell,et al.  Barriers to Faculty Pedagogical Change: Lack of Training, Time, Incentives, and…Tensions with Professional Identity? , 2012, CBE life sciences education.

[25]  Judith A. Hall,et al.  A Meta-analytic Review , 2002 .

[26]  Marilyn P. Carlson,et al.  Evaluating College Science and Mathematics Instruction: A Reform Effort That Improves Teaching Skills. , 2002 .

[27]  R. Kane,et al.  Telling Half the Story: A Critical Review of Research on the Teaching Beliefs and Practices of University Academics , 2002 .

[28]  R J Donaldson,et al.  A General Overview , 1980, Royal Society of Health journal.

[29]  Kelly F. Glassett,et al.  Long-Term Impact of On-Demand Professional Development on Student Performance: A Longitudinal Multi-State Study. , 2015 .

[30]  Diane Ebert-May,et al.  Breaking the Cycle: Future Faculty Begin Teaching with Learner-Centered Strategies after Professional Development , 2015, CBE life sciences education.

[31]  Paulo Norberto Hasse,et al.  REVISÃO BIBLIOGRÁFICA ANALÍTICA TRIGEMINAL NEURALGIA: AN ANALYTIC REVIEW OF THE LITERATURE , 2004 .

[32]  Jeffrey J. Walczyk,et al.  Obstacles to instructional innovation according to college science and mathematics faculty , 2007 .

[33]  Stephen Yelon,et al.  How Trainees Transfer What They Have Learned: Toward a Taxonomy of Use , 2014 .

[34]  K. Trigwell,et al.  How approaches to teaching are affected by discipline and teaching context , 2006 .

[35]  C. Huether,et al.  Genetic Literacy of Undergraduate Non–Science Majors and the Impact of Introductory Biology and Genetics Courses , 2008 .

[36]  Irene Bloom,et al.  Measuring Reform Practices in Science and Mathematics Classrooms: The Reformed Teaching Observation Protocol , 2002 .

[37]  Implications for Theory and Practice , 2015 .

[38]  The Problem with Reform from the Bottom up: Instructional practises and teacher beliefs of graduate teaching assistants following a reform‐minded university teacher certificate programme , 2010 .

[39]  J. Kimberly,et al.  The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research , 2012, Implementation Science.

[40]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[41]  Congruence of student teachers' pedagogical images and actual classroom practices , 2002 .

[42]  Steven S. Fletcher,et al.  Early career secondary science teachers: A longitudinal study of beliefs in relation to field experiences† , 2011 .

[43]  A. Amrein-Beardsley,et al.  Peer observations among faculty in a college of education: investigating the summative and formative uses of the Reformed Teaching Observation Protocol (RTOP) , 2012 .

[44]  Laura M. Desimone,et al.  Improving Impact Studies of Teachers’ Professional Development: Toward Better Conceptualizations and Measures , 2009 .

[45]  A. Winder,et al.  Implications for Theory and Practice , 1977 .

[46]  S. Erduran,et al.  Annual Conference of the American Educational Research Association, Seattle , 2001 .

[47]  J. Marshall,et al.  Comparative Analysis of Two Inquiry Observational Protocols: Striving to Better Understand the Quality of Teacher‐Facilitated Inquiry‐Based Instruction , 2011 .

[48]  Dan MacIsaac,et al.  Reforming Physics Instruction Via RTOP , 2002 .

[49]  Velda McCune,et al.  Approaches to Studying and Perceptions of University Teaching-Learning Environments : Concepts , Measures and Preliminary Findings , 2003 .