Propagating the adoption of CS educational innovations

In this report, we survey the existing scholarship in STEM higher education regarding what motivates, encourages, and inhibits educators' decisions to adopt teaching innovations. After reviewing common theoretical foundations and considerations for adoption and dissemination studies, we identify challenges for encouraging adoption among educators in higher education. When possible, we provide evidence-based recommendations from the literature on how to overcome these challenges. We then consider the relevance of scholarship from general higher education and other STEM disciplines to the context of computer science in particular, discussing similarities and areas of divergence that would affect dissemination efforts. In order to better guide change agents in propagating beneficial teaching practices, tools, and resources, we conclude by summarizing best practices for promoting the adoption of innovations in computer science higher education.

[1]  S. M. Lo,et al.  Anatomy of STEM teaching in North American universities , 2018, Science.

[2]  B. Dawn Medlin,et al.  Factors Influencing Accounting Faculty Members' Decision to Adopt Technology in the Classroom. , 2007 .

[3]  H. M. Grady.  Strategies for increasing use of instructional technology by engineering faculty: a case study (or teaching old engineers new tricks) , 2001, IPCC 2001. Communication Dimensions. Proceedings IEEE International Professional Communication Conference (Cat. No.01CH37271).

[4]  D. Linton,et al.  Where ' s the evidence that active learning works ? , 2006 .

[5]  George D. Kuh.  High-Impact Educational Practices: What They Are, Who Has Access to Them, and Why They Matter , 2008 .

[6]  Mark Guzdial,et al.  The use of evidence in the change making process of computer science educators , 2011, SIGCSE '11.

[7]  Joint Task Force on Computing Curricula.  Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science , 2013 .

[8]  A. Ryan,et al.  Does stereotype threat affect test performance of minorities and women? A meta-analysis of experimental evidence. , 2008, The Journal of applied psychology.

[9]  James C. Hearn,et al.  Transforming U.S. higher education: An organizational perspective , 1996 .

[10]  James R. Larus,et al.  SIGPLAN programming language curriculum workshop: Discussion Summaries and recommendations , 2008, SIGP.

[11]  S. Brownell,et al.  Barriers to Faculty Pedagogical Change: Lack of Training, Time, Incentives, and…Tensions with Professional Identity? , 2012, CBE life sciences education.

[12]  Jesse Berlin,et al.  Evidence that computer science grades are not bimodal , 2019, Commun. ACM.

[13]  Robert M. Siegfried,et al.  A Longitudinal Analysis of the Reid List of First Programming Languages , 2016 .

[14]  Eric Mazur,et al.  Peer Instruction: A User's Manual , 1996 .

[15]  Roselynn Verwoord,et al.  Engaging students as partners in learning and teaching: a guide for faculty , 2016 .

[16]  Matthew Pilarz,et al.  Research-Based Implementation of Peer Instruction: A Literature Review , 2015, CBE life sciences education.

[17]  Alan Brudner.  Basis of Authority , 2017 .

[18]  Lauri Malmi,et al.  Evaluating the educational impact of visualization , 2003, ITiCSE-WGR '03.

[19]  Melissa E. O'Neill,et al.  Framing classroom climate for student learning and retention in computer science , 2014, SIGCSE.

[20]  Cynthia Taylor,et al.  Developing Course-Level Learning Goals for Basic Data Structures in CS2 , 2018, SIGCSE.

[21]  Christopher Lynnly Hovey.  Faculty adoption of teaching innovations that promote diversity and student retention in undergraduate computing , 2017 .

[22]  Luciana Oranges Cezarino,et al.  Student organizations and Communities of Practice: Actions for the 2030 Agenda for Sustainable Development , 2017 .

[23]  R. Eric Landrum,et al.  Assessing the STEM landscape: the current instructional climate survey and the evidence-based instructional practices adoption scale , 2017, International journal of STEM education.

[24]  Jeffrey E. Froyd,et al.  Analysis of Propagation Plans in NSF-Funded Education Development Projects , 2017 .

[25]  Michael Coburn,et al.  Barriers to effective teaching. , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[26]  David S. Yeager,et al.  Reducing Inequality in Academic Success for Incoming College Students: A Randomized Trial of Growth Mindset and Belonging Interventions , 2018, Journal of research on educational effectiveness.

[27]  Christopher Lynnly Hovey,et al.  Frequency of Instructor- and Student-Centered Teaching Practices in Introductory CS Courses , 2019, SIGCSE.

[28]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[29]  Andrew Cox,et al.  What are communities of practice? A comparative review of four seminal works , 2005, J. Inf. Sci..

[30]  K. Klein,et al.  The Challenge of Innovation Implementation , 1996 .

[31]  Giles D'Souza,et al.  Characteristics‐based innovation adoption: scale and model validation , 2011 .

[32]  Patricia Malone.  Switch: How to Change Things When Change Is Hard , 2011 .

[33]  David W. Valentine,et al.  CS educational research: a meta-analysis of SIGCSE technical symposium proceedings , 2004, SIGCSE '04.

[34]  C. Wieman,et al.  Transforming Science Education at Large Research Universities: A Case Study in Progressxs , 2010 .

[35]  Maura Borrego,et al.  Increasing the Use of Evidence‐Based Teaching in STEM Higher Education: A Comparison of Eight Change Strategies , 2014 .

[36]  Raymond Lister,et al.  Geek genes, prior knowledge, stumbling points and learning edge momentum: parts of the one elephant? , 2013, ICER.

[37]  Scott Grissom,et al.  How Student Centered is the Computer Science Classroom? A Survey of College Faculty , 2017, ACM Trans. Comput. Educ..

[38]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[39]  Wendy K. Adams,et al.  Development and Validation of Instruments to Measure Learning of Expert‐Like Thinking , 2011 .

[40]  R. Felder,et al.  The National Effective Teaching Institute: Assessment of Impact and Implications for Faculty Development , 2010 .

[41]  E. Rogers.  Diffusion of Innovations , 1962 .

[42]  Jeffrey E. Froyd,et al.  Designing for sustained adoption: A model of developing educational innovations for successful propagation , 2016 .

[43]  S. Kalinowski,et al.  Active Learning Not Associated with Student Learning in a Random Sample of College Biology Courses , 2011, CBE life sciences education.

[44]  K. Tanner,et al.  “What if students revolt?”—Considering Student Resistance: Origins, Options, and Opportunities for Investigation , 2013, CBE life sciences education.

[45]  Jeffrey E. Froyd,et al.  Characteristics of well-propagated teaching innovations in undergraduate STEM , 2017, International Journal of STEM Education.

[46]  D. Leslie,et al.  Resolving the Dispute: Teaching is Academe's Core Value , 2002 .

[47]  Stephanie Willen Brown,et al.  Marketing Library Database Services to End Users: Peer-to-Peer Outreach Using the Student Ambassador Program (SAm) , 2009 .

[48]  Charles Henderson,et al.  Promoting instructional change via co-teaching , 2006 .

[49]  Sherry A. Southerland,et al.  Educational Reform, Personal Practical Theories, and Dissatisfaction: The Anatomy of Change in College Science Teaching , 2003 .

[50]  Eileen Wood,et al.  Identifying discriminating variables between teachers who fully integrate computers and teachers with limited integration , 2008, Comput. Educ..

[51]  L. G. Tornatzky,et al.  Innovation characteristics and innovation adoption-implementation: A meta-analysis of findings , 1982, IEEE Transactions on Engineering Management.

[52]  Jie Wu,et al.  NSF/IEEE-TCPP curriculum initiative on parallel and distributed computing: core topics for undergraduates , 2011, SIGCSE '11.

[53]  Elizabeth G. Creamer,et al.  Assessing the Extent that the Gender and STEM Practice- Oriented Literature is Evidence-Based , 2013, International Journal of Higher Education.

[54]  Michael C. Loui,et al.  Identifying important and difficult concepts in introductory computing courses using a delphi process , 2008, SIGCSE '08.

[55]  Jeffrey Forbes,et al.  The Importance of Computing Education Research , 2016, ArXiv.

[56]  Alenoush Saroyan,et al.  Professors' Perceived Barriers and Incentives for Teaching Improvement , 2014 .

[57]  Troy Buer,et al.  Organizational complexity: The athletics department and the university , 2009 .

[58]  Melissa H. Dancy,et al.  Pedagogical practices and instructional change of physics faculty , 2010 .

[59]  Chandra Turpen,et al.  Perceived affordances and constraints regarding instructors' use of Peer Instruction: Implications for Promoting Instructional Change , 2016 .

[60]  E. Bean,et al.  Alternative Models of Professorial Roles: New Languages to Reimagine Faculty Work , 1998 .

[61]  Lijun Ni.  What makes CS teachers change?: factors influencing CS teachers' adoption of curriculum innovations , 2009, SIGCSE '09.

[62]  D. Leslie,et al.  Resolving the Dispute , 2002 .

[63]  Quintin I. Cutts,et al.  Manipulating mindset to positively influence introductory programming performance , 2010, SIGCSE.

[64]  Melissa H. Dancy,et al.  Assessment of teaching effectiveness: Lack of alignment between instructors, institutions, and research recommendations , 2014 .

[65]  Maura Borrego,et al.  Diffusion of Engineering Education Innovations: A Survey of Awareness and Adoption Rates in U.S. Engineering Departments , 2010 .

[66]  Izak Benbasat,et al.  Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation , 1991, Inf. Syst. Res..

[67]  James S. Fairweather,et al.  The Mythologies of Faculty Productivity: Implications for Institutional Policy and Decision Making , 2002 .

[68]  MalmiLauri,et al.  Evaluating the educational impact of visualization , 2003 .

[69]  Renee Cole,et al.  From Dissemination to Propagation: A New Paradigm for Education Developers , 2017 .

[70]  Anthony V. Robins,et al.  Learning edge momentum: a new account of outcomes in CS1 , 2010, Comput. Sci. Educ..

[71]  Cynthia Taylor,et al.  Computer science concept inventories: past and future , 2014, Comput. Sci. Educ..

[72]  Shanna R. Daly,et al.  Factors that influence faculty motivation of effective teaching practices in engineering , 2013 .

[73]  Marina Kogan,et al.  Facilitating Instructor Adoption of Inquiry-Based Learning in College Mathematics , 2016 .

[74]  Melissa H. Dancy,et al.  Impact of physics education research on the teaching of introductory quantitative physics in the United States , 2009 .

[75]  Andrei Cimpian,et al.  Expectations of brilliance underlie gender distributions across academic disciplines , 2015, Science.

[76]  Walter A. Brown,et al.  Public HBCUs’ Financial Resource Distribution Disparities in Capital Spending , 2014 .

[77]  Robert McCartney,et al.  Folk Pedagogy and the Geek Gene: Geekiness Quotient , 2017, SIGCSE.

[78]  Marilyne Stains,et al.  Fidelity of Implementation: An Overlooked Yet Critical Construct to Establish Effectiveness of Evidence-Based Instructional Practices , 2017, CBE life sciences education.

[79]  Lauri Malmi,et al.  Evaluating the educational impact of visualization, Report of the ITICSE'2003 working group on , 2003 .

[80]  T. Banta,et al.  Change : The Magazine of Higher Learning , 2010 .

[81]  William Snyder,et al.  Cultivating Communities of Practice: A Guide to Managing Knowledge , 2002 .

[82]  Carrie B. Fried,et al.  Reducing the Effects of Stereotype Threat on African American College Students by Shaping Theories of Intelligence , 2002 .

[83]  Larry Cuban.  How Scholars Trumped Teachers: Change without Reform in University Curriculum, Teaching, and Research, 1890-1990. , 2000 .

[84]  James S. Fairweather,et al.  The Mythologies of Faculty Productivity , 2002 .

[85]  Diane Ebert-May,et al.  Breaking the Cycle: Future Faculty Begin Teaching with Learner-Centered Strategies after Professional Development , 2015, CBE life sciences education.

[86]  Michelle Aebersold,et al.  Diffusion of innovation: faculty barriers to adoption. , 2014, Computers, informatics, nursing : CIN.

[87]  Aart Hendriks,et al.  UN Convention on the Rights of Persons with Disabilities. , 2007, European journal of health law.

[88]  Christopher Lynnly Hovey,et al.  Survey Results on Why CS Faculty Adopt New Teaching Practices , 2019, SIGCSE.

[89]  Riina Vuorikari,et al.  European Schoolnet: enabling school networking , 2009 .

[90]  C. Henderson,et al.  Facilitating change in undergraduate STEM instructional practices: An analytic review of the literature , 2011 .

[91]  Luciana Benotti,et al.  Lessons Learned on Computer Science Teachers Professional Development , 2016, ITiCSE.

[92]  Kathleen Quardokus,et al.  Promoting instructional change: using social network analysis to understand the informal structure of academic departments , 2015 .

[93]  C. Henderson,et al.  Physics Faculty and Educational Researchers: Divergent Expectations as Barriers to the Diffusion of Innovations , 2006, physics/0608295.

[94]  Michael X Cohen,et al.  A Garbage Can Model of Organizational Choice. , 1972 .

[95]  Robert G. Green,et al.  TENURE AND PROMOTION DECISIONS: THE RELATIVE IMPORTANCE OF TEACHING, SCHOLARSHIP, AND SERVICE , 2008 .

[96]  Melissa H. Dancy,et al.  Barriers to the use of research-based instructional strategies: The influence of both individual and situational characteristics , 2007 .

[97]  Emily M. Walter,et al.  Introducing the Postsecondary Instructional Practices Survey (PIPS): A Concise, Interdisciplinary, and Easy-to-Score Survey , 2016, CBE life sciences education.

[98]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[99]  Adrianna Kezar,et al.  The Roles of STEM Faculty Communities of Practice in Institutional and Departmental Reform in Higher Education , 2017 .

[100]  Jeffrey E. Froyd,et al.  Fidelity of Implementation of Research‐Based Instructional Strategies (RBIS) in Engineering Science Courses , 2013 .

[101]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[102]  Mordechai Ben-Ari,et al.  We work so hard and they don't use it: acceptance of software tools by teachers , 2007, ITiCSE '07.

[103]  Lynda Thomas,et al.  Dangers of a fixed mindset: implications of self-theories research for computer science education , 2008, ITiCSE.

[104]  Lecia Jane Barker,et al.  The student prompt: Student feedback and change in teaching practices in postsecondary computer science , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[105]  S. Laursen,et al.  Assessing Long-Term Effects of Inquiry-Based Learning: A Case Study from College Mathematics , 2014 .

[106]  Jeffrey E. Froyd,et al.  Estimates of Use of Research-Based Instructional Strategies in Core Electrical or Computer Engineering Courses , 2013, IEEE Transactions on Education.

[107]  Melissa H. Dancy,et al.  Enabling and challenging factors in institutional reform: The case of SCALE-UP , 2016 .

[108]  Neil Brown,et al.  Repositories of teaching material and communities of use: nifty assignments and the greenroom , 2010, ICER '10.

[109]  Jeffrey E. Froyd,et al.  A comparison of electrical, computer, and chemical engineering facultys' progressions through the innovation-decision process , 2012, 2012 Frontiers in Education Conference Proceedings.

[110]  Diane Ebert-May,et al.  Assessing faculty professional development in STEM higher education: Sustainability of outcomes , 2016, Science Advances.

[111]  J. Michael.  Where's the evidence that active learning works? , 2006, Advances in physiology education.

[112]  Colleen M. Lewis,et al.  Recommendations for Designing CS Resource Sharing Sites for All Teachers , 2017, SIGCSE.

[113]  Melissa H. Dancy,et al.  How faculty learn about and implement research-based instructional strategies: The case of Peer Instruction , 2016 .

[114]  Shanna R. Daly,et al.  Bridging the Research‐to‐Practice Gap: Designing an Institutional Change Plan Using Local Evidence , 2014 .

[115]  Nancy Collins,et al.  Teaming Up Without Selling Out: The Scopus™ Student Ambassador Program at the University of Waterloo , 2011 .

[116]  C. Dweck.  Mindset: The New Psychology of Success , 2006 .

[117]  Noah D. Finkelstein,et al.  Facilitating Change in Undergraduate STEM Education , 2012 .

[118]  Mark Guzdial,et al.  How do computing faculty adopt curriculum innovations?: the story from instructors , 2010, SIGCSE.

[119]  Larry Cuban,et al.  How Scholars Trumped Teachers: Change without Reform in University Curriculum, Teaching, and Research, 1890-1990 , 2000 .

[120]  Elaine Seymour,et al.  Tracking the Processes of Change in US Undergraduate Education in Science, Mathematics, Engineering, and Technology , 2002 .

[121]  Charles Henderson,et al.  Diffusion of research-based instructional strategies: the case of SCALE-UP , 2014 .

[122]  Christopher Lynnly Hovey,et al.  What Influences CS Faculty to Adopt Teaching Practices? , 2015, SIGCSE.

[123]  J. Haidt.  The happiness hypothesis: Finding modern truth in ancient wisdom. , 2006 .

[124]  Matthew West,et al.  Coordinating College-Wide Instructional Change Through Faculty Communities , 2015 .

[125]  Daniela Giordano,et al.  New Horizons in the Assessment of Computer Science at School and Beyond: Leveraging on the ViVA Platform , 2015, ITiCSE-WGR.

[126]  Sue Fitzgerald,et al.  Exposed! CS Faculty Caught Lecturing in Public: A Survey of Instructional Practices , 2017, SIGCSE.

[127]  C. Henderson,et al.  Beyond Dissemination in College Science Teaching: An Introduction to Four Core Change Strategies , 2010 .

[128]  Lori L. Pollock,et al.  Implementation and Outcomes of a Three-Pronged Approach to Professional Development for CS Principles , 2016, SIGCSE.

[129]  Geoffrey L. Herman,et al.  Creating institution-level change in instructional practices through faculty communities of practice , 2015 .

[130]  David E. Goldberg,et al.  Creating Scalable Reform in Engineering Education Through Low-Cost In- trinsic Motivation Course Conversions of Engineering Courses , 2013 .