Measuring in-service teacher self-efficacy for teaching computational thinking: development and validation of the T-STEM CT

Despite a growing recognition that K-12 teachers should be prepared to teach students computational thinking (CT) skills across disciplines, there is a lack of valid instrumentation that measures teachers’ efficacy beliefs to do so. This study addresses this problem by developing and validating an instrument that measures in-service teachers’ self-efficacy beliefs for teaching CT. In parallel, we conducted a regression analysis to predict teachers’ self-efficacy and outcome expectancy beliefs for teaching CT based on demographic traits of the respondents. We surveyed a total of 330 K-12 in-service teachers. A combination of classical test theory and item response theory Rasch was used to validate the instrument. Our results yielded a valid and reliable tool measuring teaching efficacy beliefs for CT. Based on the differential item functioning analysis, the instrument did not reflect bias with gender, race, or teaching experience. Additionally, a regression analysis did not reveal significant predictors using teachers’ demographic characteristics. This suggests a need for looking at other factors that may significantly predict K-12 teachers’ teaching efficacy beliefs for CT to inform theory and practice around successful CT teaching and learning. Furthermore, we provide implications for the instrument we have developed.

[1]  Amber Settle,et al.  Computational Thinking in K-9 Education , 2014, ITiCSE-WGR.

[2]  Aman Yadav,et al.  Computational thinking in compulsory education: Towards an agenda for research and practice , 2015, Education and Information Technologies.

[3]  Relationship Between Self-Efficacy Beliefs of Science Teachers and Their Confidence in Content Knowledge , 2013 .

[4]  J. Eccles,et al.  Motivational beliefs, values, and goals. , 2002, Annual review of psychology.

[5]  Marcos Román-González,et al.  Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test , 2017, Comput. Hum. Behav..

[6]  Karl F. Wheatley The case for reconceptualizing teacher efficacy research , 2005 .

[7]  Chin-Chung Tsai,et al.  Exploring teachers’ perceived self efficacy and technological pedagogical content knowledge with respect to educational use of the World Wide Web , 2010 .

[8]  Darren George,et al.  IBM SPSS Statistics 21 Step by Step: A Simple Guide and Reference , 2013 .

[9]  Peggy A. Ertmer,et al.  Teacher beliefs and technology integration practices: A critical relationship , 2012, Comput. Educ..

[10]  Aman Yadav,et al.  Computer Science Pedagogical Content Knowledge , 2019, ACM Trans. Comput. Educ..

[11]  Melissa S. Yale,et al.  Rasch Analysis in the Human Sciences , 2013 .

[12]  Self-Regulation Questionnaire (SRQ) in Spanish Adolescents: Factor Structure and Rasch Analysis , 2018, Front. Psychol..

[13]  M. Chiu,et al.  Effects on teachers' self-efficacy and job satisfaction: Teacher gender, years of experience, and job stress. , 2010 .

[14]  Chenglie Hu,et al.  Computational thinking: what it might mean and what we might do about it , 2011, ITiCSE '11.

[15]  Robert M. Klassen,et al.  Teachers’ self-efficacy, personality, and teaching effectiveness: A meta-analysis , 2014 .

[16]  Svend Kreiner,et al.  Applying the Rasch Model , 2012 .

[17]  L. Enochs,et al.  Establishing Factorial Validity of the Mathematics Teaching Efficacy Beliefs Instrument , 2000 .

[18]  Aman Yadav,et al.  Computational Thinking in Elementary and Secondary Teacher Education , 2014, ACM Trans. Comput. Educ..

[19]  Chris Stephenson,et al.  Early Lessons from Evaluation of Computer Science Teacher Professional Development in Google’s CS4HS Program , 2017, ACM Trans. Comput. Educ..

[20]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[22]  Megan Tschannen-Moran,et al.  Exploring Literacy Teachers' Self-Efficacy Beliefs: Potential Sources at Play. , 2011 .

[23]  B. Antona,et al.  Five levels of performance and two subscales identified in the computer-vision symptom scale (CVSS17) by Rasch, factor, and discriminant analysis , 2018, PloS one.

[24]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[25]  Jeannette M. Wing Computational thinking and thinking about computing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[26]  John F. Sanford,et al.  Computational Thinking Concepts for Grade School. , 2016 .

[27]  W. Bearden,et al.  The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs , 2004 .

[28]  Peter B. Henderson,et al.  Ubiquitous Computational Thinking , 2009, Computer.

[29]  P. Abrami,et al.  Implementing Computer Technologies: Teachers' Perceptions and Practices , 2006 .

[30]  Martine B. Powell,et al.  Psychometric properties of the Self‐assessment Practice Scale for professional training contexts: evidence from confirmatory factor analysis and Rasch analysis , 2020, International Journal of Training and Development.

[31]  Hunter Gehlbach,et al.  Measure Twice, Cut down Error: A Process for Enhancing the Validity of Survey Scales , 2011 .

[32]  Susanne E. Hambrusch,et al.  Introducing computational thinking in education courses , 2011, SIGCSE.

[33]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[34]  Toni Ivey,et al.  Examining Elementary Teachers’ Engineering Self-Efficacy and Engineering Teacher Efficacy , 2017 .

[35]  Punya Mishra,et al.  Rethinking Technology & Creativity in the 21st Century , 2013, TechTrends.

[36]  James C. Lester,et al.  Development and validation of the Computer Science Attitudes Scale for middle school students (MG-CS attitudes) , 2020, Computers in Human Behavior Reports.

[37]  Punya Mishra,et al.  A NEW Approach to Defining and Measuring Creativity: Rethinking Technology & Creativity in the 21st Century , 2013, TechTrends.

[38]  P. D. de Jong,et al.  Inter- and intra-individual differences in teachers' self-efficacy: A multilevel factor exploration. , 2016, Journal of school psychology.

[39]  V. Shute,et al.  Demystifying computational thinking , 2017 .

[40]  Mary Webb,et al.  A K-6 Computational Thinking Curriculum Framework: Implications for Teacher Knowledge , 2016, J. Educ. Technol. Soc..

[41]  Peggy A. Ertmer,et al.  Teacher Technology Change , 2010 .

[42]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[43]  T. Bond,et al.  Applying the Rasch Model , 2015 .

[44]  Jeannette M. Wing An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[45]  Alexander Repenning,et al.  Making Computer Science Education Mandatory: Exploring a Demographic Shift in Switzerland. , 2019, ITiCSE.

[46]  Shuchi Grover,et al.  Computational Thinking in K–12 , 2013 .

[47]  Marcos Romn-Gonzlez,et al.  Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test , 2017, Comput. Hum. Behav..

[48]  Karen Koellner,et al.  Increasing the Self-Efficacy of Inservice Teachers through Content Knowledge. , 2009 .

[49]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[50]  L. Enochs,et al.  Toward the development of an elementary teacher's science teaching efficacy belief instrument , 1990 .

[51]  M. Pajares,et al.  Teachers’ Beliefs and Educational Research: Cleaning Up a Messy Construct , 1992 .

[52]  Iris M. Riggs,et al.  Further Development of an Elementary Science Teaching Efficacy Belief Instrument: A Preservice Elementary Scale , 1990 .

[53]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[54]  Ibrahim Cetin,et al.  Preservice Teachers’ Introduction to Computing , 2016 .

[55]  Siu-Cheung Kong,et al.  Assessing In-service Teachers' Development of Computational Thinking Practices in Teacher Development Courses , 2019, SIGCSE.

[56]  E. Erdfelder,et al.  Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses , 2009, Behavior research methods.

[57]  Stuart A. Karabenick,et al.  Cognitive Processing of Self-Report Items in Educational Research: Do They Think What We Mean? , 2007 .

[58]  Keith F Widaman,et al.  Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. , 1993, Psychological bulletin.

[59]  Jale Cakiroglu,et al.  Science Teaching Efficacy Beliefs , 2012 .

[60]  Alfred V. Aho,et al.  Computation and Computational Thinking , 2012, Comput. J..

[61]  James C. Lester,et al.  Development and Validation of the Middle Grades Computer Science Concept Inventory (MG-CSCI) Assessment , 2020, EURASIA Journal of Mathematics, Science and Technology Education.

[62]  Nathan H. Bean,et al.  Starting from scratch: Developing a pre-service teacher training program in computational thinking , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[63]  B. Wright Reasonable mean-square fit values , 1994 .

[64]  Michigan State University Aman Yadav Purdue University the By Punya Mishra Rethinking Technology & Creativity in the 21st Century , 2013 .

[65]  Halil Ibrahim Haseski,et al.  An Investigation of the Data Collection Instruments Developed to Measure Computational Thinking , 2019, Informatics Educ..

[66]  David Weintrop,et al.  Primary School Teachers' Conceptions of Computational Thinking , 2019, SIGCSE.

[67]  Ellen L. Usher,et al.  Sources of Self-Efficacy in School: Critical Review of the Literature and Future Directions , 2008 .

[68]  Barbara Ericson,et al.  Georgia Computes! An Intervention in a US State, with Formal and Informal Education in a Policy Context , 2014, TOCE.

[69]  Matt Bower,et al.  Improving the Computational Thinking Pedagogical Capabilities of School Teachers , 2017 .

[70]  A. Bandura Self-efficacy: toward a unifying theory of behavioral change. , 1977, Psychological review.

[71]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[72]  Megan Tschannen-Moran,et al.  Teacher Efficacy: Its Meaning and Measure , 1998 .

[73]  A. Bandura,et al.  Cultivating competence, self-efficacy, and intrinsic interest through proximal self-motivation. , 1981 .

[74]  Megan Tschannen-Moran,et al.  Sources of Self‐Efficacy: Four Professional Development Formats and Their Relationship to Self‐Efficacy and Implementation of a New Teaching Strategy , 2009, The Elementary School Journal.