On the predictors of computational thinking and its growth at the high-school level

Abstract Computational thinking (CT) is a key 21st-century skill. This paper contributes to CT research by providing a comprehensive picture of CT predictors in a longitudinal and natural classroom setting among upper secondary students. The hypothesized predictors are grouped into three areas: student characteristics, home environment, and learning opportunities. CT is measured with the Computational Thinking Test (CTt), an established performance test. N = 202 high-school students, at three time points over one school year, act as the sample and latent growth curve modeling as the analysis method. CT self-concept, followed by reasoning skills and gender, show the strongest association with the level of CT. Computer literacy, followed by duration of computer use and formal learning opportunities during the school year, have the strongest association with CT growth. Overall, variables from all three areas seem to be important for predicting either CT level or growth. An explained variance of 70.4% for CT level and 61.2% for CT growth might indicate a good trade-off between the comprehensiveness and parsimony of the conceptual framework. Our findings contribute to a better understanding of CT as a construct and have implications for instruction, e.g., the role of computer science and motivation in CT learning.

[1]  Gregorio Robles,et al.  Extending the nomological network of computational thinking with non-cognitive factors , 2018, Comput. Hum. Behav..

[2]  R. Shavelson,et al.  Self-Concept: Validation of Construct Interpretations , 1976 .

[3]  Laura M. Stapleton,et al.  On the Unnecessary Ubiquity of Hierarchical Linear Modeling , 2017, Psychological methods.

[4]  Leslie Rutkowski,et al.  Measuring Socioeconomic Background in PISA: One Size Might not Fit all , 2013 .

[5]  Fouad Georges,et al.  Digital ink for cognitive assessment of computational thinking , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[6]  Lauren E. Margulieux,et al.  Review of measurements used in computing education research and suggestions for increasing standardization , 2019, Comput. Sci. Educ..

[7]  S. Seufert,et al.  MEASURING COMPUTATIONAL THINKING - ADAPTING A PERFORMANCE TEST AND A SELF-ASSESSMENT INSTRUMENT FOR GERMAN-SPEAKING COUNTRIES , 2019, Proceedings of the 16th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2019).

[8]  T. A. Warm Weighted likelihood estimation of ability in item response theory , 1989 .

[9]  Zana Zanko,et al.  Comparing loops misconceptions in block-based and text-based programming languages at the K-12 level , 2017, Education and Information Technologies.

[10]  J. Eccles,et al.  Expectancy-Value Theory of Achievement Motivation. , 2000, Contemporary educational psychology.

[11]  Mary Webb,et al.  A K-6 Computational Thinking Curriculum Framework: Implications for Teacher Knowledge , 2016, J. Educ. Technol. Soc..

[12]  Jeannette M. Wing An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[13]  Timothy C. Bell,et al.  Tensions in specifying computing curricula for K-12: Towards a principled approach for objectives , 2018, it Inf. Technol..

[14]  Peter Hubwieser,et al.  Design and First Results of a Psychometric Test for Measuring Basic Programming Abilities , 2015, WiPSCE.

[15]  David Weintrop,et al.  Comparing Block-Based and Text-Based Programming in High School Computer Science Classrooms , 2017, ACM Trans. Comput. Educ..

[16]  Jens Möller,et al.  On the Effects of Motivation on Reading Performance Growth in Secondary School. , 2011 .

[17]  Jalal Nouri,et al.  A systematic review of learning computational thinking through Scratch in K-9 , 2019, Comput. Educ..

[18]  Yves Rosseel,et al.  lavaan: An R Package for Structural Equation Modeling , 2012 .

[19]  W. K. Campbell,et al.  Self-Threat Magnifies the Self-Serving Bias: A Meta-Analytic Integration , 1999 .

[20]  Timothy C. Bell,et al.  A Pilot Computer Science and Programming Course for Primary School Students , 2015, WiPSCE.

[21]  Gregorio Robles,et al.  Combining Assessment Tools for a Comprehensive Evaluation of Computational Thinking Interventions , 2019, Computational Thinking Education.

[22]  Marcos Romn-Gonzlez,et al.  Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test , 2017, Comput. Hum. Behav..

[23]  Alexander Repenning,et al.  Moving Beyond Syntax: Lessons from 20 Years of Blocks Programing in AgentSheets , 2017, J. Vis. Lang. Sentient Syst..

[24]  Lauren E. Margulieux,et al.  The Relationship Between Learner Characteristics and Student Outcomes in a Middle School Computing Course: An Exploratory Analysis Using Structural Equation Modeling , 2019, Journal of Research on Technology in Education.

[25]  Edward Brooks,et al.  The nature of reasoning. , 1891 .

[26]  Daniel M. McNeish,et al.  Psychological Methods Thanks Coefficient Alpha , We ’ ll Take It From Here , 2022 .

[27]  Shuchi Grover,et al.  Computational Thinking in K–12 , 2013 .

[28]  Siu-Cheung Kong,et al.  A study of primary school students' interest, collaboration attitude, and programming empowerment in computational thinking education , 2018, Comput. Educ..

[29]  David C. Webb,et al.  Scalable Game Design , 2015, ACM Trans. Comput. Educ..

[30]  Pavlo D. Antonenko,et al.  Exploring the evolution of two girls' conceptions and practices in computational thinking in science , 2020, Comput. Educ..

[31]  T. Richter,et al.  Eine revidierte Fassung des Inventars zur Computerbildung (INCOBI-R) , 2010 .

[32]  A. Meltzoff,et al.  Computing Whether She Belongs: Stereotypes Undermine Girls’ Interest and Sense of Belonging in Computer Science , 2016 .

[33]  M. Cutumisu,et al.  A Scoping Review of Empirical Research on Recent Computational Thinking Assessments , 2019, Journal of Science Education and Technology.

[34]  Roy D. Pea,et al.  Designing for deeper learning in a blended computer science course for middle school students , 2015, Comput. Sci. Educ..

[35]  Julia Haubrich,et al.  The Short Version of the Hagen Matrices Test (HMT-S): 6-Item Induction Intelligence Test , 2013 .

[36]  J. Long,et al.  Maximum Likelihood Versus Multiple Imputation for Missing Data in Small Longitudinal Samples With Nonnormality , 2017, Psychological methods.

[37]  Joseph F. Hair,et al.  When to use and how to report the results of PLS-SEM , 2019, European Business Review.

[38]  Jeannette M. Wing Computational thinking and thinking about computing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[39]  José Antonio González-Calero,et al.  Computational thinking through unplugged activities in early years of Primary Education , 2020, Comput. Educ..

[40]  Ronny Scherer,et al.  The cognitive benefits of learning computer programming: A meta-analysis of transfer effects. , 2019, Journal of Educational Psychology.

[41]  D. Treiman,et al.  A standard international socio-economic index of occupational status , 1992 .

[42]  IsraelMaya,et al.  Supporting all learners in school-wide computational thinking , 2015 .

[43]  Robert M. Gonyea Self‐reported data in institutional research: Review and recommendations , 2005 .

[44]  Aman Yadav,et al.  Computational thinking in compulsory education: Towards an agenda for research and practice , 2015, Education and Information Technologies.

[45]  Chris Stephenson,et al.  Bringing computational thinking to K-12: what is Involved and what is the role of the computer science education community? , 2011, INROADS.

[46]  Marcos Román-González,et al.  Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test , 2017, Comput. Hum. Behav..

[47]  Cristina Cachero,et al.  Impact of Programming Exposure on the Development of Computational Thinking Capabilities: An Empirical Study , 2020, IEEE Access.

[48]  Roy D. Pea,et al.  Factors Influencing Computer Science Learning in Middle School , 2016, SIGCSE.

[49]  Ting-Chia Hsu,et al.  How to learn and how to teach computational thinking: Suggestions based on a review of the literature , 2018, Comput. Educ..

[50]  Petra Fisser,et al.  Computational Thinking as an Emerging Competence Domain , 2017 .

[51]  O. Köller,et al.  Kurswahlen von Mädchen und Jungen im Fach Mathematik : Zur Rolle des fachspezifischen Selbstkonzepts und Interesses , 2000 .

[52]  Ulas Ilic,et al.  Publication Trends over 10 Years of Computational Thinking Research. , 2018 .

[53]  Ying Xie,et al.  Teaching computational thinking to non-computing majors using spreadsheet functions , 2011, 2011 Frontiers in Education Conference (FIE).

[54]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[55]  M. Román González,et al.  COMPUTATIONAL THINKING TEST: DESIGN GUIDELINES AND CONTENT VALIDATION , 2015 .

[56]  Chris Stephenson,et al.  Computational Thinking in High School Science Classrooms , 2014 .

[57]  KohJoyce Hwee Ling,et al.  Review on teaching and learning of computational thinking through programming , 2014 .

[58]  Peter M. Bentler,et al.  Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic , 2008, Psychometrika.

[59]  V. Shute,et al.  Demystifying computational thinking , 2017 .

[60]  DemetriadisStavros,et al.  Advancing students' computational thinking skills through educational robotics , 2016 .

[61]  Sze Yee Lye,et al.  Review on teaching and learning of computational thinking through programming: What is next for K-12? , 2014, Comput. Hum. Behav..

[62]  Marylène Gagné,et al.  Testing a Continuum Structure of Self-Determined Motivation: A Meta-Analysis , 2017, Psychological bulletin.

[63]  Stavros N. Demetriadis,et al.  Advancing students' computational thinking skills through educational robotics: A study on age and gender relevant differences , 2016, Robotics Auton. Syst..

[64]  Barbara J. Flood,et al.  Assessing the Teaching Quality of Accounting Programmes: An evaluation of the Course Experience Questionnaire , 2003 .

[65]  D. Eignor The standards for educational and psychological testing. , 2013 .

[66]  Valerie J. Shute,et al.  Can playing a video game foster computational thinking skills? , 2019, Comput. Educ..

[67]  Mimi Bong,et al.  Academic Self-Concept and Self-Efficacy: How Different Are They Really? , 2003 .

[68]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[69]  Özgen Korkmaz,et al.  A validity and reliability study of the computational thinking scales (CTS) , 2017, Comput. Hum. Behav..

[70]  K. McGrew,et al.  The Cattell-Horn-Carroll model of intelligence. , 2012 .

[71]  T. Postmes,et al.  A single-item measure of social identification: reliability, validity, and utility. , 2013, The British journal of social psychology.

[72]  Mustafa Saritepeci,et al.  Analysis of the relation between computational thinking skills and various variables with the structural equation model , 2018, Comput. Educ..

[73]  Romn-GonzlezMarcos,et al.  Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test , 2017 .

[74]  Maya Israel,et al.  Supporting all learners in school-wide computational thinking: A cross-case qualitative analysis , 2015, Comput. Educ..

[75]  K. Penny Appropriate Critical Values When Testing for a Single Multivariate Outlier by Using the Mahalanobis Distance , 1996 .

[76]  T. Seidel,et al.  Clarity and coherence of lesson goals as a scaffold for student learning , 2005 .

[77]  Francisco Buitrago Flórez,et al.  Changing a Generation’s Way of Thinking: Teaching Computational Thinking Through Programming , 2017 .

[78]  John Harrison,et al.  Computational Thinking: A Digital Age Skill for Everyone. , 2011 .

[79]  Samuel Greiff,et al.  Complex problem solving : More than reasoning ? , 2017 .

[80]  R. Hoffmann,et al.  Statistical methods for causal analysis in life course research: an illustration of a cross-lagged structural equation model, a latent growth model, and an autoregressive latent trajectories model , 2017 .

[81]  Jill Denner,et al.  The fairy performance assessment: measuring computational thinking in middle school , 2012, SIGCSE '12.

[82]  Yue Yin,et al.  Assessing computational thinking: A systematic review of empirical studies , 2020, Comput. Educ..