Using Learning Analytics to Understand the Learning Pathways of Novice Programmers

Many have suggested that tinkering plays a critical role in novices learning to program, and recent work in learning analytics (Baker & Yacef, 2009 Blikstein, 2011) allows us to describe new relationships in the process. Using learning analytics, we explore how students progress from exploration, through tinkering, to refinement, a pathway that we term EXTIRE. The work contributes to learning sciences by: showing empirical support for previously theorized processes; identifying a role of tinkering in novices' learning; and presenting a data-driven approach to creating process descriptions. Furthermore, our findings illuminate how tinkering can be a valuable approach for novices.

[1]  Anders Berglund,et al.  Describing computer science education research : An academic process view , 2002 .

[2]  J B Meisenhelder Hidden messages. , 1992, The Journal of the Association of Nurses in AIDS Care : JANAC.

[3]  N. Cunniff,et al.  Does programming language affect the type of conceptual bugs in beginners' programs? A comparison of FPL and Pascal , 1986, CHI '86.

[4]  Leon E. Winslow,et al.  Programming pedagogy—a psychological overview , 1996, SGCS.

[5]  Paulo Blikstein,et al.  Using learning analytics to assess students' behavior in open-ended programming tasks , 2011, LAK.

[6]  Kenneth R. Koedinger,et al.  An Open Repository and analysis tools for fine-grained, longitudinal learner data , 2008, EDM.

[7]  Daniel C. Howe,et al.  RiTa: creativity support for computational literature , 2009, C&C '09.

[8]  Elliot Soloway,et al.  Studying the Novice Programmer , 1988 .

[9]  Janine Rogalski,et al.  Acquisition of Programming Knowledge and Skills , 1990 .

[10]  Leah Buechley,et al.  The LilyPad Arduino: using computational textiles to investigate engagement, aesthetics, and diversity in computer science education , 2008, CHI.

[11]  Bruce Sherin Representing Geometric Constructions As Programs: A Brief Exploration , 2002, Int. J. Comput. Math. Learn..

[12]  C. Steele,et al.  Ambient belonging: how stereotypical cues impact gender participation in computer science. , 2009, Journal of personality and social psychology.

[13]  John Maloney,et al.  The Scratch Programming Language and Environment , 2010, TOCE.

[14]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[15]  M. Marder,et al.  Flow and diffusion of high-stakes test scores , 2009, Proceedings of the National Academy of Sciences.

[16]  Elliot Soloway,et al.  Uncovering principles of novice programming , 1983, POPL '83.

[17]  Taylor Martin,et al.  Programming on the move: design lessons from IPRO , 2011, CHI Extended Abstracts.

[18]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[19]  Mark Weiser,et al.  Programming Problem Representation in Novice and Expert Programmers , 1983, Int. J. Man Mach. Stud..

[20]  Andrew Sears,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2002, CHI 2002.

[21]  Taylor Martin,et al.  Learning Programming with IPRO: The Effects of a Mobile, Social Programming Environment. , 2013 .

[22]  Andrea A. diSessa,et al.  Changing Minds: Computers, Learning, and Literacy , 2000 .

[23]  Janet L. Kolodner,et al.  Bricoleurs and Planners engaging in Scientific Reasoning: a Tale of Two Groups in One Learning Community , 2007, Res. Pract. Technol. Enhanc. Learn..

[24]  Deborah A. Fields,et al.  Making the Connections Visible: Crafting, Circuitry, and Coding in High School E-Textile , 2012 .

[25]  Jamie Zigelbaum,et al.  Shape-changing interfaces , 2011, Personal and Ubiquitous Computing.

[26]  R. Haigh Planning for Computer Literacy , 1985 .

[27]  M. Resnick,et al.  Diving into Complexity: Developing Probabilistic Decentralized Thinking through Role-Playing Activities. , 1998 .

[28]  David C. Webb,et al.  Recognizing computational thinking patterns , 2011, SIGCSE.

[29]  Sharon M. Carver,et al.  Cognitive objectives in a LOGO debugging curriculum: Instruction, learning, and transfer , 1988, Cognitive Psychology.

[30]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[31]  Jeannette M. Wing Computational thinking and thinking about computing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[32]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[33]  Philip J. Guo,et al.  Two studies of opportunistic programming: interleaving web foraging, learning, and writing code , 2009, CHI.

[34]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[35]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[36]  Matthew Berland,et al.  Programming Standing Up: Embodied Computing with Constructionist Robotics , 2010 .

[37]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[38]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[39]  Alan F. Blackwell,et al.  Children as Unwitting End-User Programmers , 2007, IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2007).

[40]  Andreas Stefik,et al.  An empirical comparison of the accuracy rates of novices using the quorum, perl, and randomo programming languages , 2011, PLATEAU '11.

[41]  Caitlin Kelleher,et al.  Storytelling alice motivates middle school girls to learn computer programming , 2007, CHI.

[42]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[43]  Roel Vertegaal,et al.  Programming reality: from transitive materials to organic user interfaces , 2009, CHI Extended Abstracts.

[44]  S. Turkle,et al.  Epistemological Pluralism: Styles and Voices within the Computer Culture , 1990, Signs: Journal of Women in Culture and Society.

[45]  Lai-Chong Law A situated cognition view about the effects of planning and authorship on computer program debugging , 1998, Behav. Inf. Technol..

[46]  Idit Harel Caperton,et al.  Contrasts in student engagement, meaning-making, dislikes, and challenges in a discovery-based program of game design learning , 2011 .

[47]  R. Estrella,et al.  Stuck in the Shallow End Education , Race , and Computing , 2008 .

[48]  Jill Casner-Lotto,et al.  Are They Really Ready to Work? Employers' Perspectives on the Basic Knowledge and Applied Skills of New Entrants to the 21st Century U.S. Workforce. , 2006 .

[49]  Jeannette M. Wing An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[50]  Taylor Martin A Theory of Physically Distributed Learning: How External Environments and Internal States Interact in Mathematics Learning , 2009 .

[51]  Lauri Malmi,et al.  How do students solve parsons programming problems?: an analysis of interaction traces , 2012, ICER '12.

[52]  Renee Hobbs,et al.  Conditions of Learning in Novice Programmers , 1986 .

[53]  Mark Guzdial,et al.  Learning on the job: characterizing the programming knowledge and learning strategies of web designers , 2010, CHI.

[54]  湯淺 太一,et al.  20世紀の名著名論:Seymour Papert: Mindstorms:Children Computers and Powerful Ideas Basic Books New York 1980 , 2005 .

[55]  Alexander Repenning,et al.  AgentSheets: End-User Programmable Simulations , 2000, J. Artif. Soc. Soc. Simul..

[56]  Mark Guzdial,et al.  Computers for communication, not calculation: media as a motivation and context for learning , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[57]  Michael Eisenberg,et al.  Children's programming, reconsidered: settings, stuff, and surfaces , 2009, IDC.

[58]  Antti Väätänen,et al.  UbiPlay: an interactive playground and visual programming tools for children , 2006, IDC '06.

[59]  Robert S Siegler,et al.  Cognitive variability. , 2007, Developmental science.

[60]  Mitchel Resnick,et al.  Programming by choice: urban youth learning programming with scratch , 2008, SIGCSE '08.

[61]  J. Bransford How people learn , 2000 .

[62]  Mordechai Ben-Ari,et al.  Salvation for Bricoleurs , 2001, PPIG.

[63]  Joel C. Adams Alice, middle schoolers & the imaginary worlds camps , 2007, SIGCSE '07.

[64]  Kate Ehrlich,et al.  Empirical Studies of Programming Knowledge , 1984, IEEE Transactions on Software Engineering.

[65]  Uriel J. Wilensky,et al.  Vbot: motivating computational and complex systems fluencies with constructionist virtual/physical robotics , 2008 .

[66]  Mitchel Resnick,et al.  Real-time programming and the big ideas of computational literacy , 2003 .

[67]  John Maloney,et al.  Back to the Future The Story of Squeak, A Practical Smalltalk Written in Itself , 1997 .

[68]  S. Dreyfus,et al.  A Five-Stage Model of the Mental Activities Involved in Directed Skill Acquisition , 1980 .

[69]  Christopher D. Hundhausen,et al.  Can direct manipulation lower the barriers to computer programming and promote transfer of training?: An experimental study , 2009, TCHI.

[70]  Margaret M. Burnett,et al.  Tinkering and gender in end-user programmers' debugging , 2006, CHI.

[71]  Gerry Stahl,et al.  Connecting Computer-Supported Collaborative Learning to Policy and Practice: CSCL2011 Conference Proceedings , 2011 .

[72]  Janet Rountree,et al.  Learning and Teaching Programming: A Review and Discussion , 2003, Comput. Sci. Educ..

[73]  Yasmin B. Kafai,et al.  Programming & storytelling: opportunities for learning about coding & composition , 2010, IDC.

[74]  Ravit Golan Duncan,et al.  From Theory to Data: The Process of Refining Learning Progressions , 2013 .

[75]  Jasna Kuljis,et al.  Learning programming using program visualization techniques , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.