Investigating the effects of learning activities in a mobile Python tutor for targeting multiple coding skills

Mobile devices are increasingly being utilized for learning due to their unique features including portability for providing ubiquitous experiences. In this paper, we present PyKinetic, a mobile tutor we developed for Python programming, aimed to serve as a supplement to traditional courses. The overarching goal of our work is to design coding activities that maximize learning. As we work towards our goal, we first focus on the learning effectiveness of the activities within PyKinetic, rather than evaluating the effectiveness of PyKinetic as a supplement resource for an introductory programming course. The version of PyKinetic (PyKinetic_DbgOut) used in the study contains five types of learning activities aimed at supporting debugging, code-tracing, and code writing skills. We evaluated PyKinetic in a controlled lab study with quantitative and qualitative results to address the following research questions: (R1) Is the combination of coding activities effective for learning programming? (R2) How do the activities affect the skills of students with lower prior knowledge (novices) compared to those who had higher prior knowledge (advanced)? (R3) How can we improve the usability of PyKinetic? Results revealed that PyKinetic_DbgOut was more beneficial for advanced students. Furthermore, we found how coding skills are interrelated differently for novices compared to advanced learners. Lastly, we acquired sufficient feedback from the participants to improve the tutor.

[1]  Petri Ihantola,et al.  A mobile learning application for parsons problems with automatic feedback , 2012, Koli Calling.

[2]  Ivica Boticki,et al.  Teaching and learning computer science sorting algorithms with mobile devices: A case study , 2013, Comput. Appl. Eng. Educ..

[3]  Antonija Mitrovic,et al.  Learning with Engaging Activities via a Mobile Python Tutor , 2017, AIED.

[4]  Nick Cheng,et al.  Tracing vs. Writing Code: Beyond the Learning Hierarchy , 2018, SIGCSE.

[5]  Judy Perry,et al.  UbiqBio: Adoptions and Outcomes of Mobile Biology Games in the Ecology of School , 2014 .

[6]  Robert Ramberg,et al.  Learning with or without mobile devices? A comparison of traditional school field trips and inquiry-based mobile learning activities , 2014 .

[7]  David J. McArthur,et al.  Skill-oriented task sequencing in an intelligent tutor for basic algebra , 1988 .

[8]  Patricia Haden,et al.  Parson's programming puzzles: a fun and effective learning tool for first programming courses , 2006 .

[9]  Peter Lonsdale,et al.  MOBIlearn WP 4 - PEDAGOGICAL METHODOLOGIES AND PARADIGMS (UON, UOB, OU) Guidelines for learning/teaching/tutoring in a mobile environment , 2005 .

[10]  Daner Sun,et al.  Focusing a mobile science learning process: difference in activity participation , 2016, Res. Pract. Technol. Enhanc. Learn..

[11]  Colin J. Fidge,et al.  Further evidence of a relationship between explaining, tracing and writing skills in introductory programming , 2009, ITiCSE.

[12]  Junfei Zhang,et al.  Design of a Microlecture Mobile Learning System Based on Smartphone and Web Platforms , 2015, IEEE Transactions on Education.

[13]  Tobias Lauer,et al.  A study of algorithm animations on mobile devices , 2007, SIGCSE.

[14]  He Young Kim,et al.  Exploring Smartphone Applications for Effective Mobile-Assisted Language Learning , 2012 .

[15]  Tzu-Chien Liu,et al.  Split-attention and redundancy effects on mobile learning in physical environments , 2012, Comput. Educ..

[16]  Roy D. Pea,et al.  WILD for learning: Interacting through new computing devices anytime, anywhere , 2006 .

[17]  Y.-H. Wang,et al.  Could a mobile-assisted learning system support flipped classrooms for classical Chinese learning? , 2016, J. Comput. Assist. Learn..

[18]  Minjuan Wang,et al.  The impact of mobile learning on students' learning behaviours and performance: Report from a large blended classroom , 2009, Br. J. Educ. Technol..

[19]  Errol Thompson,et al.  Bloom's taxonomy for CS assessment , 2008, ACE '08.

[20]  Roy D. Pea,et al.  Language-Independent Conceptual “Bugs” in Novice Programming , 1986 .

[21]  ListerRaymond,et al.  Further evidence of a relationship between explaining, tracing and writing skills in introductory programming , 2009 .

[22]  Antonija Mitrovic,et al.  Investigating the Effectiveness of Menu-Based Self-explanation Prompts in a Mobile Python Tutor , 2017, AIED.

[23]  Anne Venables,et al.  A closer look at tracing, explaining and code writing skills in the novice programmer , 2009, ICER '09.

[24]  SuC-H.,et al.  A mobile gamification learning system for improving the learning motivation and achievements , 2015 .

[25]  Martin Ebner,et al.  It's in your pocket: A MOOC about programming for kids and the role of OER in teaching and learning contexts , 2018 .

[26]  Gwo-Jen Hwang,et al.  Effects of a peer competition-based mobile learning approach on students' affective domain exhibition in social studies courses , 2016, Br. J. Educ. Technol..

[27]  M. Murota,et al.  DEVELOPMENT AND EVALUATION OF AN INTERACTIVE ENGLISH CONVERSATION LEARNING SYSTEM WITH A MOBILE DEVICE USING TOPICS BASED ON THE LIFE OF THE LEARNER , 2013 .

[28]  Antonija Mitrovic,et al.  Adaptive Problem Selection in a Mobile Python Tutor , 2018, UMAP.

[29]  Hussein Suleman,et al.  Design and Use of Static Scaffolding Techniques to Support Java Programming on a Mobile Phone , 2016, ITiCSE.

[30]  Dean Mohamedally,et al.  RoboRun: A gamification approach to control flow learning for young students with TouchDevelop , 2013, ArXiv.

[31]  Philip J. Guo Online python tutor: embeddable web-based program visualization for cs education , 2013, SIGCSE '13.

[32]  Gill Clough,et al.  Mobile learning: Two case studies of supporting inquiry learning in informal and semiformal settings , 2013, Comput. Educ..

[33]  J. Lam,et al.  Social Media Education: Barriers and Critical Issues , 2015 .

[34]  Erkki Sutinen,et al.  Design, development, and evaluation of a mobile learning application for computing education , 2017, Education and Information Technologies.

[35]  Leon E. Winslow,et al.  Programming pedagogy—a psychological overview , 1996, SGCS.

[36]  Antonija Mitrovic,et al.  A comparison of different types of learning activities in a mobile Python tutor , 2017 .

[37]  HigginsColin,et al.  An analysis of patterns of debugging among novice computer science students , 2005 .

[38]  Jerry Chih-Yuan Sun,et al.  GPS sensor-based mobile learning for English: an exploratory study on self-efficacy, self-regulation and student achievement , 2015, Research and Practice in Technology Enhanced Learning.

[39]  Petri Ihantola,et al.  How to study programming on mobile touch devices: interactive Python code exercises , 2013, Koli Calling '13.

[40]  Peter Lonsdale,et al.  WP 4 - GUIDELINES FOR LEARNING/TEACHING/TUTORING IN A MOBILE ENVIRONMENT , 2003 .

[41]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[42]  Miguel Nussbaum,et al.  Scaffolding group explanation and feedback with handheld technology: impact on students’ mathematics learning , 2010 .

[43]  Miftachul Huda,et al.  Smartphones usage in the classrooms: Learning aid or interference? , 2017, Education and Information Technologies.

[44]  Ruth Wylie,et al.  The Self-Explanation Principle in Multimedia Learning , 2014 .

[45]  Gwo-Jen Hwang,et al.  An Inquiry-based Mobile Learning Approach to Enhancing Social Science Learning Effectiveness , 2010, J. Educ. Technol. Soc..

[46]  Robert McCartney,et al.  Naturally occurring data as research instrument: analyzing examination responses to study the novice programmer , 2010, SGCS.

[47]  K V Vinay,et al.  SMARTPHONE APPLICATIONS FOR MEDICAL STUDENTS AND PROFESSIONALS , 2013 .

[48]  Vivian Hsueh-hua Chen,et al.  Ubiquitous games for learning (UbiqGames): Weatherlings, a worked example , 2012, J. Comput. Assist. Learn..

[49]  D. Khismatrao,et al.  Smartphone, the New Learning Aid amongst Medical Students. , 2017, Journal of clinical and diagnostic research : JCDR.

[50]  LauerTobias,et al.  A study of algorithm animations on mobile devices , 2007 .

[51]  Ivica Boticki,et al.  Improving the design of a mCSCL Chinese character forming game with a distributed scaffolding design framework , 2017, Res. Pract. Technol. Enhanc. Learn..

[52]  Yeonjeong Park,et al.  A Pedagogical Framework for Mobile Learning: Categorizing Educational Applications of Mobile Technologies into Four Types. , 2011 .

[53]  Dickson K. W. Chiu,et al.  How useful are smartphones for learning? Perceptions and practices of Library and Information Science students from Hong Kong and Japan , 2015, Libr. Hi Tech.

[54]  Raymond Lister,et al.  Relationships between reading, tracing and writing skills in introductory programming , 2008, ICER '08.

[55]  C.-H. Cheng,et al.  A mobile gamification learning system for improving the learning motivation and achievements , 2015, J. Comput. Assist. Learn..