Do Computer Science Students Understand Their Programming Task?—A Case Study of Solving the Josephus Variant Problem

The ability of students to problem solve begins with interpreting the problem. When they interpret the problem inaccurately, they will likely use ineffective strategies or fail to solve the problem. Studies reported students are often incapable of identifying and articulating the problem goal, requirements/constraints, and expected output. In other words, students lack self-regulation skills, especially related to task understanding. In this study, two male and two female senior computer science students from Utah State University, USA, were recruited as research participants to learn more about their task understanding skills while engage in programming tasks. The participants were asked to answer five programming problems while thinking aloud, and their responses were video- and audio-recorded. This report focuses on one of the problems, which was a variant of the Josephus problem. Three research questions were used to guide the analysis: (a) what were the participants’ initial task understanding; (b) how did it change during the problem-solving endeavor; and (c) why did it change. All participants identified the problem goal inaccurately and as a result, selected ineffective problem-solving strategies. The analysis suggested their inaccurate task interpretations were caused by their confidence bias (i.e., a systematic cognitive error), in which they drew knowledge and strategies from irrelevant experience. Out of four participants, only one was able to defeat the confidence bias and acquired an accurate task understanding; the influencing factors and possible interventions to overcome confidence bias are discussed.

[1]  Oenardi Lawanto,et al.  Advancing research on engineering design using e-Journal , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[2]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[3]  Scott D. Johnson Cognitive Analysis of Expert and Novice Troubleshooting Performance , 2008 .

[4]  Oenardi Lawanto,et al.  Understanding Student Coregulation in Task Interpretation during Electronics Laboratory Activities , 2016 .

[5]  Linden J. Ball,et al.  Spontaneous analogising in engineering design: a comparative analysis of experts and novices , 2004 .

[6]  Mordechai Ben-Ari,et al.  Constructivism in computer science education , 1998, SIGCSE '98.

[7]  Ronan G. Reilly,et al.  Examining the role of self-regulated learning on introductory programming performance , 2005, ICER '05.

[8]  Mário B. Ferreira,et al.  The metacognitive advantage of deliberative thinkers: a dual-process perspective on overconfidence. , 2013, Journal of personality and social psychology.

[9]  B. Zimmerman A social cognitive view of self-regulated academic learning. , 1989 .

[10]  Inna Pivkina,et al.  Young women in computing: lessons learned from an educational & outreach program , 2009, SIGCSE '09.

[11]  Sze Yee Lye,et al.  Review on teaching and learning of computational thinking through programming: What is next for K-12? , 2014, Comput. Hum. Behav..

[12]  Toto Nusantara,et al.  The Students Decision Making in Solving Discount Problem , 2016 .

[13]  Allyson F. Hadwin,et al.  EXAMINING THE AGREEMENT BETWEEN STUDENT AND INSTRUCTOR TASK PERCEPTIONS IN A COMPLEX ENGINEERING DESIGN TASK , 2011 .

[14]  Deborah L. Butler,et al.  Collaborative inquiry and distributed agency in educational change: A case study of a multi-level community of inquiry , 2015 .

[15]  Maizatul Akmar Ismail,et al.  Metacognitive Support Accelerates Computer Assisted Learning for Novice Programmers , 2017, J. Educ. Technol. Soc..

[16]  Alana Platt,et al.  Getting IT Together , 2017, ACM Trans. Comput. Educ..

[17]  D. Jonassen Learning to Solve Problems: An Instructional Design Guide , 2009 .

[18]  Alan H. Schoenfeld,et al.  Episodes and Executive Decisions in Mathematical Problem Solving. , 1981 .

[19]  Peter B. Henderson,et al.  Ubiquitous Computational Thinking , 2009, Computer.

[20]  Judith Gal-Ezer,et al.  What (else) should CS educators know? , 1998, CACM.

[21]  Oenardi Lawanto,et al.  Students’ Cognitive Self Appraisal And Self Management, And The Level Of Difficulty Of An Engineering Design Project: Are They Related? , 2009 .

[22]  Harvey F. Silver,et al.  Learning Styles and Strategies , 1996 .

[23]  Norman Edward Gronlund,et al.  Assessment of student achievement , 1997 .

[24]  Mark Guzdial What's the best way to teach computer science to beginners? , 2015, Commun. ACM.

[25]  D. Butler,et al.  Promoting Strategic Learning by Postsecondary Students with Learning Disabilities , 1995, Journal of learning disabilities.

[26]  Marietjie Havenga,et al.  The role of metacognitive skills in solving object-oriented programming problems: a case study , 2015 .

[27]  P. Pintrich The Role of Metacognitive Knowledge in Learning, Teaching, and Assessing , 2002 .

[28]  Graciela Gonzalez A systematic approach to active and cooperative learning in CS1 and its effects on CS2 , 2006, SIGCSE '06.

[29]  B. Zimmerman Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.

[30]  Jesse M. Heines,et al.  Teaching computational thinking through musical live coding in scratch , 2010, SIGCSE.

[31]  Wade H. Goodridge,et al.  Pattern of Task Interpretation and Self-Regulated Learning Strategies of High School Students and College Freshmen during an Engineering Design Project. , 2013 .

[32]  Matthew C. Makel,et al.  Facts Are More Important Than Novelty , 2014 .

[33]  Oenardi Lawanto,et al.  Students' metacognition during an engineering design project , 2010 .

[34]  Lisanne Bainbridge,et al.  Verbal protocol analysis. , 1990 .

[35]  G. Gigerenzer How to Make Cognitive Illusions Disappear: Beyond “Heuristics and Biases” , 1991 .

[36]  Nickolas J. G. Falkner,et al.  Identifying computer science self-regulated learning strategies , 2014, ITiCSE '14.

[37]  Minhong Wang,et al.  Visualizing the Complex Process for Deep Learning with an Authentic Programming Project , 2017, J. Educ. Technol. Soc..

[38]  Oenardi Lawanto,et al.  Student’s Self-Regulation in Managing Their Capstone Senior Design Projects , 2016 .

[39]  Jeffrey A. Stone,et al.  Gender, perceptions, and reality: technological literacy among first-year students , 2007, SIGCSE '07.

[40]  Ville Tirronen,et al.  Teaching programming by emphasizing self-direction: How did students react to the active role required of them? , 2013, TOCE.

[41]  Jeannette M. Wing An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[42]  Celine Latulipe,et al.  CS girls rock: sparking interest in computer science and debunking the stereotypes , 2003, SIGCSE.

[43]  John Mason,et al.  Why the high attrition rate for computer science students: some thoughts and observations , 2005, SGCS.

[44]  David H. Jonassen,et al.  Learning to Solve Problems : A Handbook for Designing Problem-Solving Learning Environments , 2010 .

[45]  Frans Henskens,et al.  Student-Centered Learning Objects to Support the Self-Regulated Learning of Computer Science , 2012 .

[46]  Estelle Gaigher,et al.  Confidence versus Performance as an Indicator of the Presence of Alternative Conceptions and Inadequate Problem‐Solving Skills in Mechanics , 2010 .

[47]  John G. Brisson,et al.  Design for use: a case study of an authentically impactful design experience , 2018 .

[48]  T. Howles Preliminary results of a longitudinal study of computer science student trends, behaviors and preferences , 2007 .

[49]  Claudia Szabo,et al.  Gender Gap in Academia: Perceptions of Female Computer Science Academics , 2015, ITiCSE.

[50]  Colleen M. Lewis,et al.  "I Don't Code All Day": Fitting in Computer Science When the Stereotypes Don't Fit , 2016, ICER.

[51]  Amy L. Dent,et al.  The Relation Between Self-Regulated Learning and Academic Achievement Across Childhood and Adolescence: A Meta-Analysis , 2016 .

[52]  Lisa Benson,et al.  The Role of Replication in Engineering Education Research , 2015 .

[53]  Daniel L. Dinsmore,et al.  Focusing the Conceptual Lens on Metacognition, Self-regulation, and Self-regulated Learning , 2008 .

[54]  Nathan McNeill,et al.  Undergraduate Students' Beliefs about Engineering Problem Solving , 2016 .

[55]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[56]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[57]  Joel C. Adams Alice, middle schoolers & the imaginary worlds camps , 2007, SIGCSE '07.

[58]  Lilly Irani Understanding gender and confidence in CS course culture , 2004 .

[59]  Jeannette M. Wing Computational thinking and thinking about computing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[60]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[61]  Kent D. Lee Foundations of Programming Languages , 2017, Undergraduate Topics in Computer Science.

[62]  Vive Kumar,et al.  Effects of self-regulated learning in programming , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[63]  David H. Jonassen,et al.  Toward a design theory of problem solving , 2000 .

[64]  Laurie A. Williams,et al.  In Support of Pair Programming in the Introductory Computer Science Course , 2002, Comput. Sci. Educ..

[65]  T. Lacey,et al.  Occupational Employment Projections to 2018 , 2009 .

[66]  J. Lapadat,et al.  Transcription in Research and Practice: From Standardization of Technique to Interpretive Positionings , 1999 .

[67]  S. Järvelä,et al.  Self-Regulated, Co-Regulated, and Socially Shared Regulation of Learning , 2011 .

[68]  Keith J. Whittington Infusing active learning into introductory programming courses , 2004 .

[69]  D. Kahneman A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[70]  Anastasia Kitsantas,et al.  Developing Self-Regulated Learners: Goal Setting, Self-Evaluation, and Organizational Signals During Acquisition of Procedural Skills , 2004 .

[71]  Wade H. Goodridge,et al.  Task Interpretation, Cognitive, and Metacognitive Strategies of Higher and Lower Performers in an Engineering Design Project: An Exploratory Study of College Freshmen , 2013 .

[72]  Ray Lischner Explorations: structured labs for first-time programmers , 2001, SIGCSE '01.

[73]  Harry B. Santoso,et al.  Computer self-efficacy, cognitive, and metacognitive strategies of high school students while engaged in interactive learning modules , 2013, 2013 IEEE Frontiers in Education Conference (FIE).

[74]  Tom Briggs Techniques for active learning in CS courses , 2005 .

[75]  Gwo-Jen Hwang,et al.  Enhancing Students' Computer Programming Performances, Critical Thinking Awareness and Attitudes towards Programming: An Online Peer Assessment Attempt , 2017 .

[76]  S. A. Coutinho The relationship between goals, metacognition, and academic success , 2007 .

[77]  Jacques Lonchamp,et al.  Customizable Computer-based Interaction Analysis for Coaching and Self-Regulation in Synchronous CSCL Systems , 2010, J. Educ. Technol. Soc..

[78]  Baochuan Lu,et al.  Teaching true computer science principles to the general student , 2014 .

[79]  D. Janaki Ram,et al.  Identification of Cognitive Processes of Effective and Ineffective Students During Computer Programming , 2010, TOCE.

[80]  Sabina Kleitman,et al.  The Role of Individual Differences in the Accuracy of Confidence Judgments , 2002, The Journal of general psychology.

[81]  Margus Pedaste,et al.  First-year dropout in ICT studies , 2015, 2015 IEEE Global Engineering Education Conference (EDUCON).

[82]  Juliet Tiffany-Morales,et al.  Social Perceptions in Computer Science and Implications for Diverse Students , 2017, ICER.

[83]  John R. Anderson,et al.  The automated tutoring of introductory computer programming , 1986, CACM.

[84]  Oenardi Lawanto,et al.  Students’ Task Interpretation and Conceptual Understanding in an Electronics Laboratory , 2017, IEEE Transactions on Education.

[85]  Susanne E. Hambrusch,et al.  A multidisciplinary approach towards computational thinking for science majors , 2009, SIGCSE '09.

[86]  Tricia Walker,et al.  Computer science , 1996, English for academic purposes series.

[87]  J. Creswell Qualitative inquiry and research design: Choosing among five approaches, 2nd ed. , 2007 .