Generating Practice Questions as a Preparation Strategy for Introductory Programming Exams

Written exams are a common form of assessment in introductory programming courses. Creating exam questions is normally the responsibility of the course instructor, however the process of authoring such questions may be a useful learning activity in itself. We explored this idea with a randomized controlled experiment (n > 700) in which a group of first-year programming students generated practice questions prior to an exam. Even though all questions were available to every student in the course for practice, the group that generated the questions performed significantly better on the exam. The effects were most pronounced when students answered exam questions on topics that were targeted by questions they had generated. We suggest that some existing tools for computer science education may benefit from incorporating related activities.

[1]  J. Dunlosky,et al.  Strengthening the Student Toolbox: Study Strategies to Boost Learning. , 2013 .

[2]  Mary Dee Medley On-line finals for CS1 and CS2 , 1998, ITiCSE '98.

[3]  Simon Bates,et al.  Assessing the quality of a student-generated question repository , 2013, 1308.2202.

[4]  Anne Venables,et al.  A closer look at tracing, explaining and code writing skills in the novice programmer , 2009, ICER '09.

[5]  Daryl J. D'Souza,et al.  Assessment of programming: pedagogical foundations of exams , 2013, ITiCSE '13.

[6]  David Hovemeyer,et al.  An open platform for managing short programming exercises , 2013, ICER '13.

[7]  Nick Parlante Nifty reflections , 2007, SGCS.

[8]  Assessing Process and Product - A Practical Lab Exam for an Introductory Programming Course , 2006, Proceedings. Frontiers in Education. 36th Annual Conference.

[9]  Peter R. Denner,et al.  A developmental comparison of the effects of provided and generated questions on text recall , 1987 .

[10]  John Hamer,et al.  The PeerWise system of student contributed assessment questions , 2008, ACE '08.

[11]  Sharon Tkacz,et al.  Student study techniques and the generation effect. , 1994 .

[12]  Daryl J. D'Souza,et al.  Instructor perspectives of multiple-choice questions in summative assessment for novice programmers , 2010, Comput. Sci. Educ..

[13]  John Hamer,et al.  The quality of a PeerWise MCQ repository , 2010, ACE '10.

[14]  Jeffrey R. Lehman,et al.  The Relative Effects of Experimenter and Subject Generated Questions on Learning from Museum Case Exhibits. , 1984 .

[15]  Robert McCartney,et al.  A multi-national study of reading and tracing skills in novice programmers , 2004, ITiCSE-WGR '04.

[16]  N. J. Slamecka,et al.  The Generation Effect: Delineation of a Phenomenon , 1978 .

[17]  Beryl Plimmer,et al.  The impact of question generation activities on performance , 2012, SIGCSE '12.

[18]  Barry J. Schwartz,et al.  Effect of question production and answering on prose recall. , 1975 .