The Canterbury QuestionBank: building a repository of multiple-choice CS1 and CS2 questions

In this paper, we report on an ITiCSE-13 Working Group that developed a set of 654 multiple-choice questions on CS1 and CS2 topics, the Canterbury QuestionBank. We describe the questions, the metadata we investigated, and some preliminary investigations of possible research uses of the QuestionBank. The QuestionBank is publicly available as a repository for computing education instructors and researchers.

[1]  James Skene,et al.  Introductory programming: examining the exams , 2012, ACE 2012.

[2]  Jacqueline L. Whalley,et al.  Measuring the difficulty of code comprehension tasks using software metrics , 2013, ACE '13.

[3]  Orit Hazzan,et al.  Guide to Teaching Computer Science: An Activity-Based Approach , 2011 .

[4]  Michael Goldweber.  Proposal for an on-line computer science courseware review , 1996, ITiCSE '96.

[5]  Tony Clear,et al.  Salient elements in novice solutions to code writing problems , 2011, ACE 2011.

[6]  Mary E. Piontek,et al.  BEST PRACTICES FOR DESIGNING AND GRADING EXAMS , 2008 .

[7]  Raymond Lister.  The Neglected Middle Novice Programmer: Reading and Writing without Abstracting , 2007 .

[8]  Judithe Sheard,et al.  Contributing student pedagogy , 2012, Comput. Sci. Educ..

[9]  Stephen H. Edwards,et al.  Developing a common format for sharing programming assignments , 2008, ACM SIGCSE Bull..

[10]  Jacqueline L. Whalley,et al.  Revisiting models of human conceptualisation in the context of a programming examination , 2013, ACE '13.

[11]  Carsten Schulte,et al.  Block Model: an educational model of program comprehension as a tool for a scholarly approach to teaching , 2008, ICER '08.

[12]  Duane Buck,et al.  Design early considered harmful: graduated exposure to complexity and structure based on levels of cognitive development , 2000, SIGCSE '00.

[13]  Raymond Lister.  Objectives and objective assessment in CS1 , 2001, SIGCSE '01.

[14]  Deborah Knox.  The computer science teaching center , 1999, SGCS.

[15]  Deborah Knox.  On-line publication of CS laboratories , 1997, SIGCSE '97.

[16]  Tony Clear.  The hermeneutics of program comprehension: a 'holey quilt' theory , 2012, INROADS.

[17]  Christopher D. Manning,et al.  Finding Educational Resources on the Web: Exploiting Automatic Extraction of Metadata , 2003 .

[18]  Stephen H. Edwards,et al.  DCER: sharing empirical computer science education data , 2008, ICER '08.

[19]  Judy Kay,et al.  Over-confidence and confusion in using bloom for programming fundamentals assessment , 2012, SIGCSE '12.

[20]  Quintin I. Cutts,et al.  The abstraction transition taxonomy: developing desired learning outcomes through the lens of situated cognition , 2012, ICER '12.

[21]  Orit Hazzan,et al.  Guide to Teaching Computer Science , 2011, Springer London.

[22]  Robert McCartney,et al.  Making sense of data structures exams , 2010, ICER '10.

[23]  John Hamer,et al.  PeerWise: students sharing their multiple choice questions , 2008, ICER '08.

[24]  Susan M. Mitchell,et al.  Assessing the Value of Computer Science Course Material Repositories , 2006, 19th Conference on Software Engineering Education and Training Workshops (CSEETW'06).

[25]  Deborah Knox.  CITIDEL: making resources available , 2002, ITiCSE '02.

[26]  Erkki Sutinen,et al.  Developing laboratories for the SIGCSE computing laboratory repository: guidelines, recommendations, and sample labs (report of the ITiCSE '97 working group on designing laboratory materials for computing courses) , 1997, ITiCSE-WGR '97.

[27]  Marguerite Johnson,et al.  Helping Children Learn , 1941 .

[28]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[29]  Robert McCartney,et al.  Applying data structures in exams , 2011, SIGCSE.

[30]  Steve M. Easterbrook,et al.  Comparing and contrasting different algorithms leads to increased student learning , 2013, ICER.

[31]  Neil Brown,et al.  Repositories of teaching material and communities of use: nifty assignments and the greenroom , 2010, ICER '10.

[32]  Edward A. Fox,et al.  Towards a syllabus repository for computer science courses , 2007, SIGCSE.