Classifying computing education papers: process and results

We have applied Simon's system for classifying computing education publications to all three years of papers from ICER. We describe the process of assessing the inter-rater reliability of the system and fine-tuning it along the way. Our analysis of the ICER papers confirms that ICER is a research-intensive conference. It also indicates that the research is quite narrowly focused, with the majority of the papers set in the context of programming courses. In addition we find that ICER has a high proportion of papers involving more than one institution, and high proportions of papers on the themes of ability/aptitude and theories and models of teaching and learning.

[1]  Robert McCartney,et al.  What novice programmers don't know , 2005, ICER '05.

[2]  Mark Guzdial,et al.  Narrating data structures: the role of context in CS2 , 2007, ICER '07.

[3]  Fahri Yetim,et al.  Structuring Communication Processes and Enhancing Public Discourse : The Delphi Method Revisited , 2004 .

[4]  Tammy VanDeGrift,et al.  Uncovering student values for hiring in the software industry , 2008, JERC.

[5]  Simon.  Koli Calling comes of age: an analysis , 2007 .

[6]  Angela Carbone,et al.  Eight years of computing education papers at NACCQ , 2008 .

[7]  Orna Muller.  Pattern oriented instruction and the enhancement of analogical reasoning , 2005, ICER '05.

[8]  M. Banerjee,et al.  Beyond kappa: A review of interrater agreement measures , 1999 .

[9]  Anders Berglund,et al.  What does it take to learn 'programming thinking'? , 2005, ICER '05.

[10]  Brian Hanks.  Problems encountered by novice pair programmers , 2008, JERC.

[11]  William Wiersma,et al.  Research Methods in Education: An Introduction , 1980 .

[12]  Sue Fitzgerald,et al.  Strategies that students use to trace code: an analysis based in grounded theory , 2005, ICER '05.

[13]  Sally Fincher,et al.  Computer Science Education Research , 2004 .

[14]  L. Cohen,et al.  Research Methods in Education , 1980 .

[15]  Sally Fincher,et al.  Warren's question , 2007, ICER '07.

[16]  David R. Krathwohl,et al.  Methods of Educational and Social Science Research: An Integrated Approach , 1992 .

[17]  Mark Guzdial,et al.  Impact of alternative introductory courses on programming concept understanding , 2005, ICER '05.

[18]  David W. Valentine,et al.  CS educational research: a meta-analysis of SIGCSE technical symposium proceedings , 2004, SIGCSE '04.

[19]  Kris Powers,et al.  Evaluating assessments of novice programming environments , 2005, ICER '05.

[20]  C. Powell.  The Delphi technique: myths and realities. , 2003, Journal of advanced nursing.

[21]  J. Philip East,et al.  On models of and for teaching: toward theory-based computing education , 2006, ICER '06.

[22]  Titus Winters,et al.  What do students know?: an outcomes-based assessment system , 2005, ICER '05.

[23]  Robert McCartney,et al.  Through the eyes of instructors: a phenomenographic investigation of student success , 2007, ICER '07.

[24]  Lauri Malmi,et al.  Constructing a core literature for computing education research , 2005, SGCS.

[25]  Simon,et al.  A Classification of Recent Australasian Computing Education Publications , 2007, Comput. Sci. Educ..

[26]  Carsten Schulte,et al.  Attitudes towards computer science-computing experiences as a starting point and barrier to computer science , 2007, ICER '07.

[27]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .