Assessing the assessment of programming ability

A recent study [7] has shown that many computing students are not able to develop straightforward programs after the introductory programming sequence. Normal student assessment should have highlighted this problem, it did not, therefore normal assessment of programming ability does not work.We examine why current assessment methods (written exams and programming assignments) are faulty. We investigate another method of assessment (the lab exam) and show that this form of assessment is more accurate.We explain why accurate assessment is essential in order to encourage students to develop programming ability.

[1]  D. Rowntree.  Assessing Students: How Shall We Know Them? , 1977 .

[2]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[3]  Albert C. Oosterhof.  Classroom applications of educational measurement , 1994 .

[4]  Elliot B. Koffman,et al.  Use of laboratories in computer science education: guidelines for good practice: report of the working group on computing laboratories , 1996, ITiCSE.

[5]  P. Ashworth,et al.  Guilty in whose eyes? University students' perceptions of cheating and plagiarism in academic work and assessment , 1997 .

[6]  Nancy Falchikov,et al.  “Full on Until the Sun Comes Out”: the effects of assessment on student approaches to studying , 1998 .

[7]  Liz McDowell,et al.  The construction of the hidden curriculum: messages and meanings in the assessment of student learning , 1998 .

[8]  A. T. Chamillard,et al.  Evaluating programming ability in an introductory computer science course , 2000, SIGCSE '00.

[9]  A multi-national, multi-institutional study of assessment of programming skills of first-year CS students , 2001, SGCS.

[10]  Raymond Lister.  Objectives and objective assessment in CS1 , 2001, SIGCSE '01.

[11]  A. T. Chamillard,et al.  Using lab practica to evaluate programming ability , 2001, SIGCSE '01.

[12]  Shameem Nyla.  NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION , 2004 .

[13]  John Waldron,et al.  Introductory programming, problem solving and computer assisted assessment , 2002 .

[14]  Mary Goodwin,et al.  Testing skills and knowledge: introducing a laboratory exam in CS1 , 2002, SIGCSE.

[15]  Genevieve Orr,et al.  Interactive program demonstration as a form of student program assessment , 2002 .

[16]  Mark G. Simkin,et al.  How Well Do Multiple Choice Tests Evaluate Student Understanding in Computer Programming Classes? , 2003, J. Inf. Syst. Educ..

[17]  J. Barros,et al.  Using lab exams to ensure programming practice in an introductory programming course , 2003, ITiCSE '03.

[18]  Denise M. Woit,et al.  Effectiveness of online assessment , 2003, SIGCSE.

[19]  John Waldron,et al.  Assessing the assessment of programming ability , 2004 .

[20]  Mark A. Toleman,et al.  Training strategic problem solvers , 2004, SGCS.

[21]  J. Aultman.  The Hidden Curriculum , 2007 .