Towards a Concept Inventory for Algorithm Analysis Topics

We present initial results from our work towards developing a concept inventory for algorithm analysis (AACI) at the post-CS2 level. We used a Delphi process to identify a list of algorithm analysis topics that were considered both important and hard by surveying a panel of experienced instructors. Through a similar survey process, we identified a list of student misconceptions related to the identified topics. Based on this, a set of pilot AACI items were developed. We validated the misconceptions list by analyzing student responses to four administrations of the pilot AACI in two different universities during Fall 2015 and Spring 2016. Results revealed that a sufficient number of students held most of the misconceptions identified in the list.

[1]  Barbara M. Olds,et al.  How to Create a Concept Inventory: The Thermal and Transport Concept Inventory , 2007 .

[2]  Cynthia Taylor,et al.  Computer science concept inventories: past and future , 2014, Comput. Sci. Educ..

[3]  Geoffrey L. Herman,et al.  Identifying student misconceptions of programming , 2010, SIGCSE.

[4]  D. Hestenes,et al.  Force concept inventory , 1992 .

[5]  Mark Guzdial,et al.  The FCS1: a language independent assessment of CS1 knowledge , 2011, SIGCSE.

[6]  Annemarie Hauf,et al.  Computers in education , 1983 .

[7]  Hung-Wei Tseng,et al.  Evaluating student understanding of core concepts in computer architecture , 2013, ITiCSE '13.

[8]  Mark Woodman,et al.  Avoiding object misconceptions , 1997, SIGCSE '97.

[9]  Jan Vahrenhold,et al.  Detecting and understanding students' misconceptions related to algorithms and data structures , 2012, SIGCSE '12.

[10]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[11]  Michael C. Loui,et al.  Creating the digital logic concept inventory , 2010, SIGCSE.

[12]  Leen-Kiat Soh,et al.  Concept inventories in computer science for the topic discrete mathematics , 2006, ACM SIGCSE Bull..

[13]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[14]  Michael C. Loui,et al.  Proof by incomplete enumeration and other logical misconceptions , 2008, ICER '08.

[15]  Mark Guzdial,et al.  Developing a validated assessment of fundamental CS1 concepts , 2010, SIGCSE.

[16]  Ela Zur,et al.  The efficiency of algorithms - misconceptions , 2004, Comput. Educ..

[17]  Rodolfo Azevedo,et al.  Developing a Computer Science Concept Inventory for Introductory Programming , 2016, SIGCSE.

[18]  Michael C. Loui,et al.  Identifying important and difficult concepts in introductory computing courses using a delphi process , 2008, SIGCSE '08.

[19]  Nesrin Özdener,et al.  A comparison of the misconceptions about the time-efficiency of algorithms by various profiles of computer-programming students , 2008, Comput. Educ..

[20]  Cynthia Taylor,et al.  Developing a pre- and post-course concept inventory to gauge operating systems learning , 2014, SIGCSE.

[21]  Michael C. Loui,et al.  Work in progress - students' misconceptions about state in digital systems , 2009, 2009 39th IEEE Frontiers in Education Conference.