What do successful computer science students know? An integrative analysis using card sort measures and content analysis to evaluate graduating students' knowledge of programming concepts

Abstract: This paper describes a multi-institutional study that used a repeated single-criterion card sort to investigate graduating computer science students' knowledge of programming concepts. The study seeks to improve computer science instruction by gaining insight into how graduating students retain and assimilate introductory programming knowledge into their broader understanding of the discipline. A total of 291 card sorts was elicited from 65 undergraduate students in their final year of study at eight colleges and universities throughout the USA. To fully exploit the rich qualitative and quantitative aspects of the card sort data, an integrative analysis process was used that combined content analysis with two measures, normalized minimum spanning tree and edit distance, both developed specifically to analyze card sort data.

[1]  Sue Fitzgerald,et al.  A multi‐institutional, multinational study of programming concepts using card sort data , 2005, Expert Syst. J. Knowl. Eng..

[2]  Richard J. Anderson,et al.  Using edit distance to analyze card sorts , 2005, Expert Syst. J. Knowl. Eng..

[3]  David J. Gilmore,et al.  Are objects that important? effects of expertise and familiarity on classification of object-oriented code , 1995 .

[4]  Briana B. Morrison,et al.  A multi-institutional investigation of computer science seniors' knowledge of programming concepts , 2005 .

[5]  Sue Gerrard,et al.  Women's working wardrobes: a study using card sorts , 2005, Expert Syst. J. Knowl. Eng..

[6]  Barbara A. Kitchenham,et al.  Using Card Sorts to Elicit Web Page Quality Attributes , 2001, IEEE Softw..

[7]  Briana B. Morrison,et al.  A multi-institutional investigation of computer science seniors' knowledge of programming concepts , 2005, SIGCSE '05.

[8]  Ronald E. Anderson Gender and Computers: Understanding the Digital Divide , 2004 .

[9]  Sue V. Rosser,et al.  Re-engineering female friendly science , 1997 .

[10]  Allan Fisher,et al.  Unlocking the Clubhouse : Women in Computing by Allan Fisher , 2015 .

[11]  Steven E. Stemler,et al.  An Overview of Content Analysis. , 2001 .

[12]  Susan M. Haller,et al.  Measuring card sort orthogonality , 2005, Expert Syst. J. Knowl. Eng..

[13]  Gordon Rugg,et al.  The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts , 1997, Expert Syst. J. Knowl. Eng..