Evidence that computer science grades are not bimodal

It is commonly thought that CS grades are bimodal. We statistically analyzed 778 distributions of final course grades from a large research university, and found only 5.8% of the distributions passed tests of multimodality. We then devised a psychology experiment to understand why CS educators believe their grades to be bimodal. We showed 53 CS professors a series of histograms displaying ambiguous distributions and asked them to categorize the distributions. A random half of participants were primed to think about the fact that CS grades are commonly thought to be bimodal; these participants were more likely to label ambiguous distributions as "bimodal". Participants were also more likely to label distributions as bimodal if they believed that some students are innately predisposed to do better at CS. These results suggest that bimodal grades are instructional folklore in CS, caused by confirmation bias and instructor beliefs about their students.

[1]  Larry L. Jacoby,et al.  Mental control and visual illusions : Toward explaining race-biased weapon misidentifications q , 2004 .

[2]  Clayton Lewis,et al.  Attitudes and beliefs about computer science among students and faculty , 2007, SGCS.

[3]  Mehran Sahami,et al.  As CS Enrollments Grow, Are We Attracting Weaker Students? , 2016, SIGCSE.

[4]  Raymond Lister,et al.  COMPUTING EDUCATION RESEARCHGeek genes and bimodal grades , 2010, INROADS.

[5]  Margaret W. Rossiter,et al.  Women Scientists in America: Struggles and Strategies to 1940 , 1983 .

[6]  H. Birx,et al.  The Mismeasure of Man , 1981 .

[7]  Madeline E. Heilman,et al.  The Affirmative Action Stigma Of Incompetence: Effects Of Performance Information Ambiguity , 1997 .

[8]  R. Rosenthal,et al.  Teacher Expectancy Effects: A Brief Update 25 Years after the Pygmalion Experiment. , 1991 .

[9]  Andrei Cimpian,et al.  Expectations of brilliance underlie gender distributions across academic disciplines , 2015, Science.

[10]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[11]  Daniel Zingaro,et al.  Reviewing CS1 exam question content , 2011, SIGCSE '11.

[12]  Raymond Lister,et al.  Predicting student success using fine grain clicker data , 2014, ICER '14.

[13]  ZingaroDaniel BOOK REVIEWLearner-centered design of computing education , 2016 .

[14]  Daniel Zingaro,et al.  Stepping up to integrative questions on CS1 exams , 2012, SIGCSE '12.

[15]  Petra Wächter Thinking in systems – a primer , 2011 .

[16]  Brian A. Nosek,et al.  A Decade of System Justification Theory: Accumulated Evidence of Conscious and Unconscious Bolstering of the Status Quo , 2004 .

[17]  Y. B. Wah,et al.  Power comparisons of Shapiro-Wilk , Kolmogorov-Smirnov , Lilliefors and Anderson-Darling tests , 2011 .

[18]  Tenzin Doleck,et al.  Exploring Bimodality in Introductory Computer Science Performance Distributions , 2018, EURASIA Journal of Mathematics, Science and Technology Education.

[19]  Raymond Lister,et al.  Geek genes, prior knowledge, stumbling points and learning edge momentum: parts of the one elephant? , 2013, ICER.

[20]  M. Eysenck,et al.  Bias in interpretation of ambiguous sentences related to threat in anxiety. , 1991, Journal of abnormal psychology.

[21]  Jane Stout,et al.  STEMing the tide: using ingroup experts to inoculate women's self-concept in science, technology, engineering, and mathematics (STEM). , 2011, Journal of personality and social psychology.

[22]  Normal distribution - Wikipedia, the free encyclopedia , 2012 .

[23]  Ankur Saxena,et al.  Towards a taxonomy of errors in HTML and CSS , 2013, ICER.

[24]  Paul Slovic,et al.  Motivated numeracy and enlightened self-government , 2017, Behavioural Public Policy.

[25]  M. Schilling,et al.  Is Human Height Bimodal? , 2002 .

[26]  S. Goodman A dirty dozen: twelve p-value misconceptions. , 2008, Seminars in hematology.

[27]  Margaret W. Rossiter,et al.  Women Scientists in America: Struggles and Strategies to 1940 , 1984 .

[28]  Mark Guzdial,et al.  Learner-Centered Design of Computing Education: Research on Computing for Everyone , 2015, Synthesis Lectures on Human-Centered Informatics.