Examining Gender Differences in Written Assessment Tasks in Biology: A Case Study of Evolutionary Explanations

Using item-response theory, the authors evaluated differences in performance by gender on a constructed-response assessment about natural selection. The results identify relationships between item features and performance by gender and highlight the importance of examining gender effects on performance in written assessment tasks in biology.

[1]  H. Schweingruber,et al.  TAKING SCIENCE TO SCHOOL: LEARNING AND TEACHING SCIENCE IN GRADES K-8 , 2007 .

[2]  Charles W. Anderson,et al.  Student conceptions of natural selection and its role in evolution , 1986 .

[3]  W. Welch,et al.  Policy considerations based on a cost analysis of alternative test formats in large scale science assessments , 2000 .

[4]  Marcia C. Linn,et al.  An Investigation of Explanation Multiple-Choice Items in Science Assessment , 2011 .

[5]  Geoffrey L. Cohen,et al.  Supporting Online Material for Reducing the Gender Achievement Gap in College Science: A Classroom Study of Values Affirmation , 2010 .

[6]  J. Scheuneman,et al.  Using Differential Item Functioning Procedures to Explore Sources of Item Difficulty and Group Performance Characteristics. , 1990 .

[7]  Minsu Ha,et al.  Item Feature Effects in Evolution Assessment. , 2011 .

[8]  Drew H. Gitomer,et al.  Establishing multilevel coherence in assessment , 2007 .

[9]  G. Masters.  The Partial Credit Model , 2016 .

[10]  S. Lane,et al.  GENDER-RELATED DIFFERENTIAL ITEM FUNCTIONING ON A MIDDLE-SCHOOL MATHEMATICS PERFORMANCE ASSESSMENT , 2005 .

[11]  Sara E. Brownell,et al.  Context Matters: Volunteer Bias, Small Sample Size, and the Value of Comparison Groups in the Assessment of Research-Based Undergraduate Introductory Biology Lab Courses , 2013, Journal of microbiology & biology education.

[12]  N. Skinner,et al.  Switching Answers on Multiple-Choice Questions: Shrewdness or Shibboleth? , 1983 .

[13]  G. Engelhard,et al.  Gender Differences in Performance on Multiple-Choice and Constructed Response Mathematics Items. , 1999 .

[14]  Christine E. DeMars.  Test Stakes and Item Format Interactions , 2000 .

[15]  G. Rowley.  WHICH EXAMINEES ARE MOST FAVOURED BY THE USE OF MULTIPLE CHOICE TESTS , 1974 .

[16]  L. Hedges,et al.  Sex differences in mental test scores, variability, and numbers of high-scoring individuals. , 1995, Science.

[17]  Jenessa R. Shapiro,et al.  The Role of Stereotype Threats in Undermining Girls’ and Women’s Performance and Interest in STEM Fields , 2012 .

[18]  Nina L. Colwill,et al.  The psychology of sex differences , 1978 .

[19]  R. Murphy.  SEX DIFFERENCES IN OBJECTIVE TEST PERFORMANCE , 1982 .

[20]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[21]  Christine E. DeMars.  Gender Differences in Mathematics and Science on a High School Proficiency Exam: The Role of Response Format , 1998 .

[22]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[23]  Ross H. Nehm,et al.  The future of natural selection knowledge measurement: A reply to Anderson et al. (2010) , 2009 .

[24]  C. Steele.  A threat in the air. How stereotypes shape intellectual identity and performance. , 1997, The American psychologist.

[25]  Abigail M. Harris,et al.  PATTERNS OF GENDER DIFFERENCES ON MATHEMATICS ITEMS ON THE SCHOLASTIC APTITUDE TEST , 1993 .

[26]  A. Herlitz,et al.  Gender differences in episodic memory , 1997, Memory & cognition.

[27]  James W Pellegrino,et al.  Proficiency in Science: Assessment Challenges and Opportunities , 2013, Science.

[28]  G. Hanna.  Sex Differences in the Mathematics Achievement of Eighth Graders in Ontario. , 1986 .

[29]  J. Croizet,et al.  Stereotype Threat, Social Class, Gender, and Academic Under-Achievement: When Our Reputation Catches Up to Us and Takes Over , 2001 .

[30]  Sarah B. McKagan,et al.  Gender gap on concept inventories in physics: what is consistent, what is inconsistent,and what factors influence the gap? , 2013, 1307.0912.

[31]  Molly H. Weinburgh,et al.  Gender differences in student attitudes toward science: A meta‐analysis of the literature from 1970 to 1991 , 1995 .

[32]  Marcia C. Linn,et al.  Validating Measurement of Knowledge Integration in Science Using Multiple-Choice and Explanation Items , 2011 .

[33]  R. Murphy.  Sex Differences in GCE Examination Entry Statistics and Success Rates , 1980 .

[34]  Robert E. Slavin,et al.  Best-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews , 1986 .

[35]  International Gender × Item Difficulty interactions in mathematics and science achievement tests , 2003 .

[36]  Niall Bolger,et al.  Method of Measurement and Gender Differences in Scholastic Achievement , 1990 .

[37]  Gender‐Based Differential Item Performance in Mathematics Achievement Items , 1987 .

[38]  Minsu Ha,et al.  Reasoning About Natural Selection: Diagnosing Contextual Competency using the ACORNS Instrument , 2012 .

[39]  G. Norman,et al.  Development and Evaluation of the Conceptual Inventory of Natural Selection , 2002 .

[40]  W. Haenszel,et al.  Statistical aspects of the analysis of data from retrospective studies of disease. , 1959, Journal of the National Cancer Institute.

[41]  J. Blickenstaff.  Women and science careers: leaky pipeline or gender filter? , 2005 .

[42]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[43]  Mark L. Davison,et al.  Gender Differences by Item Difficulty Interactions in Multiple-Choice Mathematics Items , 1998 .

[44]  Minsu Ha,et al.  Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance? , 2013, Journal of Science Education and Technology.

[45]  B. Becker.  Item Characteristics and Gender Differences on the SAT-M for Mathematically Able Youths , 1990 .

[46]  David A. Gillam,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2012 .

[47]  James M. Royer,et al.  Math-Fact Retrieval as the Cognitive Mechanism Underlying Gender Differences in Math Test Performance. , 1999, Contemporary educational psychology.

[48]  Helen R. Quinn,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2013 .

[49]  D. Halpern.  Sex Differences in Cognitive Abilities , 1986 .

[50]  Helen Raptis,et al.  Gender Differences in Introductory Atmospheric and Oceanic Science Exams: Multiple Choice Versus Constructed Response Questions , 2001 .

[51]  M. Kimball.  A new perspective on women's math achievement. , 1989 .

[52]  M. Linn,et al.  Gender, Mathematics, and Science , 1989 .