The purpose of the present investigation was to identify item factors that may contribute to differential item functioning (DIF) for Black examinees on Scholastic Aptitude Test (SAT) analogy items. This research was considered necessary because analogy items have repeatedly been identified as differentially more difficult for Black examinees. The research was performed in two steps. Initially items in three forms were classified according to several possible explanatory factors. Preliminary analyses identified several factors that seemed to affect DIF for Black examinees. In order to confirm these hypothesized factors, a second step involved classifying and analyzing analogy items from two additional SAT forms.
The most significant finding is that Black students appear to need more time to complete the SAT verbal sections than White students with comparable total SAT verbal scores. This differential speededness effect makes analogy items appear differentially more difficult for Black examinees. Once differential item functioning statistics were corrected for speededness, a smaller number of analogy items were identified as differentially more difficult. In addition, evaluation of the hypothesized factors showed that some of the factors are interdependent and no clear distinction could be made to determine out their individual effects. These item factors are: item position within each analogy set, difficulty, subject matter content, and level of abstractness. The effects of homographs and semantic relationship types are also confounded with the previous factors. The only factor that seemed to be independent was “vertical relationships”. In general, a vertical or word associative answering strategy seems to be more consistently used by Black examinees on those items with negative DIF.
Generalizations to be drawn from these results are limited because the analyses are based on regular administration items which tend to have several factors operating in a single item and which contain infrequent occurrence of some factors. At this stage, these results provide a clearer picture of how comparable Black and White students respond on analogy items and the factors that might influence their performance.
[1]
L. Sinnott.
DIFFERENCES IN ITEM PERFORMANCE ACROSS GROUPS
,
1980
.
[2]
R. Chaffin,et al.
A TAXONOMY OF SEMANTIC RELATIONS FOR THE CLASSIFICATION OF GRE ANALOGY ITEMS AND AN ALOGORITHM FOR THE GENERATION OF GRE‐TYPE ANALOGIES
,
1987
.
[3]
Donald B. Rubin,et al.
EFFECT OF INCREASED TEST‐TAKING TIME ON TEST SCORES BY ETHNIC GROUP, YEARS OUT OF SCHOOL, AND SEX
,
1982
.
[4]
Michael J. Subkoviak,et al.
A Comparison of Several Methods of Assessing Item Bias.
,
1979
.
[5]
David M. Williams,et al.
Accounting for Statistical Artifacts in Item Bias Research
,
1984
.
[6]
Neil J. Dorans,et al.
Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test.
,
1986
.
[7]
Lawrence J. Stricker,et al.
Identifying Test Items That Perform Differentially in Population Subgroups: A Partial Correlation Index
,
1982
.
[8]
Neil J. Dorans,et al.
ASSESSING UNEXPECTED DIFFERENTIAL ITEM PERFORMANCE OF FEMALE CANDIDATES ON SAT AND TSWE FORMS ADMINISTERED IN DECEMBER 1977: AN APPLICATION OF THE STANDARDIZATION APPROACH1
,
1983
.
[9]
Susan E. Whitely,et al.
Relationships in Analogy Items: a Semantic Component of a Psychometric Task
,
1977
.