Differential Item Functioning in Attitude Assessment

Differential item functioning (DIF) is not often seen in the literature on attitude assessment. A brief discussion of DIF and methods of implementation is followed by an illustrative example from a program evaluation, using an attitude-towards-science scale with 1550 children in grades one through six. An item exhibiting substantial DIF with respect to gender was detected using the Mantel-Haenszel procedure. In a second example, data from workshop evaluations with 1682 adults were recoded to a binary format, and it was found that an item suspected of functioning differentially with respect to age groups was, in fact, not doing so. Implications for evaluation practice are discussed.

[1]  Howard T. Everson,et al.  Methodology Review: Statistical Approaches for Assessing Measurement Bias , 1993 .

[2]  Jeri Benson,et al.  Detecting Item BIAS in Affective Scales , 1987 .

[3]  S. Presser,et al.  Survey Questions: Handcrafting the Standardized Questionnaire. , 1988 .

[4]  P. Holland,et al.  DIF DETECTION AND DESCRIPTION: MANTEL‐HAENSZEL AND STANDARDIZATION1,2 , 1992 .

[5]  Catherine J. Welch,et al.  Procedures for Extending Item Bias Detection Techniques to Polytomously Scored Items. , 1993 .

[6]  G. Engelhard,et al.  Accuracy of Bias Review Judges in Identifying Differential Item Functioning on Teacher Certification Tests , 1990 .

[7]  Timothy R. Miller,et al.  Logistic Regression and Its Use in Detecting Differential Item Functioning in Polytomous Items , 1996 .

[8]  R. Millsap,et al.  Factors Influencing the Mantel-Haenszel Procedure the Detection of Differential Item Functioning , 1994 .

[9]  Michael J. Zieky,et al.  Practical questions in the use of DIF statistics in test development. , 1993 .

[10]  N. Dorans.  Two New Approaches to Assessing Differential Item Functioning: Standardization and the Mantel--Haenszel Method , 1989 .

[11]  Á. M. Fidalgo.  MHDIF: A Computer Program for Detecting Uniform and Nonuniform Differential Functioning With the Mantel-Haenszel Procedure , 1994 .

[12]  R. Hambleton,et al.  The Effects of Purification of Matching Criterion on the Identification of DIF Using the Mantel-Haenszel Procedure , 1993 .

[13]  L. Shepard,et al.  Methods for Identifying Biased Test Items , 1994 .

[14]  Allan S. Cohen,et al.  Detection of Differential Item Functioning in the Graded Response Model , 1993 .

[15]  Hua-Hua Chang,et al.  Detecting DIF for Polytomously Scored Items: An Adaptation of the SIBTEST Procedure , 1995 .

[16]  Dorothy T. Thayer,et al.  Differential Item Performance and the Mantel-Haenszel Procedure. , 1986 .

[17]  W. G. Cochran.  Some Methods for Strengthening the Common χ 2 Tests , 1954 .

[18]  Daniel J. Mueller.  Measuring Social Attitudes: A Handbook for Researchers and Practitioners , 1986 .

[19]  W. Haenszel,et al.  Statistical aspects of the analysis of data from retrospective studies of disease. , 1959, Journal of the National Cancer Institute.