Alchemy and beyond: Indexing the Defining Issues Test.

For over 20 years, the Defining Issues Test (DIT) has used the P index. In view of criticisms, a search has been underway for a new index. The authors propose a working definition of construct validity, systematically reanalyze existing data sets ("classic" studies) with new indexes, and make comparisons to trends obtained using the P index. The criteria for construct validity are (a) sensitivity to educational interventions, (b) differentiation of age-education al groups, (c) upward movement in longitudinal studies, (d) correlations with moral comprehension, (e) correlations with prosocial behavior, and (f) correlations with civil libertarian attitudes. As meta-analysis demonstrates, a new index, N2, generally outperforms the P index. In the early 1970s, Larry Kohlberg found amusement by comparing the research project on the Defining Issues Test (DIT) to alchemy. The alchemist's dream of the middle ages had been to transmute the "base metals" into gold. At the time, Kohlberg was beginning work on revising his scoring system and was mindful of the complexities involved in analyzing moral judgments and the arduous work required of a scorer. Kohlberg pointed out similarities between alchemy and the attempt to derive a measure of moral judgment from a multiple-choic e test. Obtaining moral development scores by simply asking participants to rate or rank statements seemed too good to be true—it was like trying to turn lead into gold. Nevertheless he was supportive of the exploration of new sources of information on moral judgment (Kohlberg, 1979), although he did make sure that we were alert to the possible problems with such an approach. Years later, once we had developed computer programs to score the DIT, we joked with Kohlberg about doing morality research "untouched by human hands'1—the very thought of which he also found preposterously amusing. For over 20 years, DIT researchers have relied on the P score to index moral judgment and for that long we have tried to find a better index. Not only did we aspire to find a

[1]  Mark L. Davison,et al.  Psychometric Properties of the Defining Issues Test , 1979 .

[2]  O. J. Dunn,et al.  Correlation Coefficients Measured on the Same Individuals , 1969 .

[3]  Mark L. Davison,et al.  The Reliability and Validity of Objective Indices of Moral Development , 1978 .

[4]  Dorothy Tate,et al.  On Ego Development , 1958 .

[5]  D. Baldwin,et al.  Moral reasoning in medicine , 1994 .

[6]  James R. Rest.  Development in Judging Moral Issues , 1979 .

[7]  Thomas E. Wren,et al.  Moral development and the social environment : studies in the philosophy and psychology of moral judgment and education , 1985 .

[8]  William Y. Penn,et al.  Teaching Ethics ‐A Direct Approach , 1990 .

[9]  Anne Colby,et al.  The measurement of moral judgment, Vol. 1: Theoretical foundations and research validation; Vol. 2: Standard issue scoring manual. , 1987 .

[10]  R. Rosenthal.  Parametric measures of effect size. , 1994 .

[11]  Mark L. Davison,et al.  On a metric, unidimensional unfolding model for attitudinal and developmental data , 1977 .

[12]  Darcia Narv ez,et al.  College Teaching and Student Moral Development Steven P.McNeel , 1994 .

[13]  Stephen J. Thoma,et al.  Designing and validating a measure of moral judgment: Stage preference and stage consistency approaches. , 1997 .

[14]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[15]  D. Deemer.  Moral Judgment and Life Experience. , 1989 .

[16]  Cheryl E. Sanders,et al.  Does the Defining Issues Test measure psychological phenomena distinct from verbal ability? An examination of Lykken's query. , 1995 .

[17]  Darcia Narvaez,et al.  Moral Development in the Professions: Psychology and Applied Ethics , 1994 .

[18]  Einar M. Rønquist,et al.  Foreword , 1999, Biological Psychiatry.

[19]  R. James,et al.  Judging the important issues in moral dilemmas: An objective measure of development. , 1974 .

[20]  James R. Rest.  Moral Development: Advances in Research and Theory , 1986 .

[21]  Anne Colby,et al.  The Measurement Of Moral Judgment , 1987 .

[22]  M J Bebeau,et al.  The impact of a dental ethics curriculum on moral reasoning. , 1994, Journal of dental education.