Applications of Multidimensional Diagnostic Scoring for Certification and Licensure Tests.

This paper discusses two topics related to diagnostic score reporting for credentialing examinations. The first deals with various ways to compute subscores for credentialing examinations. The second addresses some pertinent factors to consider when presenting diagnostic results. To illustrate these issues, a sample set of subscores is used. This set was derived from a certification test that provides pass/fail decisions on multiple sections. There are a number of ways to compute diagnostic subscores for competency areas; the paper discusses four approaches. A simulation study using these approaches shows the complexity of choosing a scoring model for multidimensional subscore reporting. The decision to use a given method to compute diagnostic scores should blend technical sophistication with operational needs. There is very little research literature on presenting scores, but there are a number of techniques from which to choose, including score tables, profile plots, and narrative text. Producing high quality score reports is feasible even for relatively small testing programs. (Contains 5 figures, 3 tables, and 22 references.) (SLD) Reproductions supplied by EDRS are the best that can be made from the original document. U.S. DEPARTMENT OF EDUCATION Office of Educational Research and Improvement /ED CATIONAL RESOURCES INFORMATION CENTER (ERIC) This document has been reproduced as received from the person or organization originating it. Minor changes have been made to improve reproduction quality. Points of view or opinions stated in this document do not necessarily represent official OERI position or policy. PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY