Modern Psychometric Methodology

Item response theory (IRT) methodology is introduced as a tool for improving assessment instruments used with people who have disabilities. Need for this approach in rehabilitation is emphasized; differences between IRT and classical test theory are clarified. Concepts essential to understanding IRT are defined, necessary data assumptions are identified, and specific data analysis techniques, using software such as TESTFACT and BILOG, are described. An example of IRT analysis applied to a subtest of the General Aptitude Test Battery (GATB) administered to people who have diverse disabilities is provided. Future potential uses of this approach in rehabilitation are outlined.

[1]  J. Ware,et al.  Practical implications of item response theory and computerized adaptive testing: a brief summary of ongoing studies of widely used headache impact scales. , 2000, Medical care.

[2]  James O. Ramsay,et al.  Progress in the technology of measurement: Applications of item response models. , 1998 .

[3]  M. Reckase.  Unifactor Latent Trait Models Applied to Multifactor Tests: Results and Implications , 1979 .

[4]  J. Hartigan,et al.  Fairness in Employment Testing: Validity Generalization, Minority Issues, and the General Aptitude Test Battery , 1989 .

[5]  R. Fitzpatrick,et al.  Deriving summary indices of health status from the Amyotrophic Lateral Sclerosis Assessment Questionnaires (ALSAQ-40 and ALSAQ-5) , 2003, Journal of neurology, neurosurgery, and psychiatry.

[6]  D. Cella,et al.  Response to Hays et al and McHorney and Cohen: A Discussion of Item Response Theory and Its Applications in Health Status Assessment , 2000, Medical care.

[7]  William Stout,et al.  A nonparametric approach for assessing latent trait unidimensionality , 1987 .

[8]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[9]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[10]  R. Hambleton.  Principles and selected applications of item response theory. , 1989 .

[11]  Mark D. Reckase,et al.  Item Response Theory: Parameter Estimation Techniques , 1998 .

[12]  Lewis R. Aiken,et al.  Psychological testing and assessment, 9th ed. , 1994 .

[13]  David Cella,et al.  Health outcomes assessment in vulnerable populations: measurement challenges and recommendations. , 2003, Archives of physical medicine and rehabilitation.

[14]  M. Bullis,et al.  NATIONAL FIELD TESTING OF THE “MINI” VERSION OF THE TRANSITION COMPETENCE BATTERY FOR ADOLESCENTS AND YOUNG ADULTS WHO ARE DEAF , 1997 .

[15]  P. Fayers.  Item Response Theory for Psychologists , 2004, Quality of Life Research.

[16]  R. Fitzpatrick,et al.  Can item response theory reduce patient burden when measuring health status in neurological disorders? Results from Rasch analysis of the SF-36 physical functioning scale (PF-10) , 2001, Journal of neurology, neurosurgery, and psychiatry.

[17]  L. Aiken.  Psychological testing and assessment , 1976 .

[18]  James O. Ramsay,et al.  Nonparametric Item Analyses of the Beck Depression Inventory: Evaluating Gender Item Bias and Response Option Weights , 1994 .

[19]  John Cotton,et al.  Handbook of measurement and evaluation in rehabilitation. , 1978 .

[20]  Robert J. Mislevy,et al.  BILOG 3 : item analysis and test scoring with binary logistic models , 1990 .

[21]  M. Abrahamowicz,et al.  The Quebec Back Pain Disability Scale: conceptualization and development. , 1996, Journal of clinical epidemiology.

[22]  S. J. Sinclair,et al.  Activity Outcome Measurement for Postacute Care , 2004, Medical care.

[23]  R. Hays,et al.  Identifying a short functional disability screen for older persons. , 2000, The journals of gerontology. Series A, Biological sciences and medical sciences.

[24]  Nambury S. Raju,et al.  Determining the Significance of Estimated Signed and Unsigned Areas Between Two Item Response Functions , 1990 .

[25]  C. McHorney,et al.  Equating Health Status Measures With Item Response Theory: Illustrations With Functional Status Items , 2000, Medical care.

[26]  R. J. Mokken,et al.  Handbook of modern item response theory , 1997 .

[27]  O. K. Buros,et al.  The seventh mental measurements yearbook , 1973 .

[28]  T. Gumpel,et al.  Application of a Rasch analysis to the examination of the perception of facial affect among persons with mental retardation. , 1996, Research in developmental disabilities.

[29]  D. Borsboom,et al.  The Theoretical Status of Latent Variables , 2003 .

[30]  Fritz Drasgow,et al.  Item response theory : application to psychological measurement , 1983 .

[31]  F. Baker.  The basics of item response theory , 1985 .

[32]  P. Fayers,et al.  Quality of Life: Assessment, Analysis, and Interpretation , 2000 .

[33]  D. Currier,et al.  Handbook of Measurement and Evaluation in Rehabilitation , 1978 .

[34]  B. Reed,et al.  Application of item response theory for development of a global functioning measure of dementia with linear measurement properties. , 2000, Statistics in medicine.

[35]  RON D. HAYS,et al.  Item Response Theory and Health Outcomes Measurement in the 21st Century , 2000, Medical care.

[36]  C. McHorney.  Use of item response theory to link 3 modules of functional status items from the Asset and Health Dynamics Among the Oldest Old study. , 2002, Archives of physical medicine and rehabilitation.

[37]  Shelby J. Haberman,et al.  Log-Linear Models and Frequency Tables with Small Expected Cell Counts , 1977 .

[38]  A. Jette,et al.  Short-form activity measure for post-acute care. , 2004, Archives of physical medicine and rehabilitation.

[39]  Delicate balance between theory and practice: health status assessment and item response theory. , 2003, Medical care.

[40]  The Washington Psychosocial Seizure Inventory (WPSI): psychometric evaluation and future applications , 2003, Seizure.

[41]  R. Linn.  Educational measurement, 3rd ed. , 1989 .