Education and sex differences in the mini-mental state examination: effects of differential item functioning.

Years of completed education is a powerful correlate of performance on mental status assessment. This analysis evaluates differences in cognitive performance attributable to level of education and sex. We analyzed Mini-Mental State Examination responses from a large community sample (Epidemiologic Catchment Area study, N = 8,556), using a structural equation analytic framework grounded in item response theory. Significant sex and education group differential item functioning (DIF) were detected. Those with low education were more likely to err on the first serial subtraction, spell world backwards, repeat phrase, write, name season, and copy design tasks. Women were more likely to err on all serial subtractions, men on spelling and other language tasks. The magnitude of detected DIF was small. Our analyses show that failing to account for DIF results in an approximately 1.6% overestimation of the magnitude of difference in assessed cognition between high- and low-education groups. In contrast, nearly all (95%) of apparent sex differences underlying cognitive impairment are due to DIF. Therefore, item bias does not appear to be a major source of observed differences in cognitive status by educational attainment. Adjustments of total scores that eliminate education group differences are not supported by these results. Our results have implications for future research concerning education and risk for dementia.

[1]  M Orrell,et al.  Education and dementia , 1995, BMJ.

[2]  R. Gibbons,et al.  Application of modern psychometric theory in psychiatric research. , 1985, Journal of psychiatric research.

[3]  L. Robins,et al.  National Institute of Mental Health Diagnostic Interview Schedule. Its history, characteristics, and validity. , 1981, Archives of general psychiatry.

[4]  B. Muthén Latent variable modeling in heterogeneous populations , 1989 .

[5]  E G Tangalos,et al.  The Mini-Mental State Examination in general medical practice: clinical utility and acceptance. , 1996, Mayo Clinic proceedings.

[6]  G. Ratcliff,et al.  Effects of age, gender, and education on cognitive tests in a rural elderly community sample: norms from the Monongahela Valley Independent Elders Survey. , 1991, Neuroepidemiology.

[7]  F. Oort Using Restricted Factor Analysis in Test Construction. , 1992 .

[8]  Jan de Leeuw,et al.  On the relationship between item response theory and factor analysis of discretized variables , 1987 .

[9]  M. Roth,et al.  The Association Between Quantitative Measures of Dementia and of Senile Change in the Cerebral Grey Matter of Elderly Subjects , 1968, British Journal of Psychiatry.

[10]  Leigh Burstein,et al.  Instructionally Sensitive Psychometrics: Application of a New IRT‐Based Detection Technique to Mathematics Achievement Test Items , 1991 .

[11]  Steven J. Osterlind,et al.  Test item bias , 1983 .

[12]  R. Mallin,et al.  Recognition of Cognitive Impairment in Primary Care Outpatients , 1983, Southern medical journal.

[13]  P. Rabins,et al.  Sadness in older persons: 13-year follow-up of a community sample in Baltimore, Maryland , 1999, Psychological Medicine.

[14]  J. Teresi,et al.  Modern psychometric methods for detection of differential item functioning: application to cognitive assessment measures. , 2000, Statistics in medicine.

[15]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[16]  N. B. Davis,et al.  Gender and racial differences in mathematical performance. , 1999, The Journal of social psychology.

[17]  J. Teresi,et al.  Item bias in cognitive screening measures: comparisons of elderly white, Afro-American, Hispanic and high and low education subgroups. , 1995, Journal of clinical epidemiology.

[18]  D. O'Connor,et al.  The influence of education and social class on the diagnosis of dementia in a community population , 1991, Psychological Medicine.

[19]  M. Miller,et al.  Clinical psychiatry. , 1972, Progress in neurology and psychiatry.

[20]  J. Teresi,et al.  Development of indicator scales for the Comprehensive Assessment and Referral Evaluation (CARE) interview schedule. , 1984, Journal of gerontology.

[21]  B. Muthén,et al.  Age differences in the symptoms of depression: a latent trait analysis. , 1994, Journal of gerontology.

[22]  Howard Wainer,et al.  Detection of differential item functioning using the parameters of item response models. , 1993 .

[23]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[24]  R. Katzman.,et al.  Education and the prevalence of dementia and Alzheimer's disease , 1993, Neurology.

[25]  L. Kirisci,et al.  Fitting a two-parameter logistic item response model to clarify the psychometric properties of the Drug Use Screening Inventory for adolescent alcohol and drug abusers. , 1994, Alcoholism, clinical and experimental research.

[26]  R. Baker,et al.  Sensory impairments and subjective well-being among aged African American persons. , 2001, The journals of gerontology. Series B, Psychological sciences and social sciences.

[27]  M. Folstein,et al.  Limits of the ‘Mini-Mental State’ as a screening test for dementia and delirium among hospital patients , 1982, Psychological Medicine.

[28]  F. Lord A theory of test scores. , 1952 .

[29]  R. Kessler,et al.  Measuring the effects of medical interventions. , 1995, Medical care.

[30]  M. Robert,et al.  Perception and representation of the Euclidean coordinates in mature and elderly men and women. , 1990, Experimental aging research.

[31]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[32]  E. Kaplan,et al.  Methodological issues in screening for dementia: the problem of education adjustment. , 1986, Journal of chronic diseases.

[33]  J. Escobar,et al.  Use of the Mini-Mental State Examination (MMSE) in a Community Population of Mixed Ethnicity: Cultural and Linguistic Artifacts , 1986, The Journal of nervous and mental disease.

[34]  R. Green,et al.  An analysis of test bias and differential item functioning due to race on the Mattis Dementia Rating Scale. , 1998, The journals of gerontology. Series B, Psychological sciences and social sciences.

[35]  M. Folstein,et al.  Population-based norms for the Mini-Mental State Examination by age and educational level. , 1993, JAMA.

[36]  M. Albert,et al.  Level of education and change in cognitive function in a community population of older persons. , 1993, Annals of epidemiology.

[37]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[38]  H. Kraemer,et al.  Adjusting Mini-Mental State Examination Scores for Age and Educational Level to Screen for Dementia: Correcting Bias or Reducing Validity? , 1998, International Psychogeriatrics.

[39]  R. Murden,et al.  Mini‐Mental State Exam Scores Vary with Education in Blacks and Whites , 1991, Journal of the American Geriatrics Society.

[40]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[41]  Nambury S. Raju,et al.  The area between two item characteristic curves , 1988 .

[42]  C. Granger,et al.  The structure and stability of the Functional Independence Measure. , 1994, Archives of physical medicine and rehabilitation.

[43]  M. Laakso,et al.  Population-Based Dementia Screening Program in Kuopio: The Effect of Education, Age, and Sex on Brief Neuropsychological Tests , 1992, Journal of geriatric psychiatry and neurology.

[44]  J. Guilford,et al.  The nature of human intelligence. , 1968 .

[45]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[46]  E. Pfeiffer A Short Portable Mental Status Questionnaire for the Assessment of Organic Brain Deficit in Elderly Patients † , 1975, Journal of the American Geriatrics Society.

[47]  J. Teresi,et al.  Detection of Dementia and Depression Cases with the Comprehensive Assessment and Referral Evaluation Interview Schedule , 1983, International journal of aging & human development.

[48]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[49]  M. Zimmerman Epidemiologic Field Methods in Psychiatry: The NIMH Epidemiologic Catchment Area Program , 1987 .

[50]  Anthony F Jorm,et al.  Educational level differences on the Mini-Mental State: the role of test bias , 1988, Psychological Medicine.

[51]  G. Ratcliff,et al.  Effect of education and gender adjustment on the sensitivity and specificity of a cognitive screening battery for dementia: results from the MoVIES Project. Monongahela Valley Independent Elders Survey. , 1996, Neuroepidemiology.

[52]  M. Folstein,et al.  Cognitive impairment and functional disability in the absence of psychiatric diagnosis , 1991, Psychological Medicine.

[53]  A. Goldberger,et al.  Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable , 1975 .

[54]  R. Kahn,et al.  Brief objective measures for the determination of mental status in the aged. , 1960, The American journal of psychiatry.

[55]  C. McHorney,et al.  Evaluation of the MOS SF-36 Physical Functioning Scale (PF-10): II. Comparison of relative precision using Likert and Rasch scoring methods. , 1997, Journal of clinical epidemiology.

[56]  A. Berthoz,et al.  Sex, Lies And Virtual Reality , 1998, Nature Neuroscience.

[57]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[58]  T. Erkinjuntti,et al.  Correction for age, education and other demographic variables in the use of the Mini Mental State Examination in Finland , 1992, Acta neurologica Scandinavica.

[59]  B. Reed,et al.  Age and education correction of Mini-Mental State Examination for English- and Spanish-speaking elderly , 1996, Neurology.

[60]  W. H. Angoff,et al.  Perspectives on differential item functioning methodology. , 1993 .

[61]  B. Muthén Contributions to factor analysis of dichotomous variables , 1978 .

[62]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[63]  R B D'Agostino,et al.  The effect of education on the incidence of dementia and Alzheimer's disease in the Framingham Study , 1995, Neurology.

[64]  D P Salmon,et al.  Effects of Age, Gender and Education on Selected Neuropsychological Tests in an Elderly Community Cohort , 1993, Journal of the American Geriatrics Society.

[65]  Bengt Muthen,et al.  Some uses of structural equation modeling in validity studies: Extending IRT to external variables , 1986 .

[66]  Richard N. Jones,et al.  Education Bias in the Mini-Mental State Examination , 2001, International Psychogeriatrics.

[67]  C. Brayne,et al.  The association of education and socioeconomic status with the Mini Mental State Examination and the clinical diagnosis of dementia in elderly people. , 1990, Age and ageing.

[68]  B B Reiss,et al.  The influence of education, social class and sex on Mini-Mental State scores , 1989, Psychological Medicine.

[69]  Bengt Muthén,et al.  Multiple Group IRT Modeling: Applications to Item Bias Analysis , 1985 .

[70]  L. Shepard,et al.  Methods for Identifying Biased Test Items , 1994 .

[71]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[72]  H. Wainer,et al.  Differential Item Functioning. , 1994 .

[73]  D. Blazer,et al.  The NIMH Epidemiologic Catchment Area program. Historical context, major objectives, and study population characteristics. , 1984, Archives of general psychiatry.

[74]  J. Mortimer,et al.  Education and other socioeconomic determinants of dementia and Alzheimer's disease , 1993 .

[75]  K. Boone,et al.  Wisconsin Card Sorting Test performance in healthy, older adults: relationship to age, sex, education, and IQ. , 1993, Journal of clinical psychology.

[76]  Louise Ryan,et al.  Latent Variable Models for Teratogenesis Using Multiple Binary Outcomes , 1997 .

[77]  E. Líndal,et al.  Mini-Mental State Examination Scores: Gender and Lifetime Psychiatric Disorders , 1993, Psychological reports.

[78]  L. George,et al.  Relationship of health and demographic characteristics to Mini-Mental State Examination score among community residents , 1988, Psychological Medicine.

[79]  J. Flynn Massive IQ gains in 14 nations: What IQ tests really measure. , 1987 .

[80]  Richard N. Jones,et al.  Dimensions of the Mini-Mental State Examination among community dwelling older adults , 2000, Psychological Medicine.

[81]  R. Linn Educational measurement, 3rd ed. , 1989 .

[82]  D. Halpern Sex Differences in Cognitive Abilities , 1986 .

[83]  J. Gallo,et al.  Symptom profiles of depression among general medical service users compared with speciality mental health service users , 1997, Psychological Medicine.

[84]  B. Reed,et al.  Differential item functioning in the Mini-Mental State Examination in English- and Spanish-speaking older adults. , 1997, Psychology and aging.

[85]  S. Bassett,et al.  Predicting Performance on the Mini‐Mental State Examination , 1987, Journal of the American Geriatrics Society.

[86]  F. Vitaro,et al.  La Prédiction Des Problèmes De Somatisation Chez Les Filles Pré-Pubertaires , 1994 .