Use of multidimensional item response theory methods for dementia prevalence prediction: an example using the Health and Retirement Survey and the Aging, Demographics, and Memory Study

Data sparsity is a major limitation to estimating national and global dementia burden. Surveys with full diagnostic evaluations of dementia prevalence are prohibitively resource-intensive in many settings. However, validation samples from nationally representative surveys allow for the development of algorithms for the prediction of dementia prevalence nationally. Using cognitive testing data and data on functional limitations from Wave A (2001–2003) of the ADAMS study (n = 744) and the 2000 wave of the HRS study (n = 6358) we estimated a two-dimensional item response theory model to calculate cognition and function scores for all individuals over 70. Based on diagnostic information from the formal clinical adjudication in ADAMS, we fit a logistic regression model for the classification of dementia status using cognition and function scores and applied this algorithm to the full HRS sample to calculate dementia prevalence by age and sex. Our algorithm had a cross-validated predictive accuracy of 88% (86–90), and an area under the curve of 0.97 (0.97–0.98) in ADAMS. Prevalence was higher in females than males and increased over age, with a prevalence of 4% (3–4) in individuals 70–79, 11% (9–12) in individuals 80–89 years old, and 28% (22–35) in those 90 and older. Our model had similar or better accuracy as compared to previously reviewed algorithms for the prediction of dementia prevalence in HRS, while utilizing more flexible methods. These methods could be more easily generalized and utilized to estimate dementia prevalence in other national surveys.

Mohammad Ali Moni | Atanu Biswas | Nicolas Cherbuin | Mika Shigematsu | Ali Bijani | Ritesh G. Menezes | Savita Lasrado | Deepika Singhal | Atif Amin Baig | Perminder S. Sachdev | Azeem Majeed | Hermann Brenner | Mohammad Hamiduzzaman | Michael R. Phillips | Hung Chak Ho | Simon I. Hay | Gholamreza Roshandel | Amir Abdoli | Abdel Douiri | Pietro Ferrara | Diego Augusto Santos Silva | Juwel Rana | Vladimir Hachinski | Mika Kivimäki | Krittika Bhattacharyya | Mohammad Ali Sahraian | Preeti Malik | Farshad Farzadfar | Nima Rezaei | Ali H. Mokdad | Ester Cerin | Rahman Shiri | Narayanaswamy Venketasubramanian | Mowafa Househ | Dinh-Toi Chu | André Karch | Masao Iwagami | Sergio I. Prada | Graeme J. Hankey | Kenji Shibuya | Giang Thu Vu | Fakher Rahim | Vahid Alipour | Olayinka Stephen Ilesanmi | Ferrán Catalá-López | Man Mohan Mehndiratta | Amin Soheili | Licia Iacoviello | Feng Sha | Emma Nichols | Valery L. Feigin | Ali Yadollahpour | Bing-Fang Hwang | Shirin Djalalinia | Ronny Westerman | David Edvardsson | Manasi Kumar | Emma Foad Amir Ahmed Eman Ashkan Rufus Olusola Fahad Ma Nichols Abd-Allah Abdoli Abualhasan Abu-Ghar | Foad Abd-Allah | Ahmed Abualhasan | Eman Abu-Gharbieh | Ashkan Afshin | Rufus Olusola Akinyemi | Fahad Mashhour Alanezi | Amir Almasi-Hashiani | Jalal Arabloo | Amir Ashraf-Ganjouei | Getinet Ayano | Jose L. Ayuso-Mateos | Maciej Banach | Miguel A. Barboza | Suzanne Lyn Barker-Collo | Bernhard T. Baune | Akshaya Srikanth Bhagavathula | Archith Boloor | Carol Brayne | Katrin Burkart | Sharath Burugina Nagaraja | Felix Carvalho | Luis F. S. Castro-de-Araujo | Xiaochen Dai | Antonio Reis de Sá-Junior | Shaimaa I. El-Jaafary | Sharareh Eskandarieh | Andre Faro | Seyed-Mohammad Fereshtehnejad | Eduarda Fernandes | Irina Filip | Florian Fischer | Shilpa Gaidhane | Lucia Galluzzo | Gebreamlak Gebremedhn Gebremeskel | Ahmad Ghashghaee | Alessandro Gialluisi | Elena V. Gnedovskaya | Mahaveer Golechha | Rajeev Gupta | Mohammad Rifat Haider | Teklehaimanot Gereziher Haile | Golnaz Heidari | Reza Heidari-Soureshjani | Irena M. Ilic | Milena D. Ilic | Seyed Sina Naghibi Irvani | Ihoghosa Osamuyi Iyamu | Ravi Prakash Jha | Rizwan Kalani | Ayele Semachew Kasa | Yousef Saleh Khader | Ejaz Ahmad Khan | Mahalaqua Nazli Khatib | Yun Jin Kim | Sezer Kisa | Adnan Kisa | Ai Koyanagi | Iván Landires | Bingyu Li | Stephen S. Lim | Xuefeng Liu | Shilpashree Madhava Kunjathur | Yousef Mohammad | Salahuddin Mohammed | Gabriele Nagel | Muhammad Naveed | Vinod C. Nayak | Cuong Tat Nguyen | Huong Lan Thi Nguyen | Virginia Nunez-Samudio | Andrew T. Olagunju | Samuel M. Ostroff | Nikita Otstavnov | Mayowa O. Owolabi | Fatemeh Pashazadeh Kan | Urvish K. Patel | Michael A. Piradov | Constance Dimity Pond | Faheem Hyder Pottoo | Amir Radfar | Vahid Rashedi | Salman Rawaf | David Laith Rawaf | Nickolas Reinig | Andre M. N. Renzaho | Aziz Rezapour | Michele Romoli | Amirhossein Sahebkar | Mehrnoosh Samaei | Mete Saylan | Masood Ali Shaikh | Jae Il Shin | Jasvinder A. Singh | Valentin Yurievich Skryabin | Anna Aleksandrovna Skryabina | Houman Sotoudeh | Emma Elizabeth Spurlock | Cassandra E. I. Szoeke | Rafael Tabarés-Seisdedos | Biruk Wogayehu Taddele | Marcos Roberto Tovani-Palone | Gebiyaw Wudie Tsegaye | Marco Vacante | Simone Vidale | Vasily Vlassov | Yuan-Pang Wang | Jordan Weiss | Abrha Hailay Weldemariam | Anders Wimo | Andrea Sylvia Winkler | Chenkai Wu | Metin Yesiltepe | Naohiro Yonemoto | Chuanhua Yu | Mikhail Sergeevich Zastrozhin | Anasthasia Zastrozhina | Zhi-Jiang Zhang | Christopher J. L. Murray | Theo Vos | Fatemeh Pashazadeh Kan | V. Feigin | T. Vos | A. Biswas | J. Ayuso-Mateos | S. Hay | H. Brenner | G. Hankey | H. Ho | C. Brayne | P. Sachdev | F. Abd-Allah | R. Akinyemi | M. Kivimäki | J. Arabloo | Maciej Banach | M. Barboza | S. Barker-Collo | Ali Bijani | F. Carvalho | F. Catalá-López | E. Cerin | Shirin Djalalinia | D. Edvardsson | S. Eskandarieh | F. Farzadfar | S. Fereshtehnejad | E. Fernandes | I. Filip | F. Fischer | E. Gnedovskaya | V. Hachinski | S. Irvani | Rizwan Kalani | A. Karch | Y. Khader | E. Khan | Y. Kim | A. Kisa | A. Koyanagi | A. Majeed | A. Mokdad | G. Nagel | E. Nichols | A. Olagunju | M. Owolabi | M. Phillips | M. Piradov | A. Radfar | F. Rahim | D. Rawaf | S. Rawaf | G. Roshandel | A. Sahebkar | M. Sahraian | M. Shaikh | K. Shibuya | M. Shigematsu | R. Shiri | D. Silva | C. Szoeke | R. Tabarés-Seisdedos | M. Tovani-Palone | N. Venketasubramanian | V. Vlassov | Yuan-Pang Wang | R. Westerman | A. Winkler | N. Yonemoto | Chuanhua Yu | B. Baune | C. Nguyen | A. Wimo | N. Cherbuin | G. Vu | L. Iacoviello | M. Mehndiratta | C. Pond | Krittika Bhattacharyya | D. Chu | Y. Mohammad | A. Renzaho | A. Yadollahpour | A. Douiri | N. Rezaei | I. Ilic | M. Ilic | M. Zastrozhin | A. Almasi-Hashiani | F. Pottoo | K. Burkart | J. Weiss | A. Baig | B. Hwang | M. Moni | L. Galluzzo | H. Sotoudeh | V. Alipour | A. Ashraf-Ganjouei | M. Househ | P. Malik | A. Bhagavathula | Xiaochen Dai | S. Ostroff | E. Spurlock | Chenkai Wu | Nickolas Reinig | R. Menezes | M. Vacante | Deepika Singhal | A. Abdoli | S. Nagaraja | M. Iwagami | M. Golechha | A. Gialluisi | A. Rezapour | M. R. Haider | M. Romoli | S. Prada | A. Soheili | M. Khatib | S. Vidale | V. Skryabin | J. Rana | F. Sha | Bingyu Li | G. G. Gebremeskel | A. Ghashghaee | S. Kisa | G. Ayano | A. Boloor | P. Ferrara | T. Haile | G. Heidari | R. Heidari-soureshjani | I. Landires | Savita Lasrado | Xuefeng Liu | V. Núñez-Samudio | Nikita Otstavnov | Eman Abu-Gharbieh | L. F. Castro-de-Araujo | Ahmed Abualhasan | S. El-Jaafary | I. Iyamu | Zhi-Jiang Zhang | M. Hamiduzzaman | Salahuddin Mohammed | S. Gaidhane | Mehrnoosh Samaei | A. Skryabina | G. W. Tsegaye | A. H. Weldemariam | Anasthasia Zastrozhina | M. Naveed | C. Murray | A. Sá-Junior | O S Ilesanmi | Metin Yesiltepe | Andre Faro | Manasi Kumar | Jasvinder A. Singh | Mete Saylan | A. Afshin | Vahid Rashedi | J. Shin | Shilpashree Madhava Kunjathur | Rajeev Gupta | Thi Lan Huong Nguyen | U. Patel | J. Shin | Juwel Rana | Shilpa Gaidhane | C. Nguyen | X. Dai | Luis F. S. Castro-de-Araujo | Amir Abdoli | Mahaveer Golechha

[1]  K. Langa,et al.  The Aging, Demographics, and Memory Study: Study Design and Methods , 2005, Neuroepidemiology.

[2]  A. Dey,et al.  LASI-DAD study: a protocol for a prospective cohort study of late-life cognition and dementia in India , 2019, BMJ Open.

[3]  Publisher's Note , 2018, Anaesthesia.

[4]  R. D'Agostino,et al.  Prevalence of dementia and probable senile dementia of the Alzheimer type in the Framingham Study , 1992, Neurology.

[5]  R. Wallace,et al.  Measures of cognitive functioning in the AHEAD Study. , 1997, The journals of gerontology. Series B, Psychological sciences and social sciences.

[6]  R. Mohs,et al.  Consortium to establish a registry for Alzheimer's disease (CERAD) clinical and neuropsychological assessment of Alzheimer's disease. , 2002, Psychopharmacology bulletin.

[7]  Thomas J. Dunn,et al.  From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. , 2014, British journal of psychology.

[8]  Robert A. Bornstein,et al.  The Wechsler Memory Scale—Revised , 1990 .

[9]  Eun Sug Park,et al.  Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019 , 2020, Lancet.

[10]  Amanda Sonnega,et al.  Cohort Profile: the Health and Retirement Study (HRS). , 2014, International journal of epidemiology.

[11]  Anthony F Jorm A short form of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): development and cross-validation , 1994, Psychological Medicine.

[12]  Dan J Stein,et al.  Global, regional, and national burden of Alzheimer's disease and other dementias, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016 , 2019, The Lancet Neurology.

[13]  A. Gross,et al.  Differential item functioning in the cognitive screener used in the Longitudinal Aging Study in India , 2019, International Psychogeriatrics.

[14]  E. T. Tchetgen Tchetgen,et al.  Combining Direct and Proxy Assessments to Reduce Attrition Bias in a Longitudinal Study , 2013, Alzheimer disease and associated disorders.

[15]  M. Reckase The Past and Future of Multidimensional Item Response Theory , 1997 .

[16]  J. Rabe-Jabłońska,et al.  [Affective disorders in the fourth edition of the classification of mental disorders prepared by the American Psychiatric Association -- diagnostic and statistical manual of mental disorders]. , 1993, Psychiatria polska.

[17]  J. Morris,et al.  The Consortium to Establish a Registry for Alzheimer's Disease (CERAD). Part I. Clinical and neuropsychological assesment of Alzheimer's disease , 1989, Neurology.

[18]  Kristopher J Preacher,et al.  A researcher's guide to regression, discretization, and median splits of continuous variables , 2015 .

[19]  T. Vos,et al.  Global, regional, and national incidence and prevalence, and years lived with disability for 328 diseases and injuries in 195 countries, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016 , 2017 .

[20]  M. Power,et al.  Development of algorithmic dementia ascertainment for racial/ethnic disparities research in the U.S. Health and Retirement Study. , 2019, Epidemiology.

[21]  How do self and proxy dependency evaluations agree? Results from a large cohort of older women , 2018, Age and ageing.

[22]  D. Koller,et al.  Dementia in the USA: state variation in prevalence. , 2014, Journal of public health.

[23]  F. Samejima Graded Response Model , 1997 .

[24]  K. Langa,et al.  Prevalence of Dementia in the United States: The Aging, Demographics, and Memory Study , 2007, Neuroepidemiology.

[25]  Linda L. Cook,et al.  Using item response theory in test score equating , 1989 .

[26]  Haniye Sadat Sajadi,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017 , 2018, The Lancet.

[27]  R. Brennan,et al.  Test Equating, Scaling, and Linking: Methods and Practices , 2004 .

[28]  M. Glymour,et al.  Comparison of Methods for Algorithmic Classification of Dementia Status in the Health and Retirement Study , 2019, Epidemiology.

[29]  M. Albert,et al.  Mild cognitive impairment and dementia prevalence: The Atherosclerosis Risk in Communities Neurocognitive Study , 2016, Alzheimer's & dementia.

[30]  R. Reitan Validity of the Trail Making Test as an Indicator of Organic Brain Damage , 1958 .

[31]  Marshal F. Folstein,et al.  The telephone interview for cognitive status , 1988 .

[32]  Bengt Muthén,et al.  On structural equation modeling with data that are not missing completely at random , 1987 .

[33]  S. Katz,et al.  STUDIES OF ILLNESS IN THE AGED. THE INDEX OF ADL: A STANDARDIZED MEASURE OF BIOLOGICAL AND PSYCHOSOCIAL FUNCTION. , 1963, JAMA.

[34]  De Ayala,et al.  The Theory and Practice of Item Response Theory , 2008 .

[35]  K. Langa,et al.  Assessment of cognition using surveys and neuropsychological assessment: the Health and Retirement Study and the Aging, Demographics, and Memory Study. , 2011, The journals of gerontology. Series B, Psychological sciences and social sciences.

[36]  Herbert Hoijtink,et al.  The Best of Both Worlds: Factor Analysis of Dichotomous Data Using Item Response Theory and Structural Equation Modeling , 2003 .

[37]  M. Prince,et al.  World Alzheimer Report 2015 - The Global Impact of Dementia: An analysis of prevalence, incidence, cost and trends , 2015 .

[38]  Paco Martorell,et al.  Monetary costs of dementia in the United States. , 2013, The New England journal of medicine.

[39]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[40]  Alzheimer’s Association 2010 Alzheimer's disease facts and figures , 2010, Alzheimer's & Dementia.

[41]  M. Lawton,et al.  Assessment of Older People: Self-Maintaining and Instrumental Activities of Daily Living , 1969 .

[42]  R. Philip Chalmers,et al.  mirt: A Multidimensional Item Response Theory Package for the R Environment , 2012 .

[43]  F. Wolinsky,et al.  A pilot study among older adults of the concordance between their self-reports to a health survey and spousal proxy reports on their behalf , 2016, BMC Health Services Research.

[44]  Thomas R. Boucher,et al.  Test Equating, Scaling, and Linking: Methods and Practices , 2007 .

[45]  Gerald van Belle,et al.  Test bias in a cognitive test: differential item functioning in the CASI , 2004, Statistics in medicine.

[46]  D. Canning,et al.  Cohort Profile: Health and Ageing in Africa: a Longitudinal Study of an INDEPTH Community in South Africa (HAALSI). , 2018, International journal of epidemiology.

[47]  Richard N. Jones Identification of Measurement Differences Between English and Spanish Language Versions of the Mini-Mental State Examination: Detecting Differential Item Functioning Using MIMIC Modeling , 2006, Medical care.