Remote Ecological Momentary Testing of Learning and Memory in Adults With Serious Mental Illness.

Smartphone-based ecological mobile cognitive tests (EMCTs) can measure cognitive abilities in the real world, complementing traditional neuropsychological assessments. We evaluated the validity of an EMCT of recognition memory designed for use with people with serious mental illness, as well as relevant contextual influences on performance. Participants with schizophrenia (SZ), schizoaffective disorder, and bipolar disorder (BD) completed in-lab assessments of memory (Hopkins Verbal Learning Test, HVLT), other cognitive abilities, functional capacity, and symptoms, followed by 30 days of EMCTs during which they completed our Mobile Variable Difficulty List Memory Test (VLMT) once every other day (3 trials per session). List length on the VLMT altered between 6, 12, and 18 items. On average, participants completed 75.3% of EMCTs. Overall performance on VLMT 12 and 18 items was positively correlated with HVLT (ρ = 0.52, P < .001). People with BD performed better on the VLMT than people with SZ. Intraindividual variability on the VLMT was more specifically associated with HVLT than nonmemory tests and not associated with symptoms. Performance during experienced distraction, low effort, and out of the home location was reduced yet still correlated with the in-lab HVLT. The VLMT converged with in-lab memory assessment, demonstrating variability within person and by different contexts. Ambulatory cognitive testing on participants' personal mobile devices offers more a cost-effective and "ecologically valid" measurement of real-world cognitive performance.

[1]  J. Torous,et al.  Cognition in Context: Understanding the Everyday Predictors of Cognitive Performance in a New Era of Measurement , 2020, JMIR mHealth and uHealth.

[2]  D. Öngür,et al.  Verbal memory measurement towards digital perspectives in first-episode psychosis: A review , 2020, Schizophrenia Research: Cognition.

[3]  M. Keshavan,et al.  COVID-19, mobile health and serious mental illness , 2020, Schizophrenia Research.

[4]  Terje B. Holmlund,et al.  Applying speech technologies to assess verbal memory in patients with serious mental illness , 2020, npj Digital Medicine.

[5]  Iracema Leroi,et al.  Tools for App- and Web-Based Self-Testing of Cognitive Impairment: Systematic Search and Evaluation , 2019, Journal of medical Internet research.

[6]  Bon Mi Koo,et al.  Mobile Technology for Cognitive Assessment of Older Adults: A Scoping Review , 2019, Innovation in aging.

[7]  K. Zakzanis,et al.  Memory impairment and the mediating role of task difficulty in patients with schizophrenia , 2017, Psychiatry and clinical neurosciences.

[8]  H. Amièva,et al.  Feasibility and validity of mobile cognitive testing in the investigation of age‐related cognitive decline , 2017, International journal of methods in psychiatric research.

[9]  Leo Galway,et al.  Validation of a Smartphone-Based Approach to In Situ Cognitive Fatigue Assessment , 2017, JMIR mHealth and uHealth.

[10]  Raeanne C Moore,et al.  Applications for self‐administered mobile cognitive assessments in clinical research: A systematic review , 2017, International journal of methods in psychiatric research.

[11]  Ralph H. B. Benedict,et al.  Hopkins Verbal Learning Test--Revised , 2013 .

[12]  Philip D. Harvey,et al.  Meta‐analysis of the association between cognitive abilities and everyday functioning in bipolar disorder , 2012, Bipolar disorders.

[13]  Marc Brysbaert,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009, Behavior research methods.

[14]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. , 2008, The American journal of psychiatry.

[15]  F. Dickerson,et al.  Neuropsychological Functioning in Bipolar Disorder and Schizophrenia , 2007, Biological Psychiatry.

[16]  Philip D. Harvey,et al.  Cognitive deficits and functional outcome in schizophrenia , 2006, Neuropsychiatric disease and treatment.

[17]  B. Mausbach,et al.  Development of a brief scale of everyday functioning in persons with serious mental illness. , 2006, Schizophrenia bulletin.

[18]  Lisa Cipolotti,et al.  Bipolar I and bipolar II disorder: cognition and emotion processing , 2006, Psychological Medicine.

[19]  Philip D. Harvey,et al.  The Brief Assessment of Cognition in Schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery , 2004, Schizophrenia Research.

[20]  T. Tombaugh Trail Making Test A and B: normative data stratified by age and education. , 2004, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[21]  Eduard Vieta,et al.  Cognitive function across manic or hypomanic, depressed, and euthymic states in bipolar disorder. , 2004, The American journal of psychiatry.

[22]  U. Bayen,et al.  Source monitoring deficits in patients with schizophrenia; a multinomial modelling analysis , 1999, Psychological Medicine.

[23]  T. Goldberg,et al.  Auditory working memory and Wisconsin Card Sorting Test performance in schizophrenia. , 1997, Archives of general psychiatry.

[24]  M. Åsberg,et al.  A New Depression Scale Designed to be Sensitive to Change , 1979, British Journal of Psychiatry.

[25]  R. C. Young,et al.  A Rating Scale for Mania: Reliability, Validity and Sensitivity , 1978, British Journal of Psychiatry.

[26]  D. Sheehan,et al.  The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. , 1998, The Journal of clinical psychiatry.

[27]  T. Goldberg,et al.  Forms of memory failure in schizophrenia. , 1992 .

[28]  Philip D. Harvey,et al.  Cognitive deficits and thought disorder: II. An 8-month followup study. , 1990, Schizophrenia bulletin.

[29]  S. Kay,et al.  The positive and negative syndrome scale (PANSS) for schizophrenia. , 1987, Schizophrenia bulletin.