Psychometric properties of the Penn Computerized Neurocognitive Battery.

OBJECTIVE The Penn Computerized Neurocognitive Battery (CNB) was designed to measure performance accuracy and speed on specific neurobehavioral domains using tests that were previously validated with functional neuroimaging. The goal of the present study was to evaluate the neuropsychological theory used to construct the CNB by confirming the factor structure of the tests composing it. METHOD In a large community sample (N = 9,138; age range 8-21), we performed a correlated-traits confirmatory factor analysis (CFA) and multiple exploratory factor analyses (EFAs) on the 12 CNB measures of Efficiency (which combine Accuracy and Speed). We then performed EFAs of the Accuracy and Speed measures separately. Finally, we performed a confirmatory bifactor analysis of the Efficiency scores. All analyses were performed with Mplus using maximum likelihood estimation. RESULTS RESULTS strongly support the a priori theory used to construct the CNB, showing that tests designed to measure executive, episodic memory, complex cognition, and social cognition aggregate their loadings within these domains. When Accuracy and Speed were analyzed separately, Accuracy produced 3 reliable factors: executive and complex cognition, episodic memory, and social cognition, while speed produced 2 factors: tests that require fast responses and those where each item requires deliberation. The statistical "Fit" of almost all models described above was acceptable (usually excellent). CONCLUSIONS Based on the analysis from these large-scale data, the CNB offers an effective means for measuring the integrity of intended neurocognitive domains in about 1 hour of testing and is thus suitable for large-scale clinical and genomic studies.

[1]  B. Meldrum,et al.  CEREBRAL METABOLIC CHANGES DURING PROLONGED EPILEPTIC SEIZURES IN RATS , 1977, Journal of neurochemistry.

[2]  S. Gosling,et al.  Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. , 2004, The American psychologist.

[3]  Thomas R. Insel,et al.  Endophenotypes: Bridging Genomic Complexity and Disorder Heterogeneity , 2009, Biological Psychiatry.

[4]  Raquel E Gur,et al.  Age group and sex differences in performance on a computerized neurocognitive battery in children age 8-21. , 2012, Neuropsychology.

[5]  Steen Moeller,et al.  The Human Connectome Project: A data acquisition perspective , 2012, NeuroImage.

[6]  Rick H. Hoyle,et al.  Determining the Number of Factors in Exploratory and Confirmatory Factor Analysis , 2004 .

[7]  S. Reise The Rediscovery of Bifactor Measurement Models , 2012 .

[8]  J. Horn A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[9]  Seung W. Choi,et al.  Firestar: Computerized Adaptive Testing Simulation Program for Polytomous Item Response Theory Models , 2009 .

[10]  Kosha Ruparel,et al.  The psychosis spectrum in a young U.S. community sample: findings from the Philadelphia Neurodevelopmental Cohort , 2014, World psychiatry : official journal of the World Psychiatric Association.

[11]  D. Sörbom Model modification , 1989 .

[12]  Mm. Liabre Standard Progressive Matrices , 1984 .

[13]  Paul M. Grant,et al.  Randomized trial to evaluate the efficacy of cognitive therapy for low-functioning patients with schizophrenia. , 2012, Archives of general psychiatry.

[14]  J. Raven,et al.  The Raven Progressive Matrices: A Review of National Norming Studies and Ethnic and Socioeconomic Variation Within the United States , 1989 .

[15]  Patrizio E. Tressoldi,et al.  Visual Selective Attention and Reading Efficiency are Related in Children , 1998, Cortex.

[16]  R. Gur,et al.  Neurobehavioral probes for physiologic neuroimaging studies. , 1992, Archives of general psychiatry.

[17]  B. Devlin,et al.  Project among African-Americans to explore risks for schizophrenia (PAARTNERS): Recruitment and assessment methods , 2006, Schizophrenia Research.

[18]  S. Gau,et al.  Visual memory as a potential cognitive endophenotype of attention deficit hyperactivity disorder , 2011, Psychological Medicine.

[19]  F. Plum,et al.  Cerebral energy metabolism during experimental status epilepticus. , 1975, Journal of neurochemistry.

[20]  David J. Weiss,et al.  APPLICATION OF COMPUTERIZED ADAPTIVE TESTING TO EDUCATIONAL PROBLEMS , 1984 .

[21]  B. Wexler,et al.  The Penn Conditional Exclusion Test (PCET): relationship to the Wisconsin Card Sorting Test and work function in patients with schizophrenia , 2004, Schizophrenia Research.

[22]  Trichur Raman Vidyasagar Neural underpinnings of dyslexia as a disorder of visuo‐spatial attention , 2004, Clinical & experimental optometry.

[23]  John Blangero,et al.  Neurocognitive endophenotypes in a multiplex multigenerational family study of schizophrenia. , 2007, The American journal of psychiatry.

[24]  Michael F. Green,et al.  Analysis of 94 candidate genes and 12 endophenotypes for schizophrenia from the Consortium on the Genetics of Schizophrenia. , 2011, The American journal of psychiatry.

[25]  J W Grice,et al.  Computing and Evaluating Factor Scores , 2004 .

[26]  Maria Chiara Passolunghi,et al.  Domain-specific and domain-general precursors of mathematical achievement: a longitudinal study from kindergarten to first grade. , 2012, The British journal of educational psychology.

[27]  S. Reise,et al.  Bifactor Models and Rotations: Exploring the Extent to Which Multidimensional Data Yield Univocal Scale Scores , 2010, Journal of personality assessment.

[28]  O B Paulson,et al.  Cerebral autoregulation. , 1984, Stroke.

[29]  R. Gur,et al.  White matter organization and neurocognitive performance variability in schizophrenia , 2013, Schizophrenia Research.

[30]  D. Borsboom Measuring the mind: Conceptual issues in contemporary psychometrics , 2005 .

[31]  Howse Dc Cerebral energy metabolism during experimental status epilepticus. , 1983 .

[32]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[33]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[34]  Donald A. Jackson,et al.  How many principal components? stopping rules for determining the number of non-trivial axes revisited , 2005, Comput. Stat. Data Anal..

[35]  K. Holzinger,et al.  The Bi-factor method , 1937 .

[36]  Michael F. Green,et al.  Initial heritability analyses of endophenotypic measures for schizophrenia: the consortium on the genetics of schizophrenia. , 2007, Archives of general psychiatry.

[37]  J. Raven The Raven's Progressive Matrices: Change and Stability over Culture and Time , 2000, Cognitive Psychology.

[38]  Raquel E Gur,et al.  Emotion-discrimination deficits in mild Alzheimer disease. , 2005, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[39]  Gregory G. Brown,et al.  Journal of Clinical and Experimental Neuropsychology Parallel Psychometric and Cognitive Modeling Analyses of the Penn Face Memory Test in the Army Study to Assess Risk and Resilience in Servicemembers , 2022 .

[40]  Juan Manuel Peralta,et al.  A genome screen for quantitative trait loci influencing schizophrenia and neurocognitive phenotypes. , 2008, The American journal of psychiatry.

[41]  A. Benton,et al.  Visuospatial judgment. A clinical test. , 1978, Archives of neurology.

[42]  Raquel E Gur,et al.  Flat affect in schizophrenia: relation to emotion processing and neurocognitive measures. , 2006, Schizophrenia bulletin.

[43]  S. West,et al.  A Comparison of Bifactor and Second-Order Models of Quality of Life , 2006, Multivariate behavioral research.

[44]  V. Bowden,et al.  The Journal of Neuropsychiatry and Clinical Neurosciences , 1992 .

[45]  Jr. William Rush Dunton,et al.  THE AMERICAN JOURNAL OF PSYCHIATRY , 1944 .

[46]  H. Hakonarson,et al.  Incidental Findings in Youths Volunteering for Brain MRI Research , 2013, American Journal of Neuroradiology.

[47]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[48]  R. Gur,et al.  A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: Standardization and initial construct validation , 2010, Journal of Neuroscience Methods.

[49]  R. Maddock,et al.  Impaired recognition of facial expressions of emotion in Alzheimer's disease. , 2002, The Journal of neuropsychiatry and clinical neurosciences.

[50]  R. Gur,et al.  Computerized Neurocognitive Scanning: I. Methodology and Validation in Healthy People , 2001, Neuropsychopharmacology.

[51]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .