Testing for a deficit in single-case studies: Effects of departures from normality

In neuropsychological single-case research inferences concerning a patient's cognitive status are often based on referring the patient's test score to those obtained from a modestly sized control sample. Two methods of testing for a deficit (z and a method proposed by Crawford and Howell [Crawford, J. R. & Howell, D. C. (1998). Comparing an individual's test score against norms derived from small samples. The Clinical Neuropsychologist, 12, 482-486]) both assume the control distribution is normal but this assumption will often be violated in practice. Monte Carlo simulation was employed to study the effects of leptokurtosis and the combination of skew and leptokurtosis on the Type I error rates for these two methods. For Crawford and Howell's method, leptokurtosis produced only a modest inflation of the Type I error rate when the control sample N was small-to-modest in size and error rates were lower than the specified rates at larger N. In contrast, the combination of leptokurtosis and skew produced marked inflation of error rates for small Ns. With a specified error rate of 5%, actual error rates as high as 14.31% and 9.96% were observed for z and Crawford and Howell's method respectively. Potential solutions to the problem of non-normal data are evaluated.

[1]  P. Garthwaite,et al.  Investigation of the single case in neuropsychology: confidence limits on the abnormality of test scores and test score differences , 2002, Neuropsychologia.

[2]  Max Coltheart,et al.  Cognitive Neuropsychology , 2014, Scholarpedia.

[3]  D. C. Howell,et al.  Comparing an Individual's Test Score Against Norms Derived from Small Samples , 1998 .

[4]  C. Temple,et al.  Executive skills in Klinefelter’s syndrome , 2003, Neuropsychologia.

[5]  Morris Moscovitch,et al.  The contribution of autobiographical significance to semantic memory: evidence from Alzheimer’s disease, semantic dementia, and amnesia , 2004, Neuropsychologia.

[6]  D. C. Howell.  Statistical methods for psychology, 3rd ed. , 1992 .

[7]  Paul H. Garthwaite,et al.  Wanted: Fully Operational Definitions of Dissociations in Single-Case Studies , 2003, Cortex.

[8]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[9]  A. Azzalini,et al.  The multivariate skew-normal distribution , 1996 .

[10]  U. Frith,et al.  The impact of extensive medial frontal lobe damage on 'Theory of Mind' and cognition. , 2004, Brain : a journal of neurology.

[11]  C. Burt.  Is Intelligence Distributed Normally , 1963 .

[12]  J. Winn,et al.  Brain , 1878, The Lancet.

[13]  A. Azzalini,et al.  Statistical applications of the multivariate skew normal distribution , 2009, 0911.2093.

[14]  A. Milner,et al.  Automatic avoidance of obstacles is a dorsal stream function: evidence from optic ataxia , 2004, Nature Neuroscience.

[15]  Morris Moscovitch,et al.  Visual imagery deficits, impaired strategic retrieval, or memory loss: disentangling the nature of an amnesic person’s autobiographical memory deficit , 2004, Neuropsychologia.

[16]  E. Renzi,et al.  Apperceptive and Associative Forms of Prosopagnosia , 1991, Cortex.

[17]  K Willmes,et al.  An approach to analyzing a single subject's scores obtained in a standardized test with application to the Aachen Aphasia Test (AAT). , 1985, Journal of clinical and experimental neuropsychology.

[18]  Tim M. Gale,et al.  When is category specific in dementia of Alzheimer's type ? , 2007 .

[19]  Jeremy MG Taylor,et al.  Robust Statistical Modeling Using the t Distribution , 1989 .

[20]  Paul H. Garthwaite,et al.  Methods of testing for a deficit in single-case studies: Evaluation of statistical power by Monte Carlo simulation , 2006, Cognitive neuropsychology.

[21]  R. Greenberg.  Biometry , 1969, The Yale Journal of Biology and Medicine.

[22]  Erminio Capitani,et al.  Normative Data and Neuropsychological Assessment. Common Problems in Clinical Practice and Research , 1997 .

[23]  D. C. Howell.  Statistical Methods for Psychology , 1987 .

[24]  K. J. Plasterk.  Louis Costa and The Journal of Clinical (and Experimental) Neuropsychology , 1998 .

[25]  Jordan Grafman,et al.  Handbook of Neuropsychology , 1991 .

[26]  J. R Crawford,et al.  Differential deficits in expression recognition in gene-carriers and patients with Huntington’s disease , 2003, Neuropsychologia.

[27]  T. Postelnicu,et al.  Sokal, R. R., and I. J. Rohlf: Biometry. W. H. Freeman and Company, San Francisco 1969, XXI + 776 S., 89 Abb., 56 Tab., Preis 126/— , 1970 .

[28]  P. Garthwaite,et al.  Evaluation of criteria for classical dissociations in single-case studies by Monte Carlo simulation. , 2005, Neuropsychology.

[29]  Tim M. Gale,et al.  When is Category Specific in Alzheimer's Disease? , 2005, Cortex.

[30]  A. Kimber.  Methods for the two-piece normal distribution , 1985 .

[31]  A. Caramazza,et al.  The case for single-patient studies , 1988 .

[32]  John R. Crawford,et al.  Psychometric Foundations of Neuropsychological Assessment , 2005 .

[33]  Laura H. Goldstein,et al.  Clinical neuropsychology: a practical guide to assessment and management for clinicians , 2005 .

[34]  Paul H Garthwaite,et al.  Testing for suspected impairments and dissociations in single-case studies in neuropsychology: evaluation of alternatives using monte carlo simulations and revised tests for dissociations. , 2005, Neuropsychology.

[35]  A. Schnider,et al.  Receptive amusia: temporal auditory processing deficit in a professional musician following a left temporo-parietal lesion , 2004, Neuropsychologia.

[36]  A. Azzalini,et al.  Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t‐distribution , 2003, 0911.2342.

[37]  G. Engel,et al.  Neuropsychology , 1994, Schizophrenia Research.