The design and implementation of the Carolina Automated Reading Evaluation for reading deficit screening

Abstract This paper examines the design process and implementation of the Carolina Automated Reading Evaluation (CARE). Designed to automate the process of screening for reading deficits, CARE is an interactive computer-based tool that helps eliminate the need for one-on-one evaluations of pupils to detect dyslexia and other reading deficits. While other tests collect specific data points in order to determine whether a pupil has dyslexia, they typically focus on only a few metrics for diagnosis, such as handwriting analysis or eye tracking. The CARE collects data across up to 16 different subtests, each built to test proficiency in various reading skills. These skills include reading fluency, phoneme manipulation, sound blending, and many other essential skills for reading. This wide variety of measurements allows for a more focused intervention to be created for the pupil. For this study, elementary school pupils were tested both with the CARE and with the Dynamic Indicators of Basic Early Literacy Skills (DIBELS) test, a well-established screener for elementary school-level reading deficits. The data collected was used in a comparison of average scores, a gradient boosting tree classifier, and a convergence test to determine if there was any correlation between the CARE and DIBELS scores. Based on these comparisons, a correspondence was found between the two tests, showing that the CARE can detect reading deficits comparable to manually administered testing instruments. Based on these findings, the CARE could be used as a replacement for current tests, giving the users more detailed data at a faster rate. This paper reviews the technical development and preliminary analysis of the CARE. It also provides insights into key considerations when translating standard psychological screeners onto computerized platforms.

[1]  Rajendra M. Sonar,et al.  Evaluating and selecting software packages: A review , 2009, Inf. Softw. Technol..

[2]  E. Wijsman,et al.  Writing problems in developmental dyslexia: under-recognized and under-treated. , 2008, Journal of school psychology.

[3]  Kathleen Kennedy Manzo National Clout of DIBELS Test Draws Scrutiny. , 2005 .

[4]  Ricardo Baeza-Yates,et al.  Screening risk of dyslexia through a web-game using language-independent content and machine learning , 2020, W4A.

[5]  Increasing College Students' Engagement and Physical Activity with Classroom Brain Breaks , 2017 .

[6]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[7]  Barbara J. Wendling,et al.  The Woodcock–Johnson IV: Tests of cognitive abilities, tests of oral language, tests of achievement. , 2018 .

[8]  H. Scholte,et al.  Machine learning and dyslexia: Classification of individual structural neuro-imaging scans of students with and without dyslexia , 2016, NeuroImage: Clinical.

[9]  Bruce B. Frey,et al.  The Sage encyclopedia of educational research, measurement, and evaluation , 2018 .

[10]  N. Mather,et al.  Dyslexia laws in the USA , 2013, Annals of dyslexia.

[11]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[12]  T. Odegard,et al.  Evaluating the impact of dyslexia laws on the identification of specific learning disability and dyslexia , 2017, Annals of Dyslexia.

[13]  Elizabeth B. Meisinger,et al.  Test Review: Comprehensive Test of Phonological Processing–2nd ed. (CTOPP-2) by Wagner, R. K., Torgesen, J. K., Rashotte, C. A., & Pearson, N. A. , 2015 .

[14]  Michael L. Vanderwood,et al.  Predictive Accuracy of Nonsense Word Fluency for English Language Learners , 2008 .

[15]  Inés Couso,et al.  Diagnosis of dyslexia with low quality data with genetic fuzzy systems , 2010, Int. J. Approx. Reason..

[16]  Economics of MRI technology , 1996, Journal of magnetic resonance imaging : JMRI.

[17]  Antonis Katsiyannis,et al.  Child Find Activities Under the Individuals With Disabilities Education Act: Recent Case Law , 2017 .

[18]  A Digital App to Aid Detection, Monitoring, and Management of Dyslexia in Young Children (DIMMAND): Protocol for a Digital Health and Education Solution , 2018, JMIR research protocols.

[19]  Farrah B. Mann,et al.  The Condition of Education 2020. NCES 2020-144. , 2020 .

[20]  Elizabeth M. Frye,et al.  Three DIBELS Tasks vs. Three Informal Reading/Spelling Tasks: A Comparison of Predictive Validity , 2017 .

[21]  Stephen Camarata,et al.  Sex differences in processing speed: Developmental effects in males and females , 2006 .

[22]  M. Snowling,et al.  A Brief History of Dyslexia , 2008 .

[23]  J. Lerner,et al.  Educational interventions in learning disabilities. , 1989, Journal of the American Academy of Child and Adolescent Psychiatry.

[24]  Richard C Gershon,et al.  Use of Computer Adaptive Testing in the Development of Machine Learning Algorithmsp Origin and Efficiency of Cats , 2022 .

[25]  Luz Rello,et al.  Detecting readers with dyslexia using machine learning with eye tracking measures , 2015, W4A.

[26]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[27]  Silvana Watson,et al.  An Overview of Dyslexia: Definition, Characteristics, Assessment, Identification, and Intervention , 2019, Science Journal of Education.

[28]  E. Koppitz The Bender Gestalt Test for Young Children , 1964 .

[29]  Maria Papadopouli,et al.  DysLexML: Screening Tool for Dyslexia Using Machine Learning , 2019, ArXiv.

[30]  Ryan Ellett,et al.  The Use of Dynamic Indicators of Basic Early Language Skills (DIBELS) and Measures of Academic Progress (MAP) to Compare Reading Proficiency in Native English Speakers and English Language Learners. , 2014 .

[31]  M. Kunter,et al.  Assessing Teacher Candidates' General Pedagogical/Psychological Knowledge: Test Construction and Validation. , 2011 .

[32]  P. Falkai,et al.  Machine Learning Approaches for Clinical Psychology and Psychiatry. , 2018, Annual review of clinical psychology.

[33]  J. Hebebrand,et al.  [Genetics of reading-spelling difficulties]. , 1993, Zeitschrift fur Kinder- und Jugendpsychiatrie.

[34]  T. Pansell,et al.  Screening for Dyslexia Using Eye Tracking during Reading , 2016, PloS one.

[35]  G. Lyon,et al.  Learning Disabilities in the United States , 1993, Journal of learning disabilities.

[36]  B. Frei,et al.  Brain Breaks: Physical Activity in the Classroom for Elementary School Children , 2014 .

[37]  Are Scientific Reading Instruction and Dyslexia Interventions the Same? Distinctions for Elementary Education Preparation Programs. , 2020 .

[38]  R. Hambleton,et al.  Item Response Theory: Principles and Applications , 1984 .

[39]  David J. Weiss,et al.  APPLICATION OF COMPUTERIZED ADAPTIVE TESTING TO EDUCATIONAL PROBLEMS , 1984 .

[40]  Iza Sazanita Isa,et al.  Automated Detection of Dyslexia Symptom Based on Handwriting Image for Primary School Children , 2019, Procedia Computer Science.

[41]  Angela D. Friederici,et al.  Predicting early signs of dyslexia at a preliterate age by combining behavioral assessment with structural MRI , 2016, NeuroImage.

[42]  Kathleen Kennedy Manzo Throughout Year, New York District Offers Clusters of Enrichment to All Its Students. , 2006 .