Attention-driven read-aloud technology increases reading comprehension in children with reading disabilities

The paper presents the design of an assistive reading tool that integrates read-aloud technology with eye-tracking to regulate the speed of reading and support struggling readers in following the text while listening to it. The paper describes the design rationale of this approach, following the theory of auditory-visual integration, in terms of an automatic self-adaptable technique based on the reader's gaze that provides an individualized interaction experience. This tool has been assessed in a controlled experiment with 20 children (aged 8-10 years) with a diagnosis of dyslexia and a control group of 20 children with typical reading abilities. The results show that children with reading difficulties improved their comprehension scores by 24% measured on a standardized instrument for the assessment of reading comprehension, and that children with more inaccurate reading (N=9) tended to benefit more. The findings are discussed in terms of a better integration between audio and visual text information, paving the way to improve standard read-aloud technology with gaze-contingency and self-adaptable techniques to personalize the reading experience.

[1]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[2]  L. Verhoeven,et al.  Responsiveness to Intervention in Children with Dyslexia. , 2016, Dyslexia.

[3]  H. Buzick,et al.  A Meta‐Analysis of Research on the Read Aloud Accommodation , 2014 .

[4]  Kenneth Eklund,et al.  A mobile game as a support tool for children with severe difficulties in reading and spelling , 2020, J. Comput. Assist. Learn..

[5]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[6]  J. Stein.  What is Developmental Dyslexia? , 2018, Brain sciences.

[7]  S. Valdois,et al.  Developmental dyslexia: The visual attention span deficit hypothesis , 2007, Cognition.

[8]  Renee O. Hawkins,et al.  Comparing the Efficiency of Repeated Reading and Listening-While-Reading to Improve Fluency and Comprehension , 2015 .

[9]  A. Olson,et al.  Reduced attentional capacity, but normal processing speed and shifting of attention in developmental dyslexia: Evidence from a serial task , 2011, Cortex.

[10]  J. Fisk,et al.  Working memory functioning in developmental dyslexia , 2007, Memory.

[11]  Kara Dawson,et al.  Assistive Technologies to Support Students With Dyslexia , 2018, TEACHING Exceptional Children.

[12]  Sally E. Shaywitz,et al.  Overcoming Dyslexia: A New and Complete Science-Based Program for Reading Problems at Any Level , 2003 .

[13]  W. Marks,et al.  Specific Impairment in Developmental Reading Disabilities , 2004, Journal of learning disabilities.

[14]  N. Gaab,et al.  Comorbidity of reading disabilities and ADHD: Structural and functional brain characteristics , 2019, Human brain mapping.

[15]  D H Klatt,et al.  Review of text-to-speech conversion for English. , 1987, The Journal of the Acoustical Society of America.

[16]  U. Goswami.  A temporal sampling framework for developmental dyslexia , 2011, Trends in Cognitive Sciences.

[17]  Chen Chen,et al.  Shorter Lines Facilitate Reading in Those Who Struggle , 2013, PloS one.

[18]  M. Snowling,et al.  Subtypes of developmental dyslexia , 1997 .

[19]  Hongli Li.  The Effects of Read-Aloud Accommodations for Students With and Without Disabilities: A Meta-Analysis , 2014 .

[20]  J. Fletcher,et al.  Specific reading disability (dyslexia): what have we learned in the past four decades? , 2004, Journal of child psychology and psychiatry, and allied disciplines.

[21]  Catherine Snow,et al.  Reading for Understanding: Toward an R&D Program in Reading Comprehension , 2002 .

[22]  Marco van de Ven,et al.  Early reading intervention by means of a multicomponent reading game , 2017, J. Comput. Assist. Learn..

[23]  Shinichi Nakagawa,et al.  A general and simple method for obtaining R2 from generalized linear mixed‐effects models , 2013 .

[24]  Simone Gori,et al.  “Shall We Play a Game?”: Improving Reading Through Action Video Games in Developmental Dyslexia , 2015, Current Developmental Disorders Reports.

[25]  I. Svensson,et al.  Assistive technology applications for students with reading difficulties: special education teachers’ experiences and perceptions , 2018, Disability and rehabilitation. Assistive technology.

[26]  C. Houston-Price,et al.  Listening while reading promotes word learning from stories. , 2018, Journal of experimental child psychology.

[27]  C. Clifton,et al.  Prosodic phrasing is central to language comprehension , 2006, Trends in Cognitive Sciences.

[28]  Paola Palladino,et al.  Intrusion errors in working memory tasks , 2000 .

[29]  Patrizio Emanuele Tressoldi,et al.  DDE-2,Batteria per la valutazione della dislessia e della disortografia evolutiva-2. , 2007 .

[30]  L. Justice.  Evidence-based practice, response to intervention, and the prevention of reading difficulties. , 2006, Language, speech, and hearing services in schools.

[31]  Eliane Segers,et al.  Effects of audio support on multimedia learning processes and outcomes in students with dyslexia , 2020, Comput. Educ..

[32]  V. Muter,et al.  Children at Familial Risk of Dyslexia: Practical Implications from an At-Risk Study , 2009 .

[33]  Philip B. Gough,et al.  Decoding, Reading, and Reading Disability , 1986 .

[34]  L. Petrosini,et al.  Do children with developmental dyslexia have an implicit learning deficit? , 2005, Journal of Neurology, Neurosurgery & Psychiatry.

[35]  J. Ziegler,et al.  Reading acquisition, developmental dyslexia, and skilled reading across languages: a psycholinguistic grain size theory. , 2005, Psychological bulletin.

[36]  S. Gori,et al.  Spatial and temporal attention in developmental dyslexia , 2014, Front. Hum. Neurosci..

[37]  P. Östberg,et al.  The Compensatory Effect of Text-to-Speech Technology on Reading Comprehension and Reading Rate in Swedish Schoolchildren With Reading Disability , 2018 .

[38]  Susanne Boll,et al.  Towards a gaze-contingent reading assistance for children with difficulties in reading , 2020, ASSETS.

[39]  Jean Écalle,et al.  Audio-visual training in children with reading disabilities , 2006, Comput. Educ..

[40]  Pushing the Speed of Assistive Technologies for Reading , 2018, Mind, Brain, and Education.

[41]  Margaret E. Bausch,et al.  Assistive Technologies for Reading. , 2006 .

[42]  F. Ramus,et al.  What Phonological Deficit? , 2008, Quarterly journal of experimental psychology.

[43]  L. Bigozzi,et al.  Reading Fluency As a Predictor of School Outcomes across Grades 4–9 , 2017, Front. Psychol..

[44]  Pascal Guitton,et al.  Online e-learning and cognitive disabilities: A systematic review , 2019, Comput. Educ..

[45]  Michael J. Hannafin,et al.  Scaffolding in technology-enhanced learning environments , 2007, Interact. Learn. Environ..

[46]  Jerad H. Moxley,et al.  Does Use of Text-to-Speech and Related Read-Aloud Tools Improve Reading Comprehension for Students With Reading Disabilities? A Meta-Analysis , 2018, Journal of learning disabilities.

[47]  B. Pennington.  From single to multiple deficit models of developmental disorders , 2006, Cognition.

[48]  Woori Kim,et al.  Critical Factors in Reading Comprehension Instruction for Students with Learning Disabilities: A Research Synthesis , 2012 .

[49]  J. Gabrieli.  Dyslexia: A New Synergy Between Education and Cognitive Neuroscience , 2009, Science.

[50]  M. Snowling,et al.  Early identification and interventions for dyslexia: a contemporary view. , 2012, Journal of research in special educational needs : JORSEN.

[51]  M. L. Kelly,et al.  Do children with developmental dyslexia have impairments in implicit learning? , 2010, Dyslexia.

[52]  Arnout Koornneef,et al.  Beginning readers might benefit from digital texts presented in a sentence-by-sentence fashion. But why? , 2019, Comput. Hum. Behav..

[53]  Theodore Lim,et al.  Technology-based reading intervention programs for elementary grades: An analytical review , 2019, Comput. Educ..

[54]  Wouter Duyck,et al.  Short-term memory for order but not for item information is impaired in developmental dyslexia , 2014, Annals of dyslexia.

[55]  Francesca Peressotti,et al.  Lexical Effects in Naming Pseudowords in Shallow Orthographies: Further Empirical Data , 1998 .

[56]  D. Spinelli,et al.  Modeling individual differences in text reading fluency: a different pattern of predictors for typically developing and dyslexic readers , 2014, Front. Psychol..

[57]  Wouter Duyck,et al.  Order or disorder? Impaired Hebb learning in dyslexia. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[58]  G. David Garson,et al.  Fundamentals of Hierarchical Linear and Multilevel Modeling , 2012 .

[59]  T. Pansell,et al.  Screening for Dyslexia Using Eye Tracking during Reading , 2016, PloS one.

[60]  D. Shankweiler,et al.  Phonology and the Problems of Learning to Read and Write , 1985 .

[61]  Mark Brosnan,et al.  Executive functioning in adults and children with developmental dyslexia , 2002, Neuropsychologia.

[62]  Andreas Dengel,et al.  The eyeBook – Using Eye Tracking to Enhance the Reading Experience , 2010, Informatik-Spektrum.

[63]  Gina Biancarosa,et al.  Technology Tools to Support Reading in the Digital Age , 2013, The Future of children.

[64]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[65]  Gerhard Sonnert,et al.  Using Technology to Support STEM Reading , 2010 .

[66]  J. Black,et al.  The multiple deficit model of dyslexia: what does it mean for identification and intervention? , 2018, Annals of Dyslexia.

[67]  Charles Hulme,et al.  Reading disorders and dyslexia , 2016, Current opinion in pediatrics.

[68]  G. Tindal,et al.  Effects of a Read-Aloud Modification on a Standardized Reading Test , 2004, Large-scale Testing of Students With Disabilities.

[69]  A. B. D. S. Kida,et al.  Reading Comprehension Assessment through Retelling: Performance Profiles of Children with Dyslexia and Language-Based Learning Disability , 2016, Front. Psychol..

[70]  Anne Castles,et al.  The genesis of reading ability: what helps children learn letter-sound correspondences? , 2009, Journal of experimental child psychology.

[71]  Therese M. Cumming,et al.  Expanding Horizons for Students with Dyslexia in the 21st Century: Universal Design and Mobile Technology. , 2013 .

[72]  Katharina Galuschka,et al.  Effectiveness of Treatment Approaches for Children and Adolescents with Reading Disabilities: A Meta-Analysis of Randomized Controlled Trials , 2014, PloS one.

[73]  Ulla Richardson,et al.  Identification of Reading Difficulties by a Digital Game-Based Assessment Technology , 2020 .

[74]  Renee O. Hawkins,et al.  The effects of two assistive technologies on reading comprehension accuracy and rate , 2019, Assistive technology : the official journal of RESNA.

[75]  Trichur Raman Vidyasagar.  Visual attention and neural oscillations in reading and dyslexia: Are they possible targets for remediation? , 2019, Neuropsychologia.

[76]  Jim Rose,et al.  Identifying and teaching children and young people with dyslexia and literacy difficulties : an independent report , 2009 .

[77]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.