Open Book: a tool for helping ASD users’ semantic comprehension

Persons affected by Autism Spectrum Disorders (ASD) present impairments in social interaction. A significant percentile of them have inadequate reading comprehension skills. In the ongoing FIRST project we build a multilingual tool called Open Book that helps the ASD people to better understand the texts. The tool applies a series of automatic transformations to user documents to identify and remove the reading obstacles to comprehension. We focus on three semantic components: an Image component that retrieves images for the concepts in the text, an idiom detection component and a topic model component. Moreover, we present the personalization component that adapts the system output to user preferences.

[1]  Pat Mirenda,et al.  Sight word reading in children with developmental disabilities: a comparison of paired associate and picture-to-text matching instruction. , 2006, Research in developmental disabilities.

[2]  Tony Attwood,et al.  The complete guide to Asperger’s syndrome , 2007 .

[3]  Karen H. Douglas,et al.  The Effectiveness of Electronic Text and Pictorial Graphic Organizers to Improve Comprehension Related to Functional Skills , 2011 .

[4]  S. Baron-Cohen Theory of mind and autism: A review , 2000 .

[5]  Claire R. Robert Breakthroughs In Autism: An Intimate Journey , 1997, CNS Spectrums.

[6]  T. Grandin How does visual thinking work in the mind of a person with autism? A personal account , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  I. Sag,et al.  Idioms , 2015 .

[8]  E. Mikkelsen,et al.  Thinking in Pictures: And Other Reports From My Life With Autism , 1996 .

[9]  Beatriz López,et al.  Do children with autism fail to process information in context? , 2003, Journal of child psychology and psychiatry, and allied disciplines.

[10]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[11]  M. Just,et al.  Sentence comprehension in autism: thinking in pictures with decreased functional connectivity. , 2006, Brain : a journal of neurology.

[12]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[13]  William Gillispie SEMANTIC PROCESSING IN CHILDREN WITH READING COMPREHENSION DEFICITS , 2008 .