A Communication System on Smart Phones and Tablets for Non-verbal Children with Autism

We designed, developed and evaluated an Augmentative and Alternative Communication (AAC) system, AutVisComm, for children with autism that can run on smart phones and tablets. An iterative design and development process was followed, where the prototypes were developed in close collaboration with the user group, and the usability testing was gradually expanded to larger groups. In the last evaluation stage described here, twenty-four children with autism used AutVisComm to learn to request the desired object. We measured their learning rates and correlated them with their behavior traits (as observed by their teachers) like joint attention, symbolic processing and imitation. We found that their ability for symbolic processing did not correlate with the learning rate, but their ability for joint attention did. This suggests that this system (and this class of AACs) helps to compensate for a lack of symbolic processing, but not for a lack of joint-attention mechanism.

[1]  Jacob O. Wobbrock,et al.  In the shadow of misperception: assistive technology use and social interactions , 2011, CHI.

[2]  Nava Tintarev,et al.  Using NLG and Sensors to Support Personal Narrative for Children with Complex Communication Needs , 2010, SLPAT@NAACL.

[3]  Gillian R. Hayes,et al.  vSked: evaluation of a system to support classroom activities for children with autism , 2010, CHI.

[4]  Christopher Frauenberger,et al.  Social Communication between Virtual Characters and Children with Autism , 2011, AIED.

[5]  J. Piaget Play, dreams and imitation in childhood , 1951 .

[6]  Wolfgang L. Zagler,et al.  Computers Helping People with Special Needs, 12th International Conference, ICCHP 2010, Vienna, Austria, July 14-16, 2010, Proceedings, Part II , 2010, ICCHP.

[7]  G. Dawson,et al.  Early Predictors of Communication Development in Young Children with Autism Spectrum Disorder: Joint Attention, Imitation, and Toy Play , 2006, Journal of autism and developmental disorders.

[8]  S. Baron-Cohen,et al.  Does the autistic child have a “theory of mind” ? , 1985, Cognition.

[9]  L. LeBlanc,et al.  Using the picture exchange communication system (PECS) with children with autism: assessment of PECS acquisition, speech, social-communicative behavior, and problem behavior. , 2002, Journal of applied behavior analysis.

[10]  Matteo Matteucci,et al.  An Adaptive and Predictive Environment to Support Augmentative and Alternative Communication , 2004, ICCHP.

[11]  Samuel C. Sennott,et al.  Autism, AAC, and Proloquo2Go , 2009 .

[12]  F. Volkmar,et al.  An evaluation of the autism behavior checklist , 1988, Journal of autism and developmental disorders.