State-of-the-art in TEL to support social communication skill development in children with autism: a multi-disciplinary review

The paper reviews state-of-the-art in Technology Enhanced Learning TEL to support social communication skill development in children with autism. We identify the driving research directions, and their associated challenges, from three broad perspectives that shape TEL: pedagogical foundations, technology and learner involvement in the design process. We further explore these challenges through the discussion of ECHOES, an example state-of-the-art system. The review assists researchers working in multi-disciplinary teams to identify the new directions that are shaping state-of-the-art in order to drive successful future research projects in this area.

[1]  Oliver Lemon,et al.  Robust Facial Feature Detection and Tracking for Head Pose Estimation in a Novel Multimodal Interface for Social Skills Learning , 2009, ISVC.

[2]  Daniel Polani,et al.  On-line behaviour classification and adaptation to human-robot interaction styles , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Rana El Kaliouby,et al.  Self-Cam: feedback from what would be your social partner , 2006, SIGGRAPH '06.

[4]  Shrikanth S. Narayanan,et al.  A review of ASR technologies for children's speech , 2009, WOCCI.

[5]  A. Bailey,et al.  Autism and pervasive developmental disorders , 2004 .

[6]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[7]  B. Ingersoll,et al.  The use of innovative computer technology for teaching social communication to individuals with autism spectrum disorders , 2011 .

[8]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[9]  Anne Marie Piper,et al.  SIDES: A Cooperative Tabletop Computer Game for Social Skills Development , 2022 .

[10]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[11]  Matthew S. Goodwin,et al.  Technology for just-in-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder , 2008, Assets '08.

[12]  S. Baron-Cohen,et al.  Enhancing Emotion Recognition in Children with Autism Spectrum Conditions: An Intervention Using Animated Vehicles with Real Emotional Faces , 2010, Journal of autism and developmental disorders.

[13]  Stephen Camarata,et al.  Increasing Speech Intelligibility in Children with Autism , 1998, Journal of autism and developmental disorders.

[14]  Sue Cobb,et al.  Participatory design approach with children with autism , 2011 .

[15]  Oliver Watts,et al.  Synthesis of Child Speech With HMM Adaptation and Voice Conversion , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[16]  N. Yuill,et al.  Social benefits of a tangible user interface for children with Autistic Spectrum Conditions , 2010, Autism.

[17]  Hilary Johnson,et al.  IDEAS: an interface design experience for the autistic spectrum , 2011, CHI Extended Abstracts.

[18]  C. Frauenberger,et al.  Designing technology for children with special needs: bridging perspectives through participatory design , 2011 .

[19]  Dc Washington Diagnostic and Statistical Manual of Mental Disorders, 4th Ed. , 1994 .

[20]  Gwen Littlewort,et al.  The computer expression recognition toolbox (CERT) , 2011, Face and Gesture 2011.

[21]  Pieter Jan Stappers,et al.  The Puzzling Life of Autistic Toddlers: Design Guidelines from the LINKX Project , 2008, Adv. Hum. Comput. Interact..

[22]  Christopher Frauenberger,et al.  Supporting children's social communication skills through interactive narratives with virtual characters , 2010, ACM Multimedia.

[23]  Maja J. Mataric,et al.  Automated detection and classification of positive vs. negative robot interactions with children with autism using distance-based features , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Phoebe Sengers,et al.  The Three Paradigms of HCI , 2007 .

[25]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[26]  S. Parsons,et al.  State-of-the-art of virtual reality technologies for children on the autism spectrum , 2011 .

[27]  Christopher Frauenberger,et al.  Interpreting input from children: a designerly approach , 2012, CHI.

[28]  Juan Pablo Hourcade,et al.  Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders , 2012, Personal and Ubiquitous Computing.

[29]  Rosalind W. Picard,et al.  Affective Computing and Autism , 2006, Annals of the New York Academy of Sciences.

[30]  J. Sigafoos,et al.  Communication Intervention on the Playground: A case study on teaching requesting to a young child with autism , 1999 .

[31]  Trent W. Lewis,et al.  Development of a virtual agent based social tutor for children with autism spectrum disorders , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[32]  S. Folstein,et al.  Current directions in research on autism. , 2001, Mental retardation and developmental disabilities research reviews.

[33]  Massimo Zancanaro,et al.  Teaching social competence: in search of design patterns , 2010, IDC.

[34]  Narcís Parés,et al.  Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment , 2005, IDC '05.

[35]  Barry M. Prizant,et al.  The SCERTS® Model: A Comprehensive Educational Approach for Children with Autism Spectrum Disorders , 2004 .

[36]  S. Arnstein,et al.  Ladder of Citizen Participation , 2020 .

[37]  Brian Scassellati,et al.  The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents , 2011, Int. J. Soc. Robotics.