Usability of a Robot's Realistic Facial Expressions and Peripherals in Autistic Children's Therapy

Robot-assisted therapy is an emerging form of therapy for autistic children, although designing effective robot behaviors is a challenge for effective implementation of such therapy. A series of usability tests assessed trends in the effectiveness of modelling a robot's facial expressions on realistic facial expressions and of adding peripherals enabling child-led control of emotion learning activities with autistic children. Nineteen autistic children interacted with a small humanoid robot and an adult therapist in several emotion-learning activities that featured realistic facial expressions modelled on either a pre-existing database or live facial mirroring, and that used peripherals (tablets or tangible 'squishies') to enable child-led activities. Both types of realistic facial expressions by the robot were less effective than exaggerated expressions, with the mirroring being unintuitive for children. The tablet was usable but required more feedback and lower latency, while the tactile tangibles were engaging aids.

[1]  D. McIntosh,et al.  Rules versus Prototype Matching: Strategies of Perception of Emotional Facial Expressions in the Autism Spectrum , 2007, Journal of autism and developmental disorders.

[2]  Juan Pablo Hourcade,et al.  Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders , 2013, CHI.

[3]  Kristi Gaines,et al.  Designing for Autism Spectrum Disorders , 2016 .

[4]  Marit Korkman,et al.  NEPSY II: clinical and interpretive manual , 2007 .

[5]  Marina Umaschi Bers,et al.  Tangible interaction and learning: the case for a hybrid approach , 2012, Personal and Ubiquitous Computing.

[6]  Mohammad H. Mahoor,et al.  An emotion recognition comparative study of autistic and typically-developing children using the zeno robot , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  S. Nowicki,et al.  Individual differences in the nonverbal communication of affect: The diagnostic analysis of nonverbal accuracy scale , 1994 .

[8]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[9]  Christopher Frauenberger,et al.  Developing technology for autism: an interdisciplinary approach , 2011, Personal and Ubiquitous Computing.

[10]  Arif Raza,et al.  Usability issues for smartphone users with special needs — Autism , 2013, 2013 International Conference on Open Source Systems and Technologies.

[11]  N. Yuill,et al.  Social benefits of a tangible user interface for children with Autistic Spectrum Conditions , 2010, Autism : the international journal of research and practice.

[12]  Sigal Eden,et al.  Usability of technology supported social competence training for children on the Autism Spectrum , 2011, 2011 International Conference on Virtual Rehabilitation.

[13]  Stefanos Zafeiriou,et al.  The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[14]  Kerstin Dautenhahn,et al.  Eliciting Requirements for a Robotic Toy for Children with Autism - Results from User Panels , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.