A Pilot Study on Facial Expression Recognition Ability of Autistic Children Using Ryan, A Rear-Projected Humanoid Robot

Rear-projected robots use computer graphics technology to create facial animations and project them on a mask to show the robot's facial cues and expressions. These types of robots are becoming commercially available, though more research is required to understand how they can be effectively used as a socially assistive robotic agent. This paper presents the results of a pilot study on comparing the facial expression recognition abilities of children with Autism Spectrum Disorder (ASD) with typically developing (TD) children using a rear-projected humanoid robot called Ryan. Six children with ASD and six TD children participated in this research, where Ryan showed them six basic expressions (i.e. anger, disgust, fear, happiness, sadness, and surprise) with different intensity levels. Participants were asked to identify the expressions portrayed by Ryan. The results of our study show that there is not any general impairment in expression recognition ability of the ASD group comparing to the TD control group; however, both groups showed deficiencies in identifying disgust and fear. Increasing the intensity of Ryan's facial expressions significantly improved the expression recognition accuracy. Both groups were successful to recognize the expressions demonstrated by Ryan with high average accuracy.

[1]  P. Ekman Are there basic emotions? , 1992, Psychological review.

[2]  D. Perrett,et al.  Detecting subtle facial emotion recognition deficits in high-functioning Autism using dynamic stimuli of varying intensities , 2010, Neuropsychologia.

[3]  Livia Colle,et al.  Impaired recognition of negative basic emotions in autism: A test of the amygdala theory , 2006, Social neuroscience.

[4]  F. Castelli,et al.  Understanding emotions from standardized facial expressions in autism and normal development , 2005, Autism : the international journal of research and practice.

[5]  Ronald A. Cole,et al.  Role of embodiment and presence in human perception of robots' facial cues , 2018, Int. J. Hum. Comput. Stud..

[6]  Brian Scassellati,et al.  Bridging the research gap , 2012, HRI 2012.

[7]  Marcello Ferro,et al.  Human-Robot Interaction in Autism: FACE, an Android-based Social Therapy , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[8]  S. Baron-Cohen Mindblindness: An Essay on Autism and Theory of Mind , 1997 .

[9]  H. Kozima,et al.  Children-robot interaction: a pilot study in autism therapy. , 2007, Progress in brain research.

[10]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[11]  A. Mayes,et al.  Convergent neuroanatomical and behavioural evidence of an amygdala hypothesis of autism , 2000, Neuroreport.

[12]  Daniel J. Ricks,et al.  Trends and considerations in robot-assisted autism therapy , 2010, 2010 IEEE International Conference on Robotics and Automation.

[13]  Zachary Warren,et al.  A Systematic Review of Early Intensive Intervention for Autism Spectrum Disorders , 2011, Pediatrics.

[14]  François Michaud,et al.  Exploring the use of a mobile robot as an imitation agent with children with low-functioning autism , 2008, Auton. Robots.

[15]  E. Bullmore,et al.  The amygdala theory of autism , 2000, Neuroscience & Biobehavioral Reviews.

[16]  Tony Belpaeme,et al.  Towards retro-projected robot faces: An alternative to mechatronic and android faces , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[17]  S. Rogers Developmental regression in autism spectrum disorders. , 2004, Mental retardation and developmental disabilities research reviews.

[18]  D. De Rossi,et al.  Realistic Humanlike Robots for Treatment of ASD, Social Training, and Research; Shown to Appeal to Youths with ASD, Cause Physiological Arousal, and Increase Human- to-Human Social Engagement , 2012, PETRA 2012.

[19]  Kerstin Dautenhahn,et al.  Using the Humanoid Robot KASPAR to Autonomously Play Triadic Games and Facilitate Collaborative Play Among Children With Autism , 2014, IEEE Transactions on Autonomous Mental Development.

[20]  Mohammad H. Mahoor,et al.  An emotion recognition comparative study of autistic and typically-developing children using the zeno robot , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Ronald A. Cole,et al.  ExpressionBot: An emotive lifelike robotic face for face-to-face communication , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[22]  Minoru Hashimoto,et al.  Facial expression of a robot using a curved surface display , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  S. Baron-Cohen The hyper-systemizing, assortative mating theory of autism , 2006, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[24]  C. Lord,et al.  Autism Diagnostic Observation Schedule , 2016 .

[25]  J. Piven,et al.  Visual Scanning of Faces in Autism , 2002, Journal of autism and developmental disorders.

[26]  B. Pennington,et al.  Are there emotion perception deficits in young autistic children? , 1990, Journal of child psychology and psychiatry, and allied disciplines.

[27]  Gabriel Skantze,et al.  The furhat Back-Projected humanoid Head-Lip Reading, gaze and Multi-Party Interaction , 2013, Int. J. Humanoid Robotics.

[28]  Antonia Hamilton,et al.  Recognition of Emotions in Autism: A Formal Meta-Analysis , 2013, Journal of autism and developmental disorders.

[29]  Kerstin Dautenhahn,et al.  From Isolation to Communication: A Case Study Evaluation of Robot Assisted Play for Children with Autism with a Minimally Expressive Humanoid Robot , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[30]  Antonio Cisternino,et al.  The FACE of autism , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[31]  Ofer Golan,et al.  The Cambridge Mindreading Face-Voice Battery for Children (CAM-C): complex emotion recognition in children with and without autism spectrum conditions , 2015, Molecular Autism.