Human–Robot Gesture Analysis for Objective Assessment of Autism Spectrum Disorder

In this paper we study the use of human robot interaction as a mean to objectively evaluate imitation deficits in children with autism. Robot control and data analysis methods were combined to assess the quality of interaction between the robot and the subjects. Humanoid robot Zeno was used to execute upper body gestures which the subjects were asked to imitate. The resulting motion of the subject was acquired through a motion capture system and compared with the intended motion performed by Zeno using the dynamic time warping (DTW) algorithm. During this study, the clinical hypothesis was that the resulting DTW cost can serve as a quantitative measure for the similarity between the motions, and thus can be used to objectively assess the severity of imitation deficits exhibited by the child. To validate this hypothesis, we present two sets of experiments, one with a set of healthy adults and the other with a group of children, some with autism spectrum disorder. The experiment with adult subjects serves as a statistically significant test to demonstrate the viability of the DTW cost as a similarity measure for the gesture analysis, whereas the experiment with child subjects is a pilot study to differentiate imitation performance for children with autism.

[1]  Marcelo H. Ang,et al.  Why Robots? A Survey on the Roles and Benefits of Social Robots in the Therapy of Children with Autism , 2013, International Journal of Social Robotics.

[2]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[3]  G. W. Hughes,et al.  Minimum Prediction Residual Principle Applied to Speech Recognition , 1975 .

[4]  Kerstin Dautenhahn,et al.  A Pilot Study with a Novel Setup for Collaborative Play of the Humanoid Robot KASPAR with Children with Autism , 2014, Int. J. Soc. Robotics.

[5]  Ayanna M. Howard,et al.  Quantifying upper-arm rehabilitation metrics for children through interaction with a humanoid Robot , 2012, HRI 2012.

[6]  Tohru Matsumoto,et al.  Mimicking and Evaluating Human Motion to Improve the Imitation Skill of Children with Autism Through a Robot , 2011, Int. J. Soc. Robotics.

[7]  L. Kanner.  Autistic disturbances of affective contact. , 1968, Acta paedopsychiatrica.

[8]  Nathan Clark,et al.  Implementation of interactive arm playback behaviors of social robot Zeno for autism spectrum disorder therapy , 2012, PETRA '12.

[9]  R. Bellman,et al.  FUNCTIONAL APPROXIMATIONS AND DYNAMIC PROGRAMMING , 1959 .

[10]  Luthffi Idzhar Ismail,et al.  Initial Response in HRI- a Case Study on Evaluation of Child with Autism Spectrum Disorders Interacting with a Humanoid Robot NAO , 2012 .

[11]  B. Robins,et al.  Does appearance matter in the interaction of children with autism with a humanoid robot , 2006 .

[12]  Panagiotis Papapetrou,et al.  Benchmarking dynamic time warping for music retrieval , 2010, PETRA '10.

[13]  Filomena O. Soares,et al.  Detection of stereotyped hand flapping movements in Autistic children using the Kinect sensor: A case study , 2014, 2014 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[14]  Peter Clote,et al.  BTW: a web server for Boltzmann time warping of gene expression time series , 2006, Nucleic Acids Res..

[15]  E. Barakova,et al.  Promoting question-asking in school-aged children with autism spectrum disorders: Effectiveness of a robot intervention compared to a human-trainer intervention , 2013, Developmental neurorehabilitation.

[16]  Daniel J. Ricks,et al.  Trends and considerations in robot-assisted autism therapy , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Kerstin Dautenhahn,et al.  Using a Humanoid Robot to Elicit Body Awareness and Appropriate Physical Interaction in Children with Autism , 2015, Int. J. Soc. Robotics.

[18]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[19]  Dan O. Popa,et al.  Human-Robot Upper Body Gesture Imitation Analysis for Autism Spectrum Disorders , 2013, ICSR.

[20]  R. Christiansen,et al.  Detecting and locating key words in continuous speech using linear predictive coding , 1977 .

[21]  C. Gillberg,et al.  A twin study of autism in Denmark, Finland, Iceland, Norway and Sweden. , 1989, Journal of child psychology and psychiatry, and allied disciplines.

[22]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[23]  Eamonn J. Keogh,et al.  Exact indexing of dynamic time warping , 2002, Knowledge and Information Systems.

[24]  Matt Stevenson,et al.  RoDiCA: a human-robot interaction system for treatment of childhood autism spectrum disorders , 2012, PETRA '12.

[25]  Vassilis Athitsos,et al.  Sign language recognition using dynamic time warping and hand shape distance based on histogram of oriented gradient features , 2014, PETRA.

[26]  Daniel H. Geschwind,et al.  Advances in autism. , 2009, Annual review of medicine.

[27]  Cathy Craig,et al.  Sensory-motor problems in Autism , 2013, Front. Integr. Neurosci..

[28]  Fillia Makedon,et al.  Enhanced therapeutic interactivity using social robot Zeno , 2011, PETRA '11.

[29]  N. Rinehart,et al.  Movement Preparation in High-Functioning Autism and Asperger Disorder: A Serial Choice Reaction Time Task Involving Motor Reprogramming , 2001, Journal of autism and developmental disorders.

[30]  Catherine J. Stevens,et al.  Dynamic dance warping: Using dynamic time warping to compare dance movement performed under different conditions , 2014, MOCO.

[31]  Nilanjan Sarkar,et al.  Autonomous robot-mediated imitation learning for children with autism , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Vassilis Athitsos,et al.  A System for Large Vocabulary Sign Search , 2010, ECCV Workshops.

[33]  Maja J. Mataric,et al.  Using Socially Assistive Human–Robot Interaction to Motivate Physical Exercise for Older Adults , 2012, Proceedings of the IEEE.

[34]  A. Tapus,et al.  Children with Autism Social Engagement in Interaction with Nao, an Imitative Robot - A Series of Single Case Experiments , 2012 .

[35]  Kerstin Dautenhahn,et al.  Tactile Interactions with a Humanoid Robot: Novel Play Scenario Implementations with Children with Autism , 2014, Int. J. Soc. Robotics.

[36]  D M Baer,et al.  The development of imitation by reinforcing behavioral similarity to a model. , 1967, Journal of the experimental analysis of behavior.

[37]  Jason M. O'Kane,et al.  CHARLIE : An Adaptive Robot Design with Hand and Face Tracking for Use in Autism Therapy , 2011, Int. J. Soc. Robotics.