Engaging Chinese Children with Autism to Interact with Portable Hand- and Finger-Gesture Based Applications: Experiment and Reflections

Recent work by researchers in China has demonstrated the potential for collaborative play as an educational tool for children on the Autism Spectrum Disorder (ASD). In this paper, researchers in the United States and China investigate the potential for accessible interface design and learning by students with ASD. Through the use of known tools and interventions, an educational protocol has been designed to evaluate two applications. The pilot studies, including experimental design and outcomes, are presented here, and provide a solid foundation for comparative assessment of mid-air finger-gesture interaction as well as hand-gesture interaction. Early results in China are promising, based on experiences in the United States.

[1]  Fabio Pianesi,et al.  Collaborative Puzzle Game: a tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD) , 2009, ITS '09.

[2]  L. LeBlanc,et al.  Use of Technology in Interventions for Children with Autism , 2004 .

[3]  M. Prior,et al.  Motor imitation abilities and neurological signs in autistic children , 1985, Journal of autism and developmental disorders.

[4]  Russell Lang,et al.  Increasing play and decreasing the challenging behavior of children with autism during recess with activity schedules and task correspondence training , 2009 .

[5]  Alberto Barbosa Raposo,et al.  Exploring Collaboration Patterns in a Multitouch Game to Encourage Social Interaction and Collaboration Among Users with Autism Spectrum Disorder , 2014, Computer Supported Cooperative Work (CSCW).

[6]  Franca Garzotto,et al.  Exploring motion-based touchless games for autistic children's learning , 2013, IDC.

[7]  Jane Case-Smith,et al.  Evidence-based review of interventions for autism used in or of relevance to occupational therapy. , 2008, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[8]  M. Behrmann,et al.  Seeing it differently: visual processing in autism , 2006, Trends in Cognitive Sciences.

[9]  Pinata Winoto,et al.  Supporting Multiplayer Online Ball Passing at a Distance with Multiple Sets of Kinect , 2015, SOCO 2015.

[10]  Claire R. Robert.  Breakthroughs In Autism: An Intimate Journey , 1997, CNS Spectrums.

[11]  Temple Grandin,et al.  Visual Abilities and Sensory Differences in a Person with Autism , 2009, Biological Psychiatry.

[12]  Leeanne M. Carey,et al.  Fish Oil Diet Associated with Acute Reperfusion Related Hemorrhage, and with Reduced Stroke-Related Sickness Behaviors and Motor Impairment , 2014, Front. Neurol..

[13]  Helena M. Mentis,et al.  The mocking gaze: the social organization of kinect use , 2013, CSCW.

[14]  D. A. Hill,et al.  Moving on: autism and movement disturbance. , 1996, Mental retardation.

[15]  Wei Shou,et al.  Interaction design patterns for multi-touch tabletop collaborative games , 2012, CHI EA '12.

[16]  Clark R Dickerson,et al.  Evaluation of a portable markerless finger position capture device: accuracy of the Leap Motion controller in healthy adults , 2015, Physiological measurement.

[17]  Mirko Gelsomini,et al.  Designing and evaluating touchless playful interaction for ASD children , 2014, IDC.

[18]  Lizbeth Escobedo,et al.  SensoryPaint: a natural user interface supporting sensory integration in children with neurodevelopmental disorders , 2014, CHI Extended Abstracts.

[19]  R. Shadmehr,et al.  Representation of internal models of action in the autistic brain , 2009, Nature Neuroscience.

[20]  Tiffany Ya Tang,et al.  Having Fun Over a Distance: Supporting Multiplayer Online Ball Passing Using Multiple Sets of Kinect , 2015, CHI Extended Abstracts.

[21]  Stewart H Mostofsky,et al.  Developmental dyspraxia is not limited to imitation in children with autism spectrum disorders , 2006, Journal of the International Neuropsychological Society.

[22]  Gaoxia Zhu,et al.  A Series of Leap Motion-Based Matching Games for Enhancing the Fine Motor Skills of Children with Autism , 2015, 2015 IEEE 15th International Conference on Advanced Learning Technologies.

[23]  Lawrie S. McKay,et al.  Vision in autism spectrum disorders , 2009, Vision Research.

[24]  Chelsea La Valle.  Chinese Cultural Factors Impacting the Educational Schooling of Children with Autism in China , 2013 .

[25]  M. Brimacombe,et al.  Prevalence of motor impairment in autism spectrum disorders , 2007, Brain and Development.

[26]  M. Silver,et al.  Evaluation of a New Computer Intervention to Teach People with Autism or Asperger Syndrome to Recognize and Predict Emotions in Others , 2001, Autism : the international journal of research and practice.

[27]  Gillian R. Hayes,et al.  Interactive visual supports for children with autism , 2010, Personal and Ubiquitous Computing.

[28]  C. Kasari,et al.  Joint attention and symbolic play in young children with autism: a randomized controlled intervention study. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[29]  Mirko Gelsomini,et al.  Motion-based touchless interaction for ASD children: a case study , 2014, AVI.

[30]  C. Hass,et al.  Motor Coordination in Autism Spectrum Disorders: A Synthesis and Meta-Analysis , 2010, Journal of autism and developmental disorders.

[31]  John Law,et al.  Cognitive and Physiological Processes Underlying Drawing Skills , 2017 .

[32]  Lori-Ann R. Sacrey,et al.  Reaching and Grasping in Autism Spectrum Disorder: A Review of Recent Literature , 2013, Front. Neurol..

[33]  S. Nagarajan,et al.  Sensory Processing in Autism: A Review of Neurophysiologic Findings , 2011, Pediatric Research.