Touchless Motion-Based Interaction for Therapy of Autistic Children

Autism is a pervasive developmental disorder characterized by abnormal behaviors along multiple dimensions (socialization, communication, and imagination). An increasing number of technologies devoted to children with autism have appeared in the research arena and the marketplace. Our interest is on interactive tools that exploit motion-based touchless interaction, where technology can be controlled using body movements and gestures without wearing additional aides (e.g., data gloves, head mounted display, remote controllers, or body markers). In spite of the increasing popularity of this interaction paradigm, its adoption in therapeutic and educational contexts for autistic children is very limited and research in this domain is still in its infancy. The chapter provides an overview of the current state of the art and describes a field study and that explores the benefits of motion-based touchless gaming for autistic children with low-moderate cognitive deficit, low-medium sensory-motor dysfunction, and motor autonomy. Our findings show that motion-based touchless gaming led to improvements of attention skills for all participants to own study, and suggest future research directions in interactive technology for autistic children.

[1]  ParesNarcis,et al.  Achieving Dialogue with Children with Severe Autism in an Adaptive Multisensory Interaction , 2005 .

[2]  Sukeshini A. Grandhi,et al.  Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces , 2011, CHI.

[3]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[4]  Jesse Schell,et al.  The Art of Game Design: A book of lenses , 2019 .

[5]  J. Bruner,et al.  Play: Its Role in Development and Evolution , 1976 .

[6]  Noel Kok Hwee Chia,et al.  Design of a generic questionnaire for reflective evaluation of a virtual reality-based intervention using virtual dolphins for children with autism , 2012 .

[7]  Thomas B. Moeslund,et al.  A procedure for developing intuitive and ergonomic gesture interfaces for man-machine interaction , 2003 .

[8]  S. Shamsuddin,et al.  Initial response of autistic children in human-robot interaction therapy with humanoid robot NAO , 2012, 2012 IEEE 8th International Colloquium on Signal Processing and its Applications.

[9]  W. Brouwer,et al.  Clinical Neuropsychology of Attention , 1994 .

[10]  Kerstin Dautenhahn,et al.  Therapeutic and educational objectives in robot assisted play for children with autism , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[11]  L. Gauthier,et al.  The Bells Test: A quantitative and qualitative test for visual neglect. , 1989 .

[12]  M. Rutter.  Diagnosis and definition of childhood autism , 1978, Journal of autism and childhood schizophrenia.

[13]  Jane Yung-jen Hsu,et al.  Playful Tray: Adopting Ubicomp and Persuasive Techniques into Play-Based Occupational Therapy for Reducing Poor Eating Behavior in Young Children , 2007, UbiComp.

[14]  Er. Zainab Pirani.  Gesture Based Educational Software for Children with Acquired Brain Injuries , 2010 .

[15]  Hannah Hoch,et al.  Teaching Children with Autism to Play a Video Game Using Activity Schedules and Game-Embedded Simultaneous Video Modeling , 2010 .

[16]  T. F. McLaughlin,et al.  EDUCATIONAL GAMES: A TECHNIQUE TO ACCELERATE THE ACQUISITION OF READING SKILLS OF CHILDREN WITH LEARNING DISABILITIES , 2005 .

[17]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[18]  R. Brickenkamp,et al.  D2 Test of Attention , 1998 .

[19]  Shing-Tsaan Huang,et al.  The Effects of Using Embodied Interactions to Improve Learning Performance , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[20]  Inmaculada Coma,et al.  A Kinect-based Augmented Reality System for Individuals with Autism Spectrum Disorders , 2018, GRAPP/IVAPP.

[21]  D. Murray,et al.  Attention, monotropism and the diagnostic criteria for autism , 2005, Autism : the international journal of research and practice.

[22]  Paul Dourish,et al.  Where the action is , 2001 .

[23]  Thomas B. Moeslund,et al.  A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI , 2003, Gesture Workshop.

[24]  Peter Mitchell,et al.  Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder , 2006, Comput. Educ..

[25]  Nopporn Chotikakamthorn,et al.  Evaluation the Efficacy of Computer - Based Training Using Tangible User Interface for Low-Function Children with Autism , 2008, 2008 Second IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[26]  Gregory D. Abowd,et al.  Monitoring children’s developmental progress using augmented toys and activity recognition , 2012, Personal and Ubiquitous Computing.

[27]  Hui-mei Justina Hsu.  The Potential of Kinect as Interactive Educational Technology , 2011 .

[28]  Norman H. Villaroman,et al.  Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor , 2011, SIGITE '11.

[29]  Janice Light,et al.  Supporting the Communication, Language, and Literacy Development of Children with Complex Communication Needs: State of the Science and Future Research Priorities , 2012, Assistive technology : the official journal of RESNA.

[30]  Narcís Parés,et al.  Achieving dialogue with children with severe autism in an adaptive multisensory interaction: the "MEDIATE" project , 2005, IEEE Transactions on Visualization and Computer Graphics.

[31]  Maria Roussou,et al.  Exploring rules and underlying concepts while engaged with collaborative full-body games , 2010, IDC.

[32]  R. Jordan.  Social Play and Autistic Spectrum Disorders , 2003, Autism : the international journal of research and practice.

[33]  Juan Pablo Hourcade,et al.  Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders , 2012, Personal and Ubiquitous Computing.

[34]  Hiroshi Ishii,et al.  Design of haptic interfaces for therapy , 2009, CHI.

[35]  Matthew S. Goodwin,et al.  Exploring speech therapy games with children on the autism spectrum , 2009, INTERSPEECH.

[36]  P. Robinson,et al.  The emotional hearing aid: an assistive tool for children with Asperger syndrome , 2005, Universal Access in the Information Society.

[37]  Mark Evans.  Gestural Interfaces in Learning , 2012 .

[38]  Nadia Bianchi-Berthouze,et al.  Does Body Movement Engage You More in Digital Game Play? and Why? , 2007, ACII.

[39]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.

[40]  Wendy Keay-Bright,et al.  Is simplicity the key to engagement for children on the autism spectrum? , 2012, Personal and Ubiquitous Computing.