Using tangible user interfaces in computer-based training systems for low-functioning autistic children

In this paper, the design of a computer-based training (CBT) system for low-functioning autistic children is addressed. The emphasis is on ease-of-use and learning efficiency of CBT systems with different interaction styles, namely the WIMP (Window Icon Menu Pointing Device) and TUI (Tangible User Interface) interaction styles. Two WIMP-based CBT systems with different pointing devices were involved in the study. The first system applied a standard computer mouse as a pointing device, while the second one employed a touch screen instead. For the TUI-based CBT system, a tabletop setting was adopted. Based on the known characteristics of TUI and children with autism, as well as related cognitive and learning theories, the benefits of TUI for low-functioning autistic children have been investigated. Elementary skill teaching was chosen as a case study for performance evaluation of these CBT systems. Empirical results show that the touch-based and TUI-based systems offered much better ease-of-use performance than that of the mouse-based system. Regarding learning efficacy, experimental results show that the TUI-based system achieved higher skill improvement, as compared with the WIMP-based system and a non-computer training method. Some guidelines and suggestions for the design of a TUI-based system for children with autism are summarized.

[1]  Anne Marie Piper,et al.  SIDES: A Cooperative Tabletop Computer Game for Social Skills Development , 2022 .

[2]  C. Gillberg,et al.  Increasing reading and communication skills in children with autism through an interactive multimedia computer program , 1995, Journal of autism and developmental disorders.

[3]  N. Chotikakamthorn,et al.  Comparative study of WIMP and tangible user interfaces in training shape matching skill for autistic children , 2007, TENCON 2007 - 2007 IEEE Region 10 Conference.

[4]  Randall Boone,et al.  Creating Individualized Computer-Assisted Instruction for Students with Autism Using Multimedia Authoring Software , 1996 .

[5]  Gillian R. Hayes,et al.  vSked: an interactive visual schedule system for use in classrooms for children with autism , 2010, IDC.

[6]  Claire R. Robert.  Breakthroughs In Autism: An Intimate Journey , 1997, CNS Spectrums.

[7]  Dominic W. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Language and Vocabulary Learning , 2003 .

[8]  K. Dautenhahn,et al.  Towards interactive robots in autism therapy: background, motivation and challenges , 2004 .

[9]  P. Langdon,et al.  Designing a More Inclusive World , 2012 .

[10]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[11]  D. Keen,et al.  Engagement of Children With Autism in Learning , 2009 .

[12]  Yvonne Rogers,et al.  Using 'tangibles' to promote novel forms of playful learning , 2003, Interact. Comput..

[13]  Gerardo Herrera,et al.  Development of symbolic play through the use of virtual reality tools in children with autistic spectrum disorders , 2008, Autism : the international journal of research and practice.

[14]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[15]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[16]  B. Fouse.  Creating a "Win-Win IEP" for students with autism , 1996 .

[17]  Tristram H. Smith,et al.  Generalization between receptive and expressive language in young children with autism , 2003 .

[18]  Janet C. Read,et al.  User-oriented design and tangible interaction for kindergarten children , 2009, IDC.

[19]  P. Yoder,et al.  Restricted object use in young children with autism , 2007, Autism : the international journal of research and practice.

[20]  Jane Yung-jen Hsu,et al.  Playful Tray: Adopting Ubicomp and Persuasive Techniques into Play-Based Occupational Therapy for Reducing Poor Eating Behavior in Young Children , 2007, UbiComp.

[21]  E. Hollander.  Textbook of Autism Spectrum Disorders , 2010 .

[22]  M. Terwogt,et al.  Understanding Atypical Emotions Among Children with Autism , 2000, Journal of autism and developmental disorders.

[23]  Eva Hornecker,et al.  Tangible User Interfaces , 2010 .

[24]  John M. Carroll,et al.  Human-Computer Interaction in the New Millennium , 2001 .

[25]  Daniel J. Ricks,et al.  Trends and considerations in robot-assisted autism therapy , 2010, 2010 IEEE International Conference on Robotics and Automation.

[26]  Fabio Pianesi,et al.  Collaborative Puzzle Game: a tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD) , 2009, ITS '09.

[27]  Hayes Solos Raffle,et al.  Collaborative Benefits of a Tangible Interface for Autistic Children , 2009 .

[28]  Fred R. Volkmar.  Autism and Pervasive Developmental Disorders: List of contributors , 2007 .

[29]  Ali Mazalek,et al.  Teaching table: a tangible mentor for pre-k math education , 2007, TEI.

[30]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[31]  D. Moore,et al.  Computer-Aided Learning for People with Autism – a Framework for Research and Development , 2000 .

[32]  Chi-Wei Lee,et al.  Development of a Geometry Learning Game with Tangible User Interfaces , 2008 .

[33]  A. Billard,et al.  Effects of repeated exposure to a humanoid robot on children with autism , 2004 .

[34]  O. Hetzroni,et al.  Effects of a Computer-Based Intervention Program on the Communicative Functions of Children with Autism , 2004, Journal of autism and developmental disorders.

[35]  Darren Edge.  Tangible user interfaces for peripheral interaction : episodic engagement with objects of physical, digital & social significance , 2008 .

[36]  Temple Grandin,et al.  Thinking in Pictures: And Other Reports From My Life With Autism , 1996 .

[37]  David F. Cihak,et al.  Using Computer-Assisted Instruction and the Nonverbal Reading Approach to Teach Word Identification , 2005 .

[38]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.

[39]  Allison Druin,et al.  Child's play: a comparison of desktop and physical interactive environments , 2005, IDC '05.

[40]  R. Stromer,et al.  Computer-Presented Video Models to Teach Generative Spelling to a Child with an Autism Spectrum Disorder , 2003 .

[41]  Cynthia E. Pearl,et al.  Restricted Interests as Motivators: Improving Academic Engagement and Outcomes of Children on the Autism Spectrum. , 2008 .

[42]  Sandra L. Calvert,et al.  Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction , 2000, Journal of autism and developmental disorders.

[43]  M. Silver,et al.  Evaluation of a New Computer Intervention to Teach People with Autism or Asperger Syndrome to Recognize and Predict Emotions in Others , 2001, Autism : the international journal of research and practice.

[44]  Gillian R. Hayes,et al.  Interactive visual supports for children with autism , 2010, Personal and Ubiquitous Computing.

[45]  Jun Ye,et al.  Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment - The pilot study , 2010, Comput. Educ..

[46]  Lars Liden,et al.  Behavioral Improvements Associated with Computer-Assisted Instruction for Children with Developmental Disabilities , 2006 .

[47]  N. Sriram,et al.  Enhancing Social Problem Solving in Children with Autism and Normal Children Through Computer-Assisted Instruction , 2001, Journal of autism and developmental disorders.

[48]  Nopporn Chotikakamthorn,et al.  Evaluation the Efficacy of Computer - Based Training Using Tangible User Interface for Low-Function Children with Autism , 2008, 2008 Second IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[49]  T. Whitman.  The Development of Autism: A Self-Regulatory Perspective , 2004 .

[50]  P. Mitchell,et al.  Finding a place to sit: a preliminary investigation into the effectiveness of virtual environments for social skills training for people with autistic spectrum disorders , 2002 .

[51]  Jason M. O'Kane,et al.  Adaptive Robot Design with Hand and Face Tracking for Use in Autism Therapy , 2010, ICSR.

[52]  H. Kozima,et al.  Children-robot interaction: a pilot study in autism therapy. , 2007, Progress in brain research.

[53]  Jiao Jian-li.  Literature Review in Learning with Tangible Technologies , 2008 .

[54]  Jakob Tholander,et al.  Towards a new set of ideals: consequences of the practice turn in tangible interaction , 2008, TEI.

[55]  Rita Jordan,et al.  Understanding and teaching children with autism , 1995 .

[56]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[57]  Gregory D. Abowd,et al.  Pervasive Computing and Autism: Assisting Caregivers of Children with Special Needs , 2007, IEEE Pervasive Computing.

[58]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[59]  G. Mesibov,et al.  Brief report: Two case studies using virtual reality as a learning tool for autistic children , 1996, Journal of autism and developmental disorders.

[60]  Carolyn A. Unsworth,et al.  The Importance of Pretend Play in Child Development: An Occupational Therapy Perspective , 2000 .

[61]  L. LeBlanc,et al.  Use of Technology in Interventions for Children with Autism , 2004 .

[62]  R. Romanczyk,et al.  Autism and Pervasive Developmental Disorders , 2012 .

[63]  L. Ruble,et al.  Individual and Environmental Determinants of Engagement in Autism , 2007, Journal of autism and developmental disorders.