Look at me and grab this! Materiality and the practices around negotiation of social attention with children on the autistic spectrum

In this paper, we present a tangible tool that supports therapists in engaging autistic children on simple educational activities of categorization of objects. The tool has been designed to digitally augment an approach routinely used in cognitive training. An initial pilot evaluation provides evidence of its effectiveness of engaging children and focusing their attention on a given task. A novel aspect of this work is the possibility offered to therapists by the material aspect of the tool to positively influence social attention of children. This work, although preliminary, contributes as a design case study to understanding of the relationship between social practices and the design space for digital artifacts that are built to support these practices.

[1]  Massimo Zancanaro,et al.  Three around a Table: The Facilitator Role in a Co-located Interface for Social Competence Training of Children with Autism Spectrum Disorder , 2011, INTERACT.

[2]  Connie Svabo,et al.  Materiality in a practice‐based approach , 2009 .

[3]  Matt Bower,et al.  How is the use of technology in education evaluated? A systematic review , 2019, Comput. Educ..

[4]  O. Grynszpan,et al.  Innovative technology-based interventions for autism spectrum disorders: A meta-analysis , 2014, Autism : the international journal of research and practice.

[5]  J. Swettenham.  Can children with autism be taught to understand false belief using computers? , 1996, Journal of child psychology and psychiatry, and allied disciplines.

[6]  Mirko Gelsomini,et al.  Creating Social Stories as Wearable Hyper-Immersive Virtual Reality Experiences for Children with Neurodevelopmental Disorders , 2017, IDC.

[7]  Dinah K.C. Murray,et al.  Autism and information technology: therapy with computers , 2011 .

[8]  Nopporn Chotikakamthorn,et al.  Using tangible user interfaces in computer-based training systems for low-functioning autistic children , 2011, Personal and Ubiquitous Computing.

[9]  Graeme G. Shanks,et al.  Positivist single case study research in information systems: a critical analysis , 2003, ECIS.

[10]  Paul Dourish,et al.  Where the action is , 2001 .

[11]  David Cohen,et al.  Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD) , 2017, Comput. Educ..

[12]  M. Zancanaro,et al.  Increasing social engagement in children with high-functioning autism spectrum disorder using collaborative technologies in the school environment , 2013, Autism : the international journal of research and practice.

[13]  Kerstin Dautenhahn,et al.  Developing a protocol and experimental setup for using a humanoid robot to assist children with autism to develop visual perspective taking skills , 2019, Paladyn J. Behav. Robotics.

[14]  Taciana Pontual Falcão.  Tangible Representational Properties: Implications for Meaning Making , 2018 .

[15]  W. Staal,et al.  Self-regulation and quality of life in high-functioning young adults with autism , 2016, Autism : the international journal of research and practice.

[16]  D. Moore,et al.  Computer-Aided Learning for People with Autism – a Framework for Research and Development , 2000 .

[17]  Narcís Parés,et al.  Sparking social initiation behaviors in children with Autism through full-body Interaction , 2017, Int. J. Child Comput. Interact..

[18]  Donna S. Murray,et al.  Strategies For Enhancing Play Skills For Children With Autism Spectrum Disorder , 2001 .

[19]  Shrikanth S. Narayanan,et al.  Rachel: Design of an emotionally targeted interactive agent for children with autism , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[20]  R. Tennyson,et al.  The Teaching of Concepts: A Review of Instructional Design Research Literature , 1980 .

[21]  Alberto Barbosa Raposo,et al.  ComFiM: a game for multitouch devices to encourage communication between people with autism , 2014, 2014 IEEE 3nd International Conference on Serious Games and Applications for Health (SeGAH).

[22]  Narcis Pares,et al.  Structuring collaboration: Multi-user full-body interaction environments for children with Autism Spectrum Disorder , 2019, Research in Autism Spectrum Disorders.

[23]  N. Sriram,et al.  Enhancing Social Problem Solving in Children with Autism and Normal Children Through Computer-Assisted Instruction , 2001, Journal of autism and developmental disorders.

[24]  Silvana Mareva,et al.  Do Tangible User Interfaces promote social behaviour during free play? A comparison of autistic and typically-developing children playing with passive and digital construction toys , 2019, Research in Autism Spectrum Disorders.

[25]  Christine Nadel,et al.  Case Study Research Design And Methods , 2016 .

[26]  Helen Pain,et al.  Designing for young children with autism spectrum disorder: A case study of an iPad app , 2016, Int. J. Child Comput. Interact..

[27]  Juan Pablo Hourcade,et al.  Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders , 2013, CHI.

[28]  Jill Taylor,et al.  Interactive Multimedia Systems for Students with Autism , 2000 .

[29]  Andrii Matviienko,et al.  Challenges For Designing Tangible Systems , 2017 .

[30]  Patrizia Marti,et al.  Robots supporting play for children with physical disabilities: Exploring the potential of IROMEC , 2017 .

[31]  Gerhard Fischer,et al.  End-User Development and Meta-design: Foundations for Cultures of Participation , 2009, IS-EUD.

[32]  Taciana Pontual Falcão.  Action-effect mappings in tangible interaction for children with intellectual disabilities , 2017, Int. J. Learn. Technol..

[33]  E. Rosch.  Cognitive Representations of Semantic Categories. , 1975 .

[34]  Carmelo Ardito,et al.  From smart objects to smart experiences: An end-user development approach , 2017, Int. J. Hum. Comput. Stud..

[35]  Massimo Zancanaro,et al.  Using Innovative Technologies as Therapeutic and Educational Tools for Children with Autism Spectrum Disorder , 2019, Virtual Reality for Psychological and Neurocognitive Interventions.

[36]  Stelios Xinogalos,et al.  Studying the effects of computer serious games on people with intellectual disabilities or autism spectrum disorder: A systematic literature review , 2018, J. Comput. Assist. Learn..

[37]  Franca Garzotto,et al.  An open-ended tangible environment for disabled children's learning , 2011, IDC.

[38]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[39]  Janet B W Williams.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[40]  Angèle L. M. Cavaye,et al.  Case study research: a multi‐faceted research approach for IS , 1996, Inf. Syst. J..

[41]  Micol Spitale,et al.  Multicriteria Decision Analysis and Conversational Agents for Children with Autism , 2020, HICSS.

[42]  Fabio Paternò,et al.  Understanding ASD individuals' difficulties with managing money: an interactive study , 2019, ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction.

[43]  Charles Fage,et al.  Effectiveness and usability of technology-based interventions for children and adolescents with ASD: A systematic review of reliability, consistency, generalization and durability related to the effects of intervention , 2017, Comput. Hum. Behav..

[44]  Lilia B. Villafuerte,et al.  Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable , 2012, CHI Extended Abstracts.

[45]  Kevin Durkin,et al.  Videogames and Young People with Developmental Disorders , 2010 .

[46]  Fabio Paternò,et al.  Enabling personalisation of remote elderly assistance , 2019, Multimedia Tools and Applications.

[47]  Nicola Yuill,et al.  An augmented toy and social interaction in children with autism , 2012, Int. J. Arts Technol..

[48]  S. Parsons,et al.  State-of-the-art of virtual reality technologies for children on the autism spectrum , 2011 .

[49]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[50]  Patrizia Marti,et al.  Tangible Technologies for the Development of Play Skills in Autistic Children , 2016, ACHI 2016.

[51]  Robert D. Tennyson,et al.  Concept Learning by Children Using Instructional Presentation Forms for Prototype Formation and Classification-Skill Development. , 1983 .

[52]  Liam J. Bannon,et al.  The turn to practice in HCI: towards a research agenda , 2014, CHI.

[53]  Fabio Paternò,et al.  End-user development for personalizing applications, things, and robots , 2019, Int. J. Hum. Comput. Stud..

[54]  Flavia Chiarotti,et al.  Are touch screen technologies more effective than traditional educational methods in children with autism spectrum disorders? A pilot study. , 2019, Annali dell'Istituto superiore di sanita.

[55]  Deborah Sturm,et al.  eMot-iCan: Design of an assessment game for emotion recognition in players with Autism , 2016, 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH).

[56]  Hilary Johnson,et al.  Designing computer-based rewards with and for children with Autism Spectrum Disorder and/or Intellectual Disability , 2017, Comput. Hum. Behav..

[57]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[58]  Volker Wulf,et al.  Socio-Informatics: A Practice-Based Perspective on the Design and Use of IT Artifacts , 2018 .

[59]  Hussein Al Osman,et al.  A Serious Game for children with Autism Spectrum Disorder as a tool for play therapy , 2017, 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH).