Self-Expression by Design: Co-Designing the ExpressiBall with Minimally-Verbal Children on the Autism Spectrum

Expressing one's thoughts and feelings is a fundamental human need - the basis for communication and social interaction. We ask, how do minimally-verbal children on the autism spectrum express themselves? How can we better recognise instances of self-expression? And how might technologies support and encourage self-expression? To address these questions, we undertook co-design research at an autism-specific primary school with 20 children over one school year. This paper contributes six Modalities of Self-Expression, through which children self-express and convey their design insights. Each modality of self-expression can occur across two different dimensions (socio-expressive and auto-expressive) and can be of a fundamental or an integrative nature. Further, we contribute the design trajectory of a tangible ball prototype, the ExpressiBall, which - through voice, sounds, lights, and motion sensors - explores how tangible technologies can support this range of expressive modalities. Finally, we discuss the concept of Self-Expression by Design.

[1]  Judith Gould,et al.  Describing the Sensory Abnormalities of Children and Adults with Autism , 2007, Journal of autism and developmental disorders.

[2]  B. Prizant,et al.  The functions of immediate echolalia in autistic children. , 1981, The Journal of speech and hearing disorders.

[3]  S. Nagarajan,et al.  Sensory Processing in Autism: A Review of Neurophysiologic Findings , 2011, Pediatric Research.

[4]  Yulia Zhiglova The Interactive Carpet - Smart Textile Interface for Children on Autism Spectrum Disorder , 2018, Tangible and Embedded Interaction.

[5]  Christina T Fuentes,et al.  No Proprioceptive Deficits in Autism Despite Movement-Related Sensory and Execution Impairments , 2011, Journal of autism and developmental disorders.

[6]  Christopher Frauenberger,et al.  Embodied Companion Technologies for Autistic Children , 2016, Tangible and Embedded Interaction.

[7]  Alessandro Soro,et al.  Technology Individuation: The Foibles of Augmented Everyday Objects , 2017, CHI.

[8]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[9]  Kenneth K Poon,et al.  To What Extent Do Joint Attention, Imitation, and Object Play Behaviors in Infancy Predict Later Communication and Intellectual Functioning in ASD? , 2011, Journal of Autism and Developmental Disorders.

[10]  Andrea Alessandrini,et al.  Designing ReduCat: Audio-Augmented Paper Drawings Tangible Interface in Educational Intervention for High-Functioning Autistic Children , 2016, IDC.

[11]  L. Vygotsky Play and Its Role in the Mental Development of the Child , 1967 .

[12]  Christopher Frauenberger,et al.  Creating creative spaces for co-designing with autistic children: the concept of a , 2016, PDC.

[13]  Chloe Silverman,et al.  NeuroTribes: The Legacy of Autism and the Future of Neurodiversity by Steve Silberman (review) , 2015 .

[14]  Danielle Wilde,et al.  The hipdiskettes: learning (through) wearables , 2008, OZCHI '08.

[15]  Asimina Vasalou,et al.  The bits & atoms of play: critical engagements with intercultural meaning making , 2018, IDC.

[16]  Connie Kasari,et al.  Minimally Verbal School‐Aged Children with Autism Spectrum Disorder: The Neglected End of the Spectrum , 2013, Autism research : official journal of the International Society for Autism Research.

[17]  Anne Marie Piper,et al.  Making as Expression: Informing Design with People with Complex Communication Needs through Art Therapy , 2018, CHI.

[18]  G. Landreth Play therapy: The art of relationship, 3rd ed. , 2012 .

[19]  Gustavo A. Reinoso,et al.  Proprioceptive processing difficulties among children with autism spectrum disorders and developmental disabilities. , 2012, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[20]  Lizbeth Escobedo,et al.  SensoryPaint: a natural user interface supporting sensory integration in children with neurodevelopmental disorders , 2014, CHI Extended Abstracts.

[21]  Laura Malinverni,et al.  Experience as an Object to Think with: from Sensing-in-action to Making-Sense of action in Full-Body Interaction Learning Environments , 2016, TEI.

[22]  Lilia B. Villafuerte,et al.  Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable , 2012, CHI Extended Abstracts.

[23]  Mathilde M. Bekker,et al.  Tangible Play Objects: Influence of Different Combinations of Feedback Modalities , 2016, Tangible and Embedded Interaction.

[24]  Ole Iversen,et al.  Child as Protagonist: Expanding the Role of Children in Participatory Design , 2017, IDC.

[25]  F Yamada,et al.  Self expression. , 1981, [Kango kyoiku] Japanese journal of nurses' education.

[26]  Laura Malinverni,et al.  Multimodal methodological approach for participatory design of Full-Body Interaction Learning Environments , 2018, Qualitative Research.

[27]  Arne Berger,et al.  Bricks, Blocks, Boxes, Cubes, and Dice: On the Role of Cubic Shapes for the Design of Tangible Interactive Devices , 2018, Conference on Designing Interactive Systems.

[28]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[29]  Margot Brereton,et al.  MyWord: enhancing engagement, interaction and self-expression with minimally-verbal children on the autism spectrum through a personal audio-visual dictionary , 2018, IDC.

[30]  U. Neisser Five kinds of self‐knowledge , 1988 .

[31]  A. Waterman,et al.  The Implications of Two Conceptions of Happiness (Hedonic Enjoyment and Eudaimonia) for the Understanding of Intrinsic Motivation , 2008 .

[32]  Heejung S. Kim,et al.  Culture and self-expression. , 2007 .

[33]  N. Minshew,et al.  Abstract reasoning in autism: a dissociation between concept formation and concept identification. , 2002, Neuropsychology.

[34]  G. Landreth Play Therapy: The Art of the Relationship , 1991 .

[35]  Caroline Hummels,et al.  Designing for Embodied Being-in-the-World: Two Cases, Seven Principles and One Framework , 2017, TEI.

[36]  Nick Bryan-Kinns,et al.  Mazi: Tangible Technologies as a Channel for Collaborative Play , 2019, CHI.

[37]  Gil Weinberg,et al.  The embroidered musical ball: a squeezable instrument for expressive performance , 2000, CHI Extended Abstracts.

[38]  Carey Jewitt,et al.  Multimodal methods for researching digital technologies , 2013 .

[39]  Margot Brereton,et al.  Design from the everyday: continuously evolving, embedded exploratory prototypes , 2010, Conference on Designing Interactive Systems.

[40]  Berry Eggen,et al.  Interactive play objects and the effects of open-ended play on social interaction and fun , 2008, ACE '08.

[41]  Jenna K. Gillett-Swan,et al.  Assuring children’s human right to freedom of opinion and expression in education , 2018, International journal of speech-language pathology.

[42]  Matthew Chalmers,et al.  Pass the Ball: Enforced Turn-Taking in Activity Tracking , 2015, CHI.

[43]  Monica Tentori,et al.  BendableSound: a Fabric-based Interactive Surface to Promote Free Play in Children with Autism , 2015, ASSETS.

[44]  Chi Thanh Vi,et al.  Multisensory Experiences in HCI , 2017, IEEE MultiMedia.

[45]  Gillian R. Hayes,et al.  Making in Minecraft: A Means of Self-Expression for Youth with Autism , 2017, IDC.

[46]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[47]  Nicola Yuill,et al.  In my own words: configuration of tangibles, object interaction and children with autism , 2010, IDC.

[48]  Margot Brereton,et al.  Design after design to bridge between people living with cognitive or sensory impairments, their friends and proxies , 2015 .

[49]  Christopher Frauenberger,et al.  The Things We Play with Roles of Technology in Social Play , 2018, CHI PLAY.

[50]  M. Sicart Play Matters , 2014 .

[51]  Andrea Cera,et al.  The urban musical game: using sport balls as musical interfaces , 2012, CHI EA '12.

[52]  J. Piaget Play, dreams and imitation in childhood , 1951 .

[53]  Joëlle Coutaz,et al.  Applying the Wizard of Oz Technique to the Study of Multimodal Systems , 1993, EWHCI.

[54]  Elvin Karana,et al.  Foundations of Materials Experience: An Approach for HCI , 2015, CHI.

[55]  Wendy Keay-Bright,et al.  Is simplicity the key to engagement for children on the autism spectrum? , 2012, Personal and Ubiquitous Computing.

[56]  Margot Brereton,et al.  Digital Strategies for Supporting Strengths- and Interests-based Learning with Children with Autism , 2017, ASSETS.

[57]  Ali Israr,et al.  Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI , 2016, CHI Extended Abstracts.

[58]  Alissa Nicole Antle,et al.  Inquiring materials for tangible prototyping , 2008, TEI.

[59]  C. Kasari,et al.  Joint attention and symbolic play in young children with autism: a randomized controlled intervention study. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[60]  Caroline Hummels,et al.  Beyond distributed representation: embodied cognition design supporting socio-sensorimotor couplings , 2014, TEI '14.

[61]  Allison Druin,et al.  Cooperative inquiry: developing new technologies for children with children , 1999, CHI '99.

[62]  Margot Brereton,et al.  Co-Design Beyond Words: 'Moments of Interaction' with Minimally-Verbal Children on the Autism Spectrum , 2019, CHI.

[63]  Mariellen Griffith Empowering Techniques of Play Therapy: A Method for Working with Sexually Abused Children. , 1997 .

[64]  Jessica L. Benham Giving voice: mobile communication, disability, and inequality , 2017 .

[65]  Barbara B. Kawulich Participant Observation as a Data Collection Method , 2005 .

[66]  Christopher Frauenberger,et al.  Designing Smart Objects with Autistic Children: Four Design Exposès , 2016, CHI.

[67]  Ben Matthews,et al.  Easy doesn’t do it: skill and expression in tangible aesthetics , 2007, Personal and Ubiquitous Computing.

[68]  Paul Dourish,et al.  Where the action is , 2001 .

[69]  Franceli L. Cibrian Music therapy on interactive surfaces to improve sensorimotor problems of children with autism , 2016, ASAC.