The TalkingBox.: Revealing Strengths of Adults with Severe Cognitive Disabilities

In this paper, we present a case study of the iterative design of TalkingBox, a communication device designed with a person with a severe cognitive disability and his support network. TalkingBox combines graphic symbols with tangible technology to foster the use of symbolic communication by leveraging the person's strength and interest in memory matching games. In the course of designing, trialing and iterating the TalkingBox, we discovered that the design supported not only the development of symbolic communication, but also revealed new interests and strengths of our participant. TalkingBox highlighted opportunities for interactions with peers, revealed new skills in visual discrimination, and evidenced interests. These could, in turn, support staff and family to adapt their support. More importantly, TalkingBox had become a living portfolio presenting our participant with severe disability through the lens of their strengths. We discuss opportunities for research through co-design to open new avenues for future communication technologies.

[1]  Margot Brereton,et al.  Designing an IIR Research Apparatus with Users with Severe Intellectual Disability , 2020, CHIIR.

[2]  Margot Brereton,et al.  MyWord: Supporting the Interest-based Learning of Words through a Personal Visual Dictionary , 2017, Conference on Designing Interactive Systems.

[3]  Janice Light,et al.  New and emerging AAC technology supports for children with complex communication needs and their communication partners: State of the science and future research directions , 2019, Augmentative and alternative communication.

[4]  Mitchell A. Kaplan,et al.  A World Without Words: The Social Construction of Children Born Deaf And Blind , 1995 .

[5]  Alessandro Soro,et al.  Cross-Cultural Dialogical Probes , 2016, AfriCHI.

[6]  William W. Gaver,et al.  Design: Cultural probes , 1999, INTR.

[7]  Janice Light,et al.  Putting People First: Re-Thinking the Role of Technology in Augmentative and Alternative Communication Intervention , 2013, Augmentative and alternative communication.

[8]  Margot Brereton,et al.  Challenges and Opportunities in Using Augmentative and Alternative Communication (AAC) Technologies: Design Considerations for Adults with Severe Disabilities , 2019, OZCHI.

[9]  Margot Brereton,et al.  A respectful design approach to facilitate codesign with people with cognitive or sensory impairments and makers , 2019, CoDesign.

[10]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[11]  Anne Marie Piper,et al.  A Critical Lens on Dementia and Design in HCI , 2017, CHI.

[12]  Oussama Metatla,et al.  Not on any map: co-designing a meaningful bespoke technology with a child with profound learning difficulties , 2020, IDC.

[13]  Christopher A. Le Dantec,et al.  Strangers at the Gate: Gaining Access, Building Rapport, and Co-Constructing Community-Based Research , 2015, CSCW.

[14]  Anthony J. Hornof,et al.  Designing for the "Universe of One": Personalized Interactive Media Systems for People with the Severe Cognitive Impairment Associated with Rett Syndrome , 2017, CHI.

[15]  R. Sevcik,et al.  Breaking the speech barrier : language development through augmented means , 1996 .

[16]  Per-Anders Hillgren,et al.  Participatory design and "democratizing innovation" , 2010, PDC '10.

[17]  Margot Brereton,et al.  Co-Design Beyond Words: 'Moments of Interaction' with Minimally-Verbal Children on the Autism Spectrum , 2019, CHI.

[18]  Margot Brereton,et al.  Design after design to bridge between people living with cognitive or sensory impairments, their friends and proxies , 2015 .

[19]  P. Enderby,et al.  Barriers and facilitators to the use of high-technology augmentative and alternative communication devices: a systematic review and qualitative synthesis. , 2012, International journal of language & communication disorders.

[20]  Janice Light,et al.  Challenges and opportunities in augmentative and alternative communication: Research and technology development to enhance communication and participation for individuals with complex communication needs , 2019, Augmentative and alternative communication.